-- Logs begin at Thu 2022-07-21 21:34:00 UTC, end at Thu 2022-07-21 22:45:44 UTC. -- Jul 21 22:15:14.732354 dv-cinder-850697-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 22:15:14.739574 dv-cinder-850697-1-smb devstack@keystone.service[80094]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 22:15:14 2022] *** Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: nodename: dv-cinder-850697-1-smb Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: machine: x86_64 Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: clock source: unix Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: pcre jit disabled Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: detected number of CPU cores: 4 Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: current working directory: / Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: detected binary path: /usr/bin/uwsgi-core Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: your processes number limit is 47680 Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: your memory page size is 4096 bytes Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: detected max file descriptor number: 2048 Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: lock engine: pthread robust mutexes Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: thunder lock: enabled Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 22:15:14.743686 dv-cinder-850697-1-smb devstack@keystone.service[80094]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 22:15:14.786764 dv-cinder-850697-1-smb devstack@keystone.service[80094]: Python main interpreter initialized at 0x55fc233d89c0 Jul 21 22:15:14.786764 dv-cinder-850697-1-smb devstack@keystone.service[80094]: python threads support enabled Jul 21 22:15:14.786764 dv-cinder-850697-1-smb devstack@keystone.service[80094]: your server socket listen backlog is limited to 100 connections Jul 21 22:15:14.786764 dv-cinder-850697-1-smb devstack@keystone.service[80094]: your mercy for graceful operations on workers is 90 seconds Jul 21 22:15:14.787127 dv-cinder-850697-1-smb devstack@keystone.service[80094]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 22:15:14.787201 dv-cinder-850697-1-smb devstack@keystone.service[80094]: *** Operational MODE: preforking *** Jul 21 22:15:14.787458 dv-cinder-850697-1-smb devstack@keystone.service[80094]: *** uWSGI is running in multiple interpreter mode *** Jul 21 22:15:14.787458 dv-cinder-850697-1-smb devstack@keystone.service[80094]: spawned uWSGI master process (pid: 80094) Jul 21 22:15:14.787663 dv-cinder-850697-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 21 22:15:14.788725 dv-cinder-850697-1-smb devstack@keystone.service[80094]: spawned uWSGI worker 1 (pid: 80106, cores: 1) Jul 21 22:15:14.788725 dv-cinder-850697-1-smb devstack@keystone.service[80094]: spawned uWSGI worker 2 (pid: 80107, cores: 1) Jul 21 22:15:14.788725 dv-cinder-850697-1-smb devstack@keystone.service[80094]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 22:15:20.162102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:15:20.162102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: from cryptography.utils import int_from_bytes Jul 21 22:15:20.162801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:15:20.162801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: from cryptography.utils import int_from_bytes Jul 21 22:15:20.166609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:15:20.166609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: from cryptography.utils import int_from_bytes Jul 21 22:15:20.167067 dv-cinder-850697-1-smb devstack@keystone.service[80106]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:15:20.167067 dv-cinder-850697-1-smb devstack@keystone.service[80106]: from cryptography.utils import int_from_bytes Jul 21 22:15:20.211369 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:15:20.211579 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:15:20.211763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] command line args: [] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:15:20.212032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:15:20.212210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ================================================================================ {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:15:20.212480 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] admin_token = **** {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.212755 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] config_dir = [] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.212985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.213183 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] config_source = [] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.213379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] debug = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.213619 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.213884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:15:20.213884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:15:20.213996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.214053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] command line args: [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:15:20.214189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.214348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:15:20.214428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.214550 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ================================================================================ {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:15:20.214667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.214825 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] admin_token = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.214916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] list_limit = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.215054 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] log_config_append = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.215168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] config_dir = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.215272 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.215367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.215469 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] log_dir = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.215573 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] config_source = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.215669 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] log_file = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.215774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] debug = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.215870 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.215964 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.216076 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.216152 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.216275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.216355 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.216514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.216600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.216687 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.216814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.216896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.216998 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.217113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.217193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_config_append = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.217322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.217398 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.217515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_dir = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.217596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.217674 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_file = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.217797 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.217884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.218012 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.218131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.218241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.218378 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.218486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.218619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.218730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.218809 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.218953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.219040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.219196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.219440 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.219575 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.219660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] publish_errors = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.219746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.219881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.219967 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.220181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.220259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.220416 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.220503 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.220662 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.220740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.220906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.221200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.221289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.221617 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] standard_threads = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.221696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.221865 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] publish_errors = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.221943 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.222099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.222190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.222295 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.222373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.222482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] use_journal = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.222612 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.222687 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] use_json = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.222757 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.222826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] use_stderr = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.222960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.223040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] use_syslog = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.223194 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] standard_threads = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.223275 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.223425 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.223548 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.223667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.223817 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.223923 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.224004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] use_journal = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.224126 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.224250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] use_json = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.224330 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] use_stderr = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.224408 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.224481 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] use_syslog = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.224638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.224725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:15:20.224883 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.225014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.225166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.225246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.225410 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.225488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.225699 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.225786 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.225952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.226154 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.226283 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.226427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.226627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.226707 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.226906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.226986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.227155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.227332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.227411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.227581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.227668 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.227838 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.227923 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.228096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.228175 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.228336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.228491 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.228568 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.228637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.228807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.228887 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.229092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.229187 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.229346 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.229424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.229594 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.229672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.229833 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.229925 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.230089 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.230174 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.230340 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.230418 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.230581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.230671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.230815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.230894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.231048 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.231127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.231281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.231867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.232043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.232122 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.232283 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.232362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.232515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.232593 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.232748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.232826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.233014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.233096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.233250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.233331 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.233495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.233573 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.233740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.233817 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.233979 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.234060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.234225 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.234303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.234458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.234536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.234685 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.234760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.234915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.234994 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.235150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.235229 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.235383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.235463 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.235615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.235700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.235849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.235928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.236085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.236170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.236326 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.236405 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.236556 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.236636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.236794 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.236873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.237049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.237130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.237288 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.237367 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.237525 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.237605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.237766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.237851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.237998 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.238106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.238235 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.238347 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.238474 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.238586 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.238712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.238816 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.238947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.239054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.239170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.239267 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.239403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.239509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.239635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.239720 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.239871 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.239966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.240108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.240187 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.240340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.240470 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.240585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.240665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.240823 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.240903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.241078 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.241158 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.241317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.241398 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.241555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.241636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.241825 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.241905 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.242064 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.242145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.242299 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.242372 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.242536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.242615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.242772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.242853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.243008 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.243088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.243243 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.243325 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.243481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.243562 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.243717 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.243795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.243953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.244043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.244191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.244271 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.244427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.244505 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.244660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.244746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.244897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.245018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.245154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.245232 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.245391 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.245483 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.245642 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.245721 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.245881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.245961 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.246119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.246269 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.246345 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.246414 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.246577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.246656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.246810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.246896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.247119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.247715 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.247846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.247927 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.248078 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.248156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.248311 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.248399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.248548 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.248628 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.248784 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.248864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.249038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.249134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.249284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.249364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.249523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.249601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.249770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.249864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.250009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.250088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.250261 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.250346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.250496 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] auth.external = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.250584 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.250734 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.250814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.250972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.external = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.251050 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.251205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.251312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.251477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] auth.password = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.251572 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.251711 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] auth.token = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.251790 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.251948 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.password = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.252027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.252182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.token = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.252264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.252423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.252503 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.252654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.252732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.252898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.253033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.253152 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.253222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.253403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.253525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.253642 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] credential.caching = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.253726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.253874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.253960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.254111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.254190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.254360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.254441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.254596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.254682 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.254842 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.254921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.255075 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.255161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.255321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.255400 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.255556 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.255636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.255808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.255887 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.256064 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.256143 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.256302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.256379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.256558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.256645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.256845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.256940 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.257116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.257193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.257377 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.257458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.257615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] federation.caching = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.257694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.257854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.257933 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.258096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.258175 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.258336 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.258414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.258567 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.258651 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.258816 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.258897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.259045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.259123 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.259293 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.259372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.259529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.259609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.259782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.259860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.260017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.260095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.260266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.260346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.260501 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.260584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity.caching = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.260748 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.260845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.261025 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.261103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.261246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.261335 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.261481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.261560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.261730 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.261856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.261967 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.262095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.262215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.262340 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.262448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.262617 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.262727 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.262876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.263095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.263182 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.263338 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.263417 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.263570 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.263649 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.263803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.263889 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.264034 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.264130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.264286 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.264371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.264535 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.264622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.264784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.264863 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.265065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.265146 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.265310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.265404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.265551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.265630 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.265785 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.265863 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.266023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.266113 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.266255 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.266334 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.266492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.266570 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.266726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.266813 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.266964 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.267049 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.267207 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.267287 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.267444 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.267530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.267693 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.267772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.267927 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.268007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.268164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.268250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.268412 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.268491 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.268654 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.268740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.268885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.268995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.269151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.269242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.269384 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.269503 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.269621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.269709 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.269854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.269932 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.270094 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.270182 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.270332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.270418 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.270575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.270654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.270815 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.270894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.271054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.271142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.271285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.271363 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.271518 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.271597 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.271763 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.271853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.271996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.272075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.272232 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.272310 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.272467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.272555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.272702 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.272782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.272957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.273041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.273190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.273281 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.273423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.273502 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.273664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.273749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.273910 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.273996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.274145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.274224 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.274395 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.274473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.274630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.274710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.274862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.274940 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.275098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.275173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.275331 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.275415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.275564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.275642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.275796 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.275875 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.276031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.276110 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.276262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.276355 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.276510 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.276589 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.276755 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.276838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.277019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.277100 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.277252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.277332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.277496 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.277577 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.277989 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.278068 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.278754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.278889 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.279039 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.279170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.279290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.279418 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.279547 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.279674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.279674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.279921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.280047 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.280172 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.280299 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.280423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.280559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.280696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.280822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.280973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.281098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.281227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.281364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.281489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.281618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.281746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.281873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.282004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.282004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.282251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.282251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.282497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.282623 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.282751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.282885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] resource.caching = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.283012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.283012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.283250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.283375 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.283500 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.283636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.283765 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.283892 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.284016 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.284141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.284277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.284411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.284538 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.284664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.284792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.284917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.285064 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.285264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.285391 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.285516 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.285639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] role.caching = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.285763 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.285888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] role.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.286020 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] role.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.286155 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.286280 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] role.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.286404 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.286529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.286653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.286786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.286912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.287036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.287161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.287285 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.287417 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.287550 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.287675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.287808 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.287941 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.288066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.288198 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.288323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.288448 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.288572 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.288695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.288819 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.289007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.289134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.289261 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.289389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.289528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.289655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.289791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.289918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.290047 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.290174 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.290300 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.290427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.290563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.290691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.290818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.290946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.291074 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.291214 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.291348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.291475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.291604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.291732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.291859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.291987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.292123 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.292249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.292375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.292502 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.292628 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.292754 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.292896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.293039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.293164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.293287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.293410 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.293543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.293673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.293797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.294527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.294658 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.294784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.294917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.295048 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.295176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.295313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] token.caching = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.295437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.295560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.295692 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.295815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.295939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.296061 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.296184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.296309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.296440 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.296565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.296565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.296797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.296980 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.297119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.297258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.297393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.297520 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.297645 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.297771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.297898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.298033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.298161 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.298286 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.298415 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.298540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.298668 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.298812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.298939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.299065 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.299193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.299318 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.299447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.299447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.299694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.299821 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.299947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.connection = **** {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.300081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.300216 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.300216 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.300492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.connection = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.300650 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.300821 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.300966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.301091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.301220 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.301348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.301476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.301612 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.301738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.301863 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.301986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.302110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.302234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.302366 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.302501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.302648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.302770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.302894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.303017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.303150 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.303275 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.303399 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.303523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.303647 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.303779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.303931 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.304070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.304194 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.304328 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.304454 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.304579 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.304712 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.304838 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80107) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:15:20.304983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.304983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:15:20.304983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:15:20.332742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.332966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.333097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.333227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.333367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.333367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.341935 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.342145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.370298 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.370466 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.370596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.370743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.511793 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.512082 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.561193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.561430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.562190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.562429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.625761 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.625987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.626135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.626270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.626407 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.626534 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.626673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.626798 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.626921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.627052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.627177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.627177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.651497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.651777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.651952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.652091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.652218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.652355 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.652479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.652611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.653020 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.653145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.653785 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.653916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.654044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.654199 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.664557 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.664802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.677793 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.678023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.678164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.678296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.678423 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.678559 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.678687 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.678823 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.678951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.679079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.679218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.679345 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.679478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.679478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80107) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 22:15:20.696175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.696384 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 22:15:20.696721 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.696846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.697001 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 22:15:20.697125 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 22:15:20.697248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.697381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.697504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.697626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 22:15:20.697755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.697879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.698001 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.698122 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.698322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.698580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.709526 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.709802 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.710068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.710202 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.710329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.710469 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.710727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.711008 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.719056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.719687 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.722360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.722643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.722978 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.723115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.723263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.723395 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.723566 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.723689 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.723834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.723958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.724087 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.724212 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.724365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.724490 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.724622 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.724745 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.724896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.725042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.725191 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.725315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.725497 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.725763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.751561 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.752128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.753187 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.753469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.753770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.754051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.758741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.759018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.759296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.759422 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.759559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.759845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.767135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.767417 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.767667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.767951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.772041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.772325 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.772566 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.772692 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.772855 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.773007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.773160 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.773284 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.773421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.773549 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.773687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.773815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.773942 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.774069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.774195 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.774454 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.793366 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.793640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.793803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.794105 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.798236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.798816 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.801876 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.802169 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.802447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.802740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.807188 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.807729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.810830 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.811366 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.814599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.814895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.815142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.815268 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.815439 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.815564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.815725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.815850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.816019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.816154 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.816279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.816536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.835382 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.835756 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.835907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.836033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.836283 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.836409 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.836559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.836825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.844783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.845356 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.846510 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.846787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.847046 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.847320 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.849937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.850219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.850464 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.850588 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.850726 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.850864 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.851001 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.851131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.851258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.851577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.864362 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.864643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.864952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.865131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.865256 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.865396 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.865531 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.865661 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.865789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.865946 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.866071 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.866230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.866521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.866805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.885119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.885892 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.888871 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.889723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.892187 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.893030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.893821 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.894637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.895454 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.895734 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.896019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.896255 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.896536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.896822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.904306 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.905113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.905950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.906729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.909189 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.909479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.909759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.909974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.910098 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.910263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.910546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.910829 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.919226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.919514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.919797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.920045 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.920330 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.920609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.927667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.927947 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.928226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.928467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80107) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 22:15:20.928602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.928750 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.928875 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.929046 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.929184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.929309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.929438 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.929561 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.929685 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.929828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.929952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.930077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.930208 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.930380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.930505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.930628 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.930752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.930875 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.931006 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.931140 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.931263 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.931386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.931604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.931878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80107) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 22:15:20.969765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fc233d89c0 pid: 80106 (default app) Jul 21 22:15:20.970498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fc233d89c0 pid: 80107 (default app) Jul 21 22:15:20.973054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59adc1-d458-4537-80a9-d89f8ea761f2 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:20.973349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59adc1-d458-4537-80a9-d89f8ea761f2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:20.973627 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59adc1-d458-4537-80a9-d89f8ea761f2 None None] PATH_INFO: `/v3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:20.977820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Thu Jul 21 22:15:20 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:28.577824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051e9d7-4cfa-4008-86cf-e667d6c38dfa None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:28.578376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051e9d7-4cfa-4008-86cf-e667d6c38dfa None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:28.578376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051e9d7-4cfa-4008-86cf-e667d6c38dfa None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:28.582696 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:15:28.587741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b1baa-0dbf-4df0-9084-e36117472ff9 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:28.588160 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b1baa-0dbf-4df0-9084-e36117472ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:28.588287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b1baa-0dbf-4df0-9084-e36117472ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:28.657762 dv-cinder-850697-1-smb devstack@keystone.service[80106]: INFO dbcounter [None req-204b1baa-0dbf-4df0-9084-e36117472ff9 None None] Registered counter for database keystone Jul 21 22:15:28.679580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG oslo_db.sqlalchemy.engines [None req-204b1baa-0dbf-4df0-9084-e36117472ff9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:15:28.685684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writer thread running {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:15:28.859346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG passlib.handlers.bcrypt [None req-204b1baa-0dbf-4df0-9084-e36117472ff9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80106) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 22:15:28.859686 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG passlib.handlers.bcrypt [None req-204b1baa-0dbf-4df0-9084-e36117472ff9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80106) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 22:15:28.913357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-204b1baa-0dbf-4df0-9084-e36117472ff9 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:28.914948 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-204b1baa-0dbf-4df0-9084-e36117472ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:29.034088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 22:15:29.210399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051e9d7-4cfa-4008-86cf-e667d6c38dfa None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:29.280562 dv-cinder-850697-1-smb devstack@keystone.service[80107]: INFO dbcounter [None req-d051e9d7-4cfa-4008-86cf-e667d6c38dfa None None] Registered counter for database keystone Jul 21 22:15:29.299932 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG oslo_db.sqlalchemy.engines [None req-d051e9d7-4cfa-4008-86cf-e667d6c38dfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80107) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:15:29.306011 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writer thread running {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:15:29.423884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051e9d7-4cfa-4008-86cf-e667d6c38dfa None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:29.428164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a096481-c5de-40f1-95f9-d1a7b76785e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:29.428824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a096481-c5de-40f1-95f9-d1a7b76785e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:29.429135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a096481-c5de-40f1-95f9-d1a7b76785e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:29.429418 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a096481-c5de-40f1-95f9-d1a7b76785e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:29.437376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a096481-c5de-40f1-95f9-d1a7b76785e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:29.488283 dv-cinder-850697-1-smb devstack@keystone.service[80107]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7a096481-c5de-40f1-95f9-d1a7b76785e5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 22:15:29.488624 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a096481-c5de-40f1-95f9-d1a7b76785e5 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:29.498002 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Jul 21 22:15:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:15:29.503962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b1baa-0dbf-4df0-9084-e36117472ff9 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:29.518173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b1baa-0dbf-4df0-9084-e36117472ff9 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:29.522509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1d7c5-aa17-49fa-98b7-4b4fdbdf46ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:29.523621 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1d7c5-aa17-49fa-98b7-4b4fdbdf46ec admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:29.523906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1d7c5-aa17-49fa-98b7-4b4fdbdf46ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:29.524181 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1d7c5-aa17-49fa-98b7-4b4fdbdf46ec admin admin] PATH_INFO: `/v3/projects/cde20a12b28d4325b013339974b4c146` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:29.525692 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1d7c5-aa17-49fa-98b7-4b4fdbdf46ec admin admin] RBAC: Authorizing `identity:get_project(project_id=cde20a12b28d4325b013339974b4c146)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:29.578625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e9e1d7c5-aa17-49fa-98b7-4b4fdbdf46ec admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 22:15:29.578965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1d7c5-aa17-49fa-98b7-4b4fdbdf46ec admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:29.583479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Thu Jul 21 22:15:29 2022] GET /identity/v3/projects/cde20a12b28d4325b013339974b4c146 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:31.579965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497b639-3791-42d4-99dc-534705adb6ac None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:31.580495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497b639-3791-42d4-99dc-534705adb6ac None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:31.580587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497b639-3791-42d4-99dc-534705adb6ac None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:31.584649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:31.589928 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309b54f-8b42-4f97-9ddd-bac9f92d987d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:31.590289 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309b54f-8b42-4f97-9ddd-bac9f92d987d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:31.590491 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309b54f-8b42-4f97-9ddd-bac9f92d987d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:31.609403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2309b54f-8b42-4f97-9ddd-bac9f92d987d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:31.611258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2309b54f-8b42-4f97-9ddd-bac9f92d987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:31.619091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 22:15:31.641277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497b639-3791-42d4-99dc-534705adb6ac None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:31.653317 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497b639-3791-42d4-99dc-534705adb6ac None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:31.657495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afede8da-be5c-43a8-90b6-43c7d2462748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:31.658117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afede8da-be5c-43a8-90b6-43c7d2462748 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:31.658401 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afede8da-be5c-43a8-90b6-43c7d2462748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:31.658681 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afede8da-be5c-43a8-90b6-43c7d2462748 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:31.666407 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afede8da-be5c-43a8-90b6-43c7d2462748 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:31.668213 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afede8da-be5c-43a8-90b6-43c7d2462748 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:31.677592 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Jul 21 22:15:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 22:15:31.682810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309b54f-8b42-4f97-9ddd-bac9f92d987d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:31.692260 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309b54f-8b42-4f97-9ddd-bac9f92d987d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:31.696551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967d2a3-3775-4614-8f2b-20fbf97fd8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:31.697438 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967d2a3-3775-4614-8f2b-20fbf97fd8da admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:31.697721 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967d2a3-3775-4614-8f2b-20fbf97fd8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:31.697996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967d2a3-3775-4614-8f2b-20fbf97fd8da admin admin] PATH_INFO: `/v3/users/f173d7158e2a4553aa3707927ef2704b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:31.699378 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967d2a3-3775-4614-8f2b-20fbf97fd8da admin admin] RBAC: Authorizing `identity:get_user(user_id=f173d7158e2a4553aa3707927ef2704b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:31.701211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967d2a3-3775-4614-8f2b-20fbf97fd8da admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:31.702741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Thu Jul 21 22:15:31 2022] GET /identity/v3/users/f173d7158e2a4553aa3707927ef2704b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:33.778993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a0bea-d1c5-435a-99f8-f5baac842951 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:33.779526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a0bea-d1c5-435a-99f8-f5baac842951 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:33.779526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a0bea-d1c5-435a-99f8-f5baac842951 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:33.780911 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:33.786035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a741c-1ded-4ef8-9f44-5f1eae0aee62 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:33.786432 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a741c-1ded-4ef8-9f44-5f1eae0aee62 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:33.786591 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a741c-1ded-4ef8-9f44-5f1eae0aee62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:33.803410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-aa8a741c-1ded-4ef8-9f44-5f1eae0aee62 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:33.804608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-aa8a741c-1ded-4ef8-9f44-5f1eae0aee62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:33.859898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dfe0e-d5ba-47e3-95a1-b21a6a165671 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:33.860181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dfe0e-d5ba-47e3-95a1-b21a6a165671 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:33.860456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dfe0e-d5ba-47e3-95a1-b21a6a165671 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:33.861832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:15:33.866846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d48d7c-9f08-4030-92ea-ad6a723595f1 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:33.867128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d48d7c-9f08-4030-92ea-ad6a723595f1 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:33.867412 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d48d7c-9f08-4030-92ea-ad6a723595f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:33.882531 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:33.906261 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a741c-1ded-4ef8-9f44-5f1eae0aee62 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:33.906971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG passlib.handlers.bcrypt [None req-37d48d7c-9f08-4030-92ea-ad6a723595f1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80107) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 22:15:33.907388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG passlib.handlers.bcrypt [None req-37d48d7c-9f08-4030-92ea-ad6a723595f1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80107) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 22:15:33.928893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:33.952607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-37d48d7c-9f08-4030-92ea-ad6a723595f1 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:33.954189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-37d48d7c-9f08-4030-92ea-ad6a723595f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:34.006864 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a741c-1ded-4ef8-9f44-5f1eae0aee62 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:34.041320 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4ea0d-f211-4f65-8073-a1828d61253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:34.042056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ea0d-f211-4f65-8073-a1828d61253b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:34.042354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ea0d-f211-4f65-8073-a1828d61253b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:34.042638 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ea0d-f211-4f65-8073-a1828d61253b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:34.052071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:15:34.053697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4ea0d-f211-4f65-8073-a1828d61253b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c0b4ea0d-f211-4f65-8073-a1828d61253b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:34.065029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:34.066088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:34.069847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:34.069847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:34.069847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:34.069847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:34.069847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:34.069847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:34.069847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:34.069847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:34.069847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:34.069847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:34.069847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:15:34.069847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:15:34.069847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:15:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:15:34.072036 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d48d7c-9f08-4030-92ea-ad6a723595f1 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:34.073864 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4ea0d-f211-4f65-8073-a1828d61253b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:34.162422 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:34.175591 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d48d7c-9f08-4030-92ea-ad6a723595f1 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:34.177936 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:34.181663 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4ea0d-f211-4f65-8073-a1828d61253b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:34.214026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89b883-0e90-405f-bc69-c520d42c3dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:34.214945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89b883-0e90-405f-bc69-c520d42c3dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:34.215056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4188ec-d4ae-4ca0-9ce1-76bc529359e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:34.215231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89b883-0e90-405f-bc69-c520d42c3dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:34.215511 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89b883-0e90-405f-bc69-c520d42c3dc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:34.216147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4188ec-d4ae-4ca0-9ce1-76bc529359e7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:34.216422 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4188ec-d4ae-4ca0-9ce1-76bc529359e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:34.216697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4188ec-d4ae-4ca0-9ce1-76bc529359e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:34.216955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89b883-0e90-405f-bc69-c520d42c3dc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:34.217262 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89b883-0e90-405f-bc69-c520d42c3dc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:34.218695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89b883-0e90-405f-bc69-c520d42c3dc2 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:34.230295 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:15:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:34.236450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89b883-0e90-405f-bc69-c520d42c3dc2 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:34.283758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4188ec-d4ae-4ca0-9ce1-76bc529359e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:34.285274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4188ec-d4ae-4ca0-9ce1-76bc529359e7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:34.331888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89b883-0e90-405f-bc69-c520d42c3dc2 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:34.364050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:34.365785 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33975ee-4c6a-448f-bd06-06619a1dd162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:34.366832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33975ee-4c6a-448f-bd06-06619a1dd162 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:34.367124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33975ee-4c6a-448f-bd06-06619a1dd162 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:34.367403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33975ee-4c6a-448f-bd06-06619a1dd162 None admin] PATH_INFO: `/v3/users/f173d7158e2a4553aa3707927ef2704b` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:34.368986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33975ee-4c6a-448f-bd06-06619a1dd162 None admin] RBAC: Authorizing `identity:get_user(user_id=f173d7158e2a4553aa3707927ef2704b)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:34.370481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33975ee-4c6a-448f-bd06-06619a1dd162 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:34.372116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 9/16] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:15:34 2022] GET /identity/v3/users/f173d7158e2a4553aa3707927ef2704b => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:34.377562 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33975ee-4c6a-448f-bd06-06619a1dd162 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:34.387947 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 8/17] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:15:34.388940 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4188ec-d4ae-4ca0-9ce1-76bc529359e7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:34.414127 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:34.479380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33975ee-4c6a-448f-bd06-06619a1dd162 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:34.485918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4188ec-d4ae-4ca0-9ce1-76bc529359e7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:34.512966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8454251-f9fd-4748-9ee9-8d532afebca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:34.513762 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8454251-f9fd-4748-9ee9-8d532afebca8 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:34.514044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8454251-f9fd-4748-9ee9-8d532afebca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:34.514324 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8454251-f9fd-4748-9ee9-8d532afebca8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:34.515501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8454251-f9fd-4748-9ee9-8d532afebca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:34.517011 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8454251-f9fd-4748-9ee9-8d532afebca8 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:34.518062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d402a-f985-4475-89f0-503f75db2b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:34.518565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:15:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:34.518934 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d402a-f985-4475-89f0-503f75db2b29 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:34.519227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d402a-f985-4475-89f0-503f75db2b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:34.519508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d402a-f985-4475-89f0-503f75db2b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:34.524196 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8454251-f9fd-4748-9ee9-8d532afebca8 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:34.530792 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d402a-f985-4475-89f0-503f75db2b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:34.532251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d402a-f985-4475-89f0-503f75db2b29 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:34.549985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-f54d402a-f985-4475-89f0-503f75db2b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:15:34.549985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:34.549985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:34.549985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:34.549985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:34.549985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:34.549985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:34.549985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:34.549985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:34.549985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:34.549985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:34.549985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:34.549985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:15:34.549985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:15:34.549985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:34.550820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:34.551596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:15:34.551596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:15:34.551596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:15:34.551596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:15:34.551596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:34.556868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d402a-f985-4475-89f0-503f75db2b29 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:34.590031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:34.622429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8454251-f9fd-4748-9ee9-8d532afebca8 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:34.623920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:34.655654 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d402a-f985-4475-89f0-503f75db2b29 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:34.656059 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d57e16-92fd-4e67-aa85-2230ba24d4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:34.656748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d57e16-92fd-4e67-aa85-2230ba24d4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:34.657064 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d57e16-92fd-4e67-aa85-2230ba24d4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:34.657347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d57e16-92fd-4e67-aa85-2230ba24d4b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:34.658182 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d57e16-92fd-4e67-aa85-2230ba24d4b2 None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.domain.id=default, user.id=f173d7158e2a4553aa3707927ef2704b) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:34.658498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d57e16-92fd-4e67-aa85-2230ba24d4b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:34.659949 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d57e16-92fd-4e67-aa85-2230ba24d4b2 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:34.668048 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Jul 21 22:15:34 2022] GET /identity/v3/role_assignments?user.id=f173d7158e2a4553aa3707927ef2704b&scope.domain.id=default&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:34.690636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434ed62-3c49-450d-9cc5-92778518f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:34.691325 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434ed62-3c49-450d-9cc5-92778518f560 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:34.691612 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434ed62-3c49-450d-9cc5-92778518f560 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:34.691893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434ed62-3c49-450d-9cc5-92778518f560 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:34.692642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434ed62-3c49-450d-9cc5-92778518f560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:34.692977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434ed62-3c49-450d-9cc5-92778518f560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:34.694433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434ed62-3c49-450d-9cc5-92778518f560 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:34.713559 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:36.909916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab623ec2-3cf5-43ae-934d-6cd727a941a4 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:36.910894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab623ec2-3cf5-43ae-934d-6cd727a941a4 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:36.911408 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab623ec2-3cf5-43ae-934d-6cd727a941a4 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:36.913031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:36.919067 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc929c-835c-48f7-a74f-55c2bf21e0fa None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:36.919893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc929c-835c-48f7-a74f-55c2bf21e0fa None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:36.920344 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc929c-835c-48f7-a74f-55c2bf21e0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:36.946099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-54cc929c-835c-48f7-a74f-55c2bf21e0fa None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:36.947600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-54cc929c-835c-48f7-a74f-55c2bf21e0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:37.033761 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:37.073169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab623ec2-3cf5-43ae-934d-6cd727a941a4 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:37.097598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56017e6f-1087-4e70-8830-a8b5e8b4b8a1 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:37.098237 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56017e6f-1087-4e70-8830-a8b5e8b4b8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:37.098715 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56017e6f-1087-4e70-8830-a8b5e8b4b8a1 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:37.100284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 12/24] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:15:37.105404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcb464-000b-41fb-9575-97815833c580 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:37.105934 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcb464-000b-41fb-9575-97815833c580 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:37.106957 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcb464-000b-41fb-9575-97815833c580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:37.137750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f0dcb464-000b-41fb-9575-97815833c580 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:37.140476 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f0dcb464-000b-41fb-9575-97815833c580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:37.191153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:37.282111 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab623ec2-3cf5-43ae-934d-6cd727a941a4 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:37.301384 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 13/25] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:15:37.303178 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ee7f3-616f-4b43-a0b7-a9ebaf77c97f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:37.305236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ee7f3-616f-4b43-a0b7-a9ebaf77c97f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:37.305730 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ee7f3-616f-4b43-a0b7-a9ebaf77c97f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:37.307223 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 14/26] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:37.330835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2205c-0e6f-4db3-ad9c-c2d78f139f30 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:37.331531 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2205c-0e6f-4db3-ad9c-c2d78f139f30 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:37.332021 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2205c-0e6f-4db3-ad9c-c2d78f139f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:37.354546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8ff2205c-0e6f-4db3-ad9c-c2d78f139f30 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:37.355930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6cfcb-b66a-4586-aa96-090a5b3473d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:37.357031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6cfcb-b66a-4586-aa96-090a5b3473d3 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:37.357544 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6cfcb-b66a-4586-aa96-090a5b3473d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:37.358023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6cfcb-b66a-4586-aa96-090a5b3473d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:37.361514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8ff2205c-0e6f-4db3-ad9c-c2d78f139f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:37.381439 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6cfcb-b66a-4586-aa96-090a5b3473d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-52d6cfcb-b66a-4586-aa96-090a5b3473d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:37.395571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:37.396487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:37.397282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:37.397282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:37.397282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:37.397282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:37.397282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:37.397282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:37.397282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:37.397282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:37.397282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:37.397282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:37.397282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:15:37.397282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:15:37.399709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 13/27] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:15:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:37.401135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6cfcb-b66a-4586-aa96-090a5b3473d3 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:37.457470 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:37.499102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 15/28] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:37.506608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2205c-0e6f-4db3-ad9c-c2d78f139f30 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:37.612955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:37.619368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6cfcb-b66a-4586-aa96-090a5b3473d3 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:37.631313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2205c-0e6f-4db3-ad9c-c2d78f139f30 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:37.668183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0da7ac-7617-4a7c-b22e-28043fd1dbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:37.669720 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0da7ac-7617-4a7c-b22e-28043fd1dbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:37.670191 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0da7ac-7617-4a7c-b22e-28043fd1dbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:37.670616 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0da7ac-7617-4a7c-b22e-28043fd1dbe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:37.671560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0da7ac-7617-4a7c-b22e-28043fd1dbe2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:37.672172 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0da7ac-7617-4a7c-b22e-28043fd1dbe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:37.673820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0da7ac-7617-4a7c-b22e-28043fd1dbe2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:37.683178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719b6e2-564d-487f-a0f6-4df3f5373da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:37.684017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719b6e2-564d-487f-a0f6-4df3f5373da1 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:37.684853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719b6e2-564d-487f-a0f6-4df3f5373da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:37.685654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719b6e2-564d-487f-a0f6-4df3f5373da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:37.689433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 16/29] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:15:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:37.690530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0da7ac-7617-4a7c-b22e-28043fd1dbe2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:37.720707 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719b6e2-564d-487f-a0f6-4df3f5373da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:37.722226 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719b6e2-564d-487f-a0f6-4df3f5373da1 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:37.763884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-b719b6e2-564d-487f-a0f6-4df3f5373da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:15:37.763884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:37.763884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:37.763884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:37.763884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:37.763884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:37.763884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:37.763884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:37.763884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:37.763884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:37.763884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:37.763884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:37.763884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:15:37.763884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:15:37.763884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:37.764979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:37.766031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:15:37.766031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:15:37.766031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:15:37.766031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:15:37.770228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 14/30] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:37.770778 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719b6e2-564d-487f-a0f6-4df3f5373da1 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:37.803187 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0da7ac-7617-4a7c-b22e-28043fd1dbe2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:37.841869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5920bc-d1ed-4263-9201-c3f69e4367b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:37.842839 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5920bc-d1ed-4263-9201-c3f69e4367b6 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:37.843323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5920bc-d1ed-4263-9201-c3f69e4367b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:37.843776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5920bc-d1ed-4263-9201-c3f69e4367b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:37.844716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5920bc-d1ed-4263-9201-c3f69e4367b6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:37.846367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5920bc-d1ed-4263-9201-c3f69e4367b6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:37.881026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:37.908316 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719b6e2-564d-487f-a0f6-4df3f5373da1 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:37.943991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79e9a5-ba54-4754-8e0b-7b4345d1349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:37.945652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79e9a5-ba54-4754-8e0b-7b4345d1349f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:37.946162 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79e9a5-ba54-4754-8e0b-7b4345d1349f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:37.946638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79e9a5-ba54-4754-8e0b-7b4345d1349f None admin] PATH_INFO: `/v3/users/f173d7158e2a4553aa3707927ef2704b` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:37.948030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79e9a5-ba54-4754-8e0b-7b4345d1349f None admin] RBAC: Authorizing `identity:get_user(user_id=f173d7158e2a4553aa3707927ef2704b)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:37.949733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79e9a5-ba54-4754-8e0b-7b4345d1349f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:37.951972 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 15/31] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:15:37 2022] GET /identity/v3/users/f173d7158e2a4553aa3707927ef2704b => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:37.953116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79e9a5-ba54-4754-8e0b-7b4345d1349f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:37.981582 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 17/32] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Jul 21 22:15:37 2022] POST /identity/v3/roles => generated 219 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:15:37.983049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9274504-bc9e-4f2a-8a38-e802fc7face8 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:37.983349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9274504-bc9e-4f2a-8a38-e802fc7face8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:37.983635 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9274504-bc9e-4f2a-8a38-e802fc7face8 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:37.985549 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 18/33] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:37.986047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9274504-bc9e-4f2a-8a38-e802fc7face8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:38.000698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:38.073670 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79e9a5-ba54-4754-8e0b-7b4345d1349f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:38.109750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9274504-bc9e-4f2a-8a38-e802fc7face8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:38.122551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e34b8-55c7-4deb-ad30-01a723c0af23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:38.123706 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e34b8-55c7-4deb-ad30-01a723c0af23 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:38.124204 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e34b8-55c7-4deb-ad30-01a723c0af23 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:38.124686 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e34b8-55c7-4deb-ad30-01a723c0af23 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:38.125810 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e34b8-55c7-4deb-ad30-01a723c0af23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:38.126355 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e34b8-55c7-4deb-ad30-01a723c0af23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:38.128149 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e34b8-55c7-4deb-ad30-01a723c0af23 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:38.155465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5f541-83eb-43af-bf56-cfb8ff6b199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:38.156292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5f541-83eb-43af-bf56-cfb8ff6b199d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:38.156581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5f541-83eb-43af-bf56-cfb8ff6b199d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:38.156920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5f541-83eb-43af-bf56-cfb8ff6b199d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:38.163986 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5f541-83eb-43af-bf56-cfb8ff6b199d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:38.163986 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5f541-83eb-43af-bf56-cfb8ff6b199d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:38.163986 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 19/34] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:15:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:38.165335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad03c9-b07f-4cd0-b3c8-44c2cb299f53 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:38.166016 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad03c9-b07f-4cd0-b3c8-44c2cb299f53 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:38.166538 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad03c9-b07f-4cd0-b3c8-44c2cb299f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:38.179822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 16/35] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:38.180538 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e34b8-55c7-4deb-ad30-01a723c0af23 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:38.202761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:38.317944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6bad03c9-b07f-4cd0-b3c8-44c2cb299f53 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:38.319472 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6bad03c9-b07f-4cd0-b3c8-44c2cb299f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:38.347281 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e34b8-55c7-4deb-ad30-01a723c0af23 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:38.394284 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83359f81-15c8-437a-8000-dd677702fe2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:38.395607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83359f81-15c8-437a-8000-dd677702fe2e None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:38.396070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83359f81-15c8-437a-8000-dd677702fe2e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:38.396630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83359f81-15c8-437a-8000-dd677702fe2e None admin] PATH_INFO: `/v3/domains/default/users/f173d7158e2a4553aa3707927ef2704b/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:38.399033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83359f81-15c8-437a-8000-dd677702fe2e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f173d7158e2a4553aa3707927ef2704b, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:38.399739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 20/36] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:38.400621 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad03c9-b07f-4cd0-b3c8-44c2cb299f53 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:38.401265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83359f81-15c8-437a-8000-dd677702fe2e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:38.405189 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:38.526387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad03c9-b07f-4cd0-b3c8-44c2cb299f53 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:38.561438 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 17/37] 10.222.0.43 () {58 vars in 1361 bytes} [Thu Jul 21 22:15:38 2022] PUT /identity/v3/domains/default/users/f173d7158e2a4553aa3707927ef2704b/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:15:38.563066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83359f81-15c8-437a-8000-dd677702fe2e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:38.568682 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296017-47a3-4afc-a158-86a2c7c69844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:38.569598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296017-47a3-4afc-a158-86a2c7c69844 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:38.570071 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296017-47a3-4afc-a158-86a2c7c69844 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:38.570594 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296017-47a3-4afc-a158-86a2c7c69844 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:38.571946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef296017-47a3-4afc-a158-86a2c7c69844 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:38.573840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef296017-47a3-4afc-a158-86a2c7c69844 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:38.640784 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 21/38] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jul 21 22:15:38 2022] POST /identity/v3/projects => generated 301 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:15:38.646405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:38.683190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72d887-eed4-4795-8fa2-988eb04d9165 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:38.683569 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72d887-eed4-4795-8fa2-988eb04d9165 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:38.683908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72d887-eed4-4795-8fa2-988eb04d9165 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:38.686087 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 22/39] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:15:38.690533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83359f81-15c8-437a-8000-dd677702fe2e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:38.692697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebfb42-5f67-4bbc-8e64-e44cc513ce53 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:38.692995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebfb42-5f67-4bbc-8e64-e44cc513ce53 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:38.693340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebfb42-5f67-4bbc-8e64-e44cc513ce53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:38.734135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-07ebfb42-5f67-4bbc-8e64-e44cc513ce53 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:38.735139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7d05b-65bb-47e1-9969-d43ca16827ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:38.735468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-07ebfb42-5f67-4bbc-8e64-e44cc513ce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:38.736350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7d05b-65bb-47e1-9969-d43ca16827ef None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:38.736861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7d05b-65bb-47e1-9969-d43ca16827ef None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:38.737374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7d05b-65bb-47e1-9969-d43ca16827ef None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:38.738994 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7d05b-65bb-47e1-9969-d43ca16827ef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:38.740969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7d05b-65bb-47e1-9969-d43ca16827ef None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:38.769772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 18/40] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Jul 21 22:15:38 2022] POST /identity/v3/roles => generated 225 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:15:38.799262 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eace13-4ada-4c04-8838-e94fccc458e4 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:38.799928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eace13-4ada-4c04-8838-e94fccc458e4 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:38.800786 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eace13-4ada-4c04-8838-e94fccc458e4 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:38.804062 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 19/41] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:38.812357 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6a130-54a9-4802-8f7e-894118bdd7d4 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:38.813189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6a130-54a9-4802-8f7e-894118bdd7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:38.814604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6a130-54a9-4802-8f7e-894118bdd7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:38.838692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-5aa6a130-54a9-4802-8f7e-894118bdd7d4 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:38.841152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-5aa6a130-54a9-4802-8f7e-894118bdd7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:38.860907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:38.884055 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 23/42] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:38.910247 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebfb42-5f67-4bbc-8e64-e44cc513ce53 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:38.935215 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 20/43] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:15:38.960368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6a130-54a9-4802-8f7e-894118bdd7d4 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:39.022237 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:39.036521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebfb42-5f67-4bbc-8e64-e44cc513ce53 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:39.080041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6a130-54a9-4802-8f7e-894118bdd7d4 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:39.081987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd293f-e855-42a1-ae9b-08660dcfea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:39.083578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd293f-e855-42a1-ae9b-08660dcfea4f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:39.083869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd293f-e855-42a1-ae9b-08660dcfea4f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:39.084152 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd293f-e855-42a1-ae9b-08660dcfea4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:39.085374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd293f-e855-42a1-ae9b-08660dcfea4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:39.086860 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd293f-e855-42a1-ae9b-08660dcfea4f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:39.089148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 24/44] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:15:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:39.094316 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd293f-e855-42a1-ae9b-08660dcfea4f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:39.119880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ab2a7-bc8f-42d9-a534-8949da2d36ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:39.120814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ab2a7-bc8f-42d9-a534-8949da2d36ef None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:39.121299 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ab2a7-bc8f-42d9-a534-8949da2d36ef None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:39.122286 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ab2a7-bc8f-42d9-a534-8949da2d36ef None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:39.122909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ab2a7-bc8f-42d9-a534-8949da2d36ef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:39.124309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ab2a7-bc8f-42d9-a534-8949da2d36ef None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:39.138704 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 21/45] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Jul 21 22:15:38 2022] POST /identity/v3/roles => generated 223 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:15:39.157252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:39.210634 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd293f-e855-42a1-ae9b-08660dcfea4f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:39.248214 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdd793-e563-4020-8122-4b931f0455ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:39.248905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdd793-e563-4020-8122-4b931f0455ef None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:39.249243 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdd793-e563-4020-8122-4b931f0455ef None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:39.249529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdd793-e563-4020-8122-4b931f0455ef None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:39.250295 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdd793-e563-4020-8122-4b931f0455ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:39.251805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdd793-e563-4020-8122-4b931f0455ef None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:39.279468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 25/46] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jul 21 22:15:39 2022] POST /identity/v3/projects => generated 312 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:15:40.743955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a49aaf-669e-45d5-ad57-cc9e3ddd6933 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:40.744497 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a49aaf-669e-45d5-ad57-cc9e3ddd6933 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:40.744497 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a49aaf-669e-45d5-ad57-cc9e3ddd6933 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:40.745924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 22/47] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:40.751050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25870699-5578-4d96-bf22-c34ffe97d5b0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:40.751447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25870699-5578-4d96-bf22-c34ffe97d5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:40.751741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25870699-5578-4d96-bf22-c34ffe97d5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:40.768696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-25870699-5578-4d96-bf22-c34ffe97d5b0 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:40.769900 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-25870699-5578-4d96-bf22-c34ffe97d5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:40.836357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 26/48] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:15:40.859636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a49aaf-669e-45d5-ad57-cc9e3ddd6933 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:40.959002 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a49aaf-669e-45d5-ad57-cc9e3ddd6933 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:40.974696 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:40.992805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c01056-c3c1-4d24-ba04-e1b0b1c94521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:40.993635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c01056-c3c1-4d24-ba04-e1b0b1c94521 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:40.993918 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c01056-c3c1-4d24-ba04-e1b0b1c94521 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:40.994242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c01056-c3c1-4d24-ba04-e1b0b1c94521 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:41.004599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c01056-c3c1-4d24-ba04-e1b0b1c94521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-28c01056-c3c1-4d24-ba04-e1b0b1c94521 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:41.012230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:41.013761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:41.014811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:41.014811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:41.014811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:41.014811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:41.014811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:41.014811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:41.014811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:41.014811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:41.014811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:41.014811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:41.014811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:15:41.014811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:15:41.014811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 23/49] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:15:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:41.019713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25870699-5578-4d96-bf22-c34ffe97d5b0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:41.052943 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:41.119161 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25870699-5578-4d96-bf22-c34ffe97d5b0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:41.152721 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43d892-de25-4fb4-978e-a7650aa57fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:41.153702 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43d892-de25-4fb4-978e-a7650aa57fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:41.153991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43d892-de25-4fb4-978e-a7650aa57fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:41.154278 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43d892-de25-4fb4-978e-a7650aa57fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:41.155032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43d892-de25-4fb4-978e-a7650aa57fc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:41.155347 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43d892-de25-4fb4-978e-a7650aa57fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:41.156740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43d892-de25-4fb4-978e-a7650aa57fc9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:41.165071 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 27/50] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:15:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:41.170747 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c01056-c3c1-4d24-ba04-e1b0b1c94521 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:41.342819 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf0f08-d15f-46c9-949c-2b3243cdebb5 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:41.343022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf0f08-d15f-46c9-949c-2b3243cdebb5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:41.343299 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf0f08-d15f-46c9-949c-2b3243cdebb5 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:41.344682 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 28/51] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:15:41.349824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513d27f-3d26-469d-b28d-35f5a9caea87 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:41.350120 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513d27f-3d26-469d-b28d-35f5a9caea87 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:41.351052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513d27f-3d26-469d-b28d-35f5a9caea87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:41.368179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e513d27f-3d26-469d-b28d-35f5a9caea87 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:41.369374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e513d27f-3d26-469d-b28d-35f5a9caea87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:41.376741 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c01056-c3c1-4d24-ba04-e1b0b1c94521 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:41.409697 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af026db7-2d9d-4f8a-acaf-727c1edc9395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:41.410567 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af026db7-2d9d-4f8a-acaf-727c1edc9395 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:41.410854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af026db7-2d9d-4f8a-acaf-727c1edc9395 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:41.411130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af026db7-2d9d-4f8a-acaf-727c1edc9395 None admin] PATH_INFO: `/v3/users/f173d7158e2a4553aa3707927ef2704b` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:41.412308 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af026db7-2d9d-4f8a-acaf-727c1edc9395 None admin] RBAC: Authorizing `identity:get_user(user_id=f173d7158e2a4553aa3707927ef2704b)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:41.413772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af026db7-2d9d-4f8a-acaf-727c1edc9395 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:41.415392 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 24/52] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:15:41 2022] GET /identity/v3/users/f173d7158e2a4553aa3707927ef2704b => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:41.421174 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af026db7-2d9d-4f8a-acaf-727c1edc9395 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:41.435589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 29/53] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:15:41.458600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513d27f-3d26-469d-b28d-35f5a9caea87 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:41.467894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:41.486677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:41.522596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af026db7-2d9d-4f8a-acaf-727c1edc9395 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:41.555528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48b848-3a4b-4a06-b18b-74233c462937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:41.556330 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48b848-3a4b-4a06-b18b-74233c462937 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:41.556620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48b848-3a4b-4a06-b18b-74233c462937 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:41.556903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48b848-3a4b-4a06-b18b-74233c462937 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:41.557907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513d27f-3d26-469d-b28d-35f5a9caea87 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:41.558135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48b848-3a4b-4a06-b18b-74233c462937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:41.560142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48b848-3a4b-4a06-b18b-74233c462937 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:41.561817 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 25/54] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:15:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:41.567617 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48b848-3a4b-4a06-b18b-74233c462937 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:41.591206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2673c-7c99-4f9a-9eea-d556aba6fb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:41.592010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2673c-7c99-4f9a-9eea-d556aba6fb58 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:41.592295 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2673c-7c99-4f9a-9eea-d556aba6fb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:41.592575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2673c-7c99-4f9a-9eea-d556aba6fb58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:41.593825 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2673c-7c99-4f9a-9eea-d556aba6fb58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:41.595247 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2673c-7c99-4f9a-9eea-d556aba6fb58 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:41.596868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 30/55] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:15:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:41.602500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2673c-7c99-4f9a-9eea-d556aba6fb58 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:41.666119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48b848-3a4b-4a06-b18b-74233c462937 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:41.679220 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:41.694224 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:41.700550 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2673c-7c99-4f9a-9eea-d556aba6fb58 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:41.701092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48564a5-ff27-4165-9a57-04f5410d8a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:41.701757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48564a5-ff27-4165-9a57-04f5410d8a27 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:41.702050 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48564a5-ff27-4165-9a57-04f5410d8a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:41.702338 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48564a5-ff27-4165-9a57-04f5410d8a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:41.703180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48564a5-ff27-4165-9a57-04f5410d8a27 None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.domain.id=default, user.id=f173d7158e2a4553aa3707927ef2704b) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:41.703500 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48564a5-ff27-4165-9a57-04f5410d8a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:41.704974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48564a5-ff27-4165-9a57-04f5410d8a27 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:41.710765 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 26/56] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Jul 21 22:15:41 2022] GET /identity/v3/role_assignments?user.id=f173d7158e2a4553aa3707927ef2704b&scope.domain.id=default&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:41.735935 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700068f5-5fdc-4a7b-9c81-9a9b82983474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:41.736619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700068f5-5fdc-4a7b-9c81-9a9b82983474 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:41.736902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700068f5-5fdc-4a7b-9c81-9a9b82983474 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:41.737213 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700068f5-5fdc-4a7b-9c81-9a9b82983474 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:41.737954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700068f5-5fdc-4a7b-9c81-9a9b82983474 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:41.739462 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700068f5-5fdc-4a7b-9c81-9a9b82983474 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:41.765829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 31/57] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Jul 21 22:15:41 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:15:43.808129 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0b4c5-f2f1-432c-8a19-fd99bb6631d5 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:43.808793 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0b4c5-f2f1-432c-8a19-fd99bb6631d5 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:43.808793 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0b4c5-f2f1-432c-8a19-fd99bb6631d5 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:43.810164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 27/58] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:43.817006 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2277e-0f2e-46bf-9ec7-85844b091704 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:43.817482 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2277e-0f2e-46bf-9ec7-85844b091704 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:43.817782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2277e-0f2e-46bf-9ec7-85844b091704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:43.839833 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b3a2277e-0f2e-46bf-9ec7-85844b091704 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:43.841088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b3a2277e-0f2e-46bf-9ec7-85844b091704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:43.905633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 32/59] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:15:43.930405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0b4c5-f2f1-432c-8a19-fd99bb6631d5 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:44.029118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0b4c5-f2f1-432c-8a19-fd99bb6631d5 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:44.061010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4643ef8-b1b2-407a-a457-6ea8a55fbf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:44.061752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4643ef8-b1b2-407a-a457-6ea8a55fbf94 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:44.062035 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4643ef8-b1b2-407a-a457-6ea8a55fbf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:44.062312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4643ef8-b1b2-407a-a457-6ea8a55fbf94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:44.063474 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4643ef8-b1b2-407a-a457-6ea8a55fbf94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:44.064917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4643ef8-b1b2-407a-a457-6ea8a55fbf94 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:44.066539 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 28/60] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:15:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:44.071958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2277e-0f2e-46bf-9ec7-85844b091704 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:44.145919 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:44.167730 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2277e-0f2e-46bf-9ec7-85844b091704 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:44.202023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d26cc-13cf-4a8e-93d4-e91b028dc3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:44.202697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d26cc-13cf-4a8e-93d4-e91b028dc3c2 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:44.202986 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d26cc-13cf-4a8e-93d4-e91b028dc3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:44.203274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d26cc-13cf-4a8e-93d4-e91b028dc3c2 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:44.203987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d26cc-13cf-4a8e-93d4-e91b028dc3c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:44.205641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d26cc-13cf-4a8e-93d4-e91b028dc3c2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:44.230608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 33/61] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:15:44 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:15:47.295123 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bfa70-3a64-498b-81b5-de332c8898a9 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:47.295123 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bfa70-3a64-498b-81b5-de332c8898a9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:47.295123 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bfa70-3a64-498b-81b5-de332c8898a9 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:47.295123 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 29/62] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:47.301285 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827261c8-fbcb-48ef-8014-8c11bcef0075 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:47.302102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827261c8-fbcb-48ef-8014-8c11bcef0075 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:47.302622 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827261c8-fbcb-48ef-8014-8c11bcef0075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:47.326018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-827261c8-fbcb-48ef-8014-8c11bcef0075 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:47.327505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-827261c8-fbcb-48ef-8014-8c11bcef0075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:47.422300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 34/63] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:47.453568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341c474-959d-4b5c-84fb-19049eb5971d None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:47.454200 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341c474-959d-4b5c-84fb-19049eb5971d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:47.454701 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341c474-959d-4b5c-84fb-19049eb5971d None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:47.456297 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 30/64] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:47.458732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827261c8-fbcb-48ef-8014-8c11bcef0075 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:47.461067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f6060-7b60-434b-8628-224e38d0bc00 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:47.461361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f6060-7b60-434b-8628-224e38d0bc00 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:47.461656 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f6060-7b60-434b-8628-224e38d0bc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:47.487169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-2c1f6060-7b60-434b-8628-224e38d0bc00 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:47.488387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2c1f6060-7b60-434b-8628-224e38d0bc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:47.545833 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:47.580066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:47.604585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 31/65] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:15:47.626971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827261c8-fbcb-48ef-8014-8c11bcef0075 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:47.634045 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f6060-7b60-434b-8628-224e38d0bc00 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:47.698314 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965e064-1c44-4733-8e81-6b24e08481ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:47.699132 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965e064-1c44-4733-8e81-6b24e08481ab None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:47.699423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965e064-1c44-4733-8e81-6b24e08481ab None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:47.700264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965e064-1c44-4733-8e81-6b24e08481ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:47.720952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965e064-1c44-4733-8e81-6b24e08481ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-e965e064-1c44-4733-8e81-6b24e08481ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:47.728683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:47.729540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:47.730357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:47.730357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:47.730357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:47.730357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:47.730357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:47.730357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:47.730357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:47.730357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:47.730357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:47.730357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:47.730357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:15:47.730357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:15:47.730357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 35/66] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:15:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:47.737554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bd513-bed1-46cc-9191-210a121ed76d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:47.737853 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bd513-bed1-46cc-9191-210a121ed76d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:47.738145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bd513-bed1-46cc-9191-210a121ed76d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:47.739517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 36/67] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:47.740228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bd513-bed1-46cc-9191-210a121ed76d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:47.796263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f6060-7b60-434b-8628-224e38d0bc00 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:47.841898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c5505-9858-4ef9-8c14-3b118f070d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:47.842638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c5505-9858-4ef9-8c14-3b118f070d7b None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:47.842926 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c5505-9858-4ef9-8c14-3b118f070d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:47.843206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c5505-9858-4ef9-8c14-3b118f070d7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:47.853532 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c5505-9858-4ef9-8c14-3b118f070d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:47.855658 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bd513-bed1-46cc-9191-210a121ed76d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-e68c5505-9858-4ef9-8c14-3b118f070d7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:47.861363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:47.862180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:47.862953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:47.862953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:47.862953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:47.862953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:47.862953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:47.862953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:47.862953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:47.862953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:47.862953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:47.862953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:47.862953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:15:47.862953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:15:47.862953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 32/68] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:15:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:15:47.863753 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6681f-55e1-4615-a373-c679e0444738 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:47.864212 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6681f-55e1-4615-a373-c679e0444738 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:47.864490 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6681f-55e1-4615-a373-c679e0444738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:47.881611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-aae6681f-55e1-4615-a373-c679e0444738 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:47.882794 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-aae6681f-55e1-4615-a373-c679e0444738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:47.887036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:47.902090 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086e398-9cdf-421f-869c-3834e084f50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:47.902799 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086e398-9cdf-421f-869c-3834e084f50b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:47.903337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086e398-9cdf-421f-869c-3834e084f50b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:47.903619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086e398-9cdf-421f-869c-3834e084f50b None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:47.904376 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086e398-9cdf-421f-869c-3834e084f50b None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:47.904686 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086e398-9cdf-421f-869c-3834e084f50b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:47.906128 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086e398-9cdf-421f-869c-3834e084f50b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:47.910943 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:47.918791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 37/69] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:15:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:47.918791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfaf82d-a8a2-45a0-926d-4431b0954f40 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:47.918791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfaf82d-a8a2-45a0-926d-4431b0954f40 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:47.918791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfaf82d-a8a2-45a0-926d-4431b0954f40 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:47.918791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 38/70] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:47.918791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfaf82d-a8a2-45a0-926d-4431b0954f40 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:47.961362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 33/71] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:47.962132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6681f-55e1-4615-a373-c679e0444738 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:48.039652 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfaf82d-a8a2-45a0-926d-4431b0954f40 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:48.058634 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6681f-55e1-4615-a373-c679e0444738 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:48.077322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea676bb-764b-4f7a-a16c-f81b9ac401d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:48.077995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea676bb-764b-4f7a-a16c-f81b9ac401d9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:48.078283 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea676bb-764b-4f7a-a16c-f81b9ac401d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:48.078597 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea676bb-764b-4f7a-a16c-f81b9ac401d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:48.079346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea676bb-764b-4f7a-a16c-f81b9ac401d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:48.079655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea676bb-764b-4f7a-a16c-f81b9ac401d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:48.081151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea676bb-764b-4f7a-a16c-f81b9ac401d9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:48.089171 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 39/72] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:15:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:48.090471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef416c-6942-4ee7-b56c-58c6c2bbfe34 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:48.090826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef416c-6942-4ee7-b56c-58c6c2bbfe34 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:48.091180 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef416c-6942-4ee7-b56c-58c6c2bbfe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:48.099264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ba5d3-f3bb-4962-acc0-16ae274a7fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:48.100084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ba5d3-f3bb-4962-acc0-16ae274a7fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:48.100371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ba5d3-f3bb-4962-acc0-16ae274a7fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:48.100650 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ba5d3-f3bb-4962-acc0-16ae274a7fc0 None admin] PATH_INFO: `/v3/users/5ee173f5cb884d6f8571ad755a0dd89a` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:48.107360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2cef416c-6942-4ee7-b56c-58c6c2bbfe34 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:48.108547 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2cef416c-6942-4ee7-b56c-58c6c2bbfe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:48.115835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ba5d3-f3bb-4962-acc0-16ae274a7fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=5ee173f5cb884d6f8571ad755a0dd89a)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:48.117309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ba5d3-f3bb-4962-acc0-16ae274a7fc0 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:48.118986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 34/73] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:15:47 2022] GET /identity/v3/users/5ee173f5cb884d6f8571ad755a0dd89a => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:48.119743 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ba5d3-f3bb-4962-acc0-16ae274a7fc0 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:48.143124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:48.153957 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:48.178129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 40/74] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:48.188360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402172d1-160e-43e9-baf5-88475b061b98 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:48.188360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402172d1-160e-43e9-baf5-88475b061b98 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:48.188360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402172d1-160e-43e9-baf5-88475b061b98 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:48.188360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 41/75] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:48.188360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402172d1-160e-43e9-baf5-88475b061b98 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:48.228134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ba5d3-f3bb-4962-acc0-16ae274a7fc0 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:48.261736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff651b-ae5c-47bb-9836-44e38d91b258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:48.263076 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff651b-ae5c-47bb-9836-44e38d91b258 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:48.263361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff651b-ae5c-47bb-9836-44e38d91b258 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:48.263640 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff651b-ae5c-47bb-9836-44e38d91b258 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:48.274007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff651b-ae5c-47bb-9836-44e38d91b258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-03ff651b-ae5c-47bb-9836-44e38d91b258 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:48.282587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:48.283468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:48.284210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:48.284210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:48.284210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:48.284210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:48.284210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:48.284210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:48.284210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:48.284210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:48.284210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:48.284210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:48.284210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:15:48.284210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:15:48.284210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 35/76] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:15:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:48.284841 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff651b-ae5c-47bb-9836-44e38d91b258 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:48.292236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402172d1-160e-43e9-baf5-88475b061b98 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:48.326085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40756d04-e74e-4dd1-a554-9f3fae51c2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:48.326965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40756d04-e74e-4dd1-a554-9f3fae51c2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:48.327250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40756d04-e74e-4dd1-a554-9f3fae51c2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:48.327532 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40756d04-e74e-4dd1-a554-9f3fae51c2c9 None admin] PATH_INFO: `/v3/users/f173d7158e2a4553aa3707927ef2704b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:48.328718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40756d04-e74e-4dd1-a554-9f3fae51c2c9 None admin] RBAC: Authorizing `identity:get_user(user_id=f173d7158e2a4553aa3707927ef2704b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:48.330229 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40756d04-e74e-4dd1-a554-9f3fae51c2c9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:48.332039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 42/77] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:15:48 2022] GET /identity/v3/users/f173d7158e2a4553aa3707927ef2704b => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:48.333009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caced3bf-0abc-46e6-9e0c-90dd0ff057f0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:48.333301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caced3bf-0abc-46e6-9e0c-90dd0ff057f0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:48.333584 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caced3bf-0abc-46e6-9e0c-90dd0ff057f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:48.349629 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-caced3bf-0abc-46e6-9e0c-90dd0ff057f0 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:48.350743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-caced3bf-0abc-46e6-9e0c-90dd0ff057f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:48.369177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:48.388438 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff651b-ae5c-47bb-9836-44e38d91b258 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:48.392046 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:48.416639 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 43/78] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:48.417309 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caced3bf-0abc-46e6-9e0c-90dd0ff057f0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:48.427124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0c7de-6f45-4ac3-ad4b-137771d90da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:48.428084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0c7de-6f45-4ac3-ad4b-137771d90da3 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:48.428382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0c7de-6f45-4ac3-ad4b-137771d90da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:48.428825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0c7de-6f45-4ac3-ad4b-137771d90da3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:48.495296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0c7de-6f45-4ac3-ad4b-137771d90da3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:48.497324 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0c7de-6f45-4ac3-ad4b-137771d90da3 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:48.513775 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caced3bf-0abc-46e6-9e0c-90dd0ff057f0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:48.548806 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763095b-d4a2-4d45-82ce-715757cadce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:48.549640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763095b-d4a2-4d45-82ce-715757cadce9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:48.549929 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763095b-d4a2-4d45-82ce-715757cadce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:48.550211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763095b-d4a2-4d45-82ce-715757cadce9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:48.561419 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763095b-d4a2-4d45-82ce-715757cadce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9763095b-d4a2-4d45-82ce-715757cadce9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:48.569193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:48.570131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:48.570885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:48.570885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:48.570885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:48.570885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:48.570885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:48.570885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:48.570885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:48.570885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:48.570885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:48.570885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:48.570885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:15:48.570885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:15:48.570885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 44/79] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:15:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:48.571523 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763095b-d4a2-4d45-82ce-715757cadce9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:48.581827 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:48.600822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 36/80] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:15:48.601628 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0c7de-6f45-4ac3-ad4b-137771d90da3 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:48.606870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:48.672423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763095b-d4a2-4d45-82ce-715757cadce9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:48.698447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0c7de-6f45-4ac3-ad4b-137771d90da3 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:48.706200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398ba52-1995-44e2-a6f7-682e1c5f2a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:48.706882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398ba52-1995-44e2-a6f7-682e1c5f2a86 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:48.707170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398ba52-1995-44e2-a6f7-682e1c5f2a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:48.707455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398ba52-1995-44e2-a6f7-682e1c5f2a86 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:48.708208 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398ba52-1995-44e2-a6f7-682e1c5f2a86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:48.708523 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398ba52-1995-44e2-a6f7-682e1c5f2a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:48.709953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398ba52-1995-44e2-a6f7-682e1c5f2a86 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:48.717787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 45/81] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:15:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:48.718569 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398ba52-1995-44e2-a6f7-682e1c5f2a86 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:48.735698 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a5cdb-1fd8-4ff7-93b1-f29722010c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:48.736356 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a5cdb-1fd8-4ff7-93b1-f29722010c3e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:48.736652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a5cdb-1fd8-4ff7-93b1-f29722010c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:48.736958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a5cdb-1fd8-4ff7-93b1-f29722010c3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:48.785173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:48.804163 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a5cdb-1fd8-4ff7-93b1-f29722010c3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:48.805720 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a5cdb-1fd8-4ff7-93b1-f29722010c3e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:48.812356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:48.816500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398ba52-1995-44e2-a6f7-682e1c5f2a86 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:48.849574 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a943f35-182f-49b6-a89c-e6523ae12556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:48.850367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a943f35-182f-49b6-a89c-e6523ae12556 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:48.850651 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a943f35-182f-49b6-a89c-e6523ae12556 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:48.850974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a943f35-182f-49b6-a89c-e6523ae12556 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:48.852107 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a943f35-182f-49b6-a89c-e6523ae12556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:48.853583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a943f35-182f-49b6-a89c-e6523ae12556 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:48.855352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 46/82] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:15:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:48.856463 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a943f35-182f-49b6-a89c-e6523ae12556 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:48.909607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 37/83] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:15:48.910243 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a5cdb-1fd8-4ff7-93b1-f29722010c3e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:48.952215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a943f35-182f-49b6-a89c-e6523ae12556 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:48.984075 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61175944-e835-4af1-8ccb-9f5c62a985d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:48.984734 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61175944-e835-4af1-8ccb-9f5c62a985d4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:48.985052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61175944-e835-4af1-8ccb-9f5c62a985d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:48.985335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61175944-e835-4af1-8ccb-9f5c62a985d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:48.986075 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61175944-e835-4af1-8ccb-9f5c62a985d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:48.986381 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61175944-e835-4af1-8ccb-9f5c62a985d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:48.987756 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61175944-e835-4af1-8ccb-9f5c62a985d4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:48.990083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:48.996012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 47/84] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:15:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:49.000617 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61175944-e835-4af1-8ccb-9f5c62a985d4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:49.009258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a5cdb-1fd8-4ff7-93b1-f29722010c3e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:49.029065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:49.043031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852d6e1-f75a-47bc-a701-cc70044cb4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:49.044385 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852d6e1-f75a-47bc-a701-cc70044cb4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:49.044678 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852d6e1-f75a-47bc-a701-cc70044cb4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:49.044973 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852d6e1-f75a-47bc-a701-cc70044cb4d3 None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:49.046169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852d6e1-f75a-47bc-a701-cc70044cb4d3 None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:49.047615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852d6e1-f75a-47bc-a701-cc70044cb4d3 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:49.049340 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 38/85] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:15:48 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:49.050161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852d6e1-f75a-47bc-a701-cc70044cb4d3 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:49.103065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61175944-e835-4af1-8ccb-9f5c62a985d4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:49.135962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239d12e-a01e-48f8-95b4-d322d2034c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:49.136837 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239d12e-a01e-48f8-95b4-d322d2034c36 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:49.137247 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239d12e-a01e-48f8-95b4-d322d2034c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:49.137530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239d12e-a01e-48f8-95b4-d322d2034c36 None admin] PATH_INFO: `/v3/users/5ee173f5cb884d6f8571ad755a0dd89a` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:49.138728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239d12e-a01e-48f8-95b4-d322d2034c36 None admin] RBAC: Authorizing `identity:get_user(user_id=5ee173f5cb884d6f8571ad755a0dd89a)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:49.140182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239d12e-a01e-48f8-95b4-d322d2034c36 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:49.141835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 48/86] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:15:48 2022] GET /identity/v3/users/5ee173f5cb884d6f8571ad755a0dd89a => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:49.142598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239d12e-a01e-48f8-95b4-d322d2034c36 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:49.154594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852d6e1-f75a-47bc-a701-cc70044cb4d3 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:49.187913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a66ab-c1b8-4450-93a0-1d529f009c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:49.188585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a66ab-c1b8-4450-93a0-1d529f009c0d None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:49.188872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a66ab-c1b8-4450-93a0-1d529f009c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:49.189196 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a66ab-c1b8-4450-93a0-1d529f009c0d None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:49.189921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a66ab-c1b8-4450-93a0-1d529f009c0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:49.191351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a66ab-c1b8-4450-93a0-1d529f009c0d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:49.216692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 39/87] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:15:49 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:15:49.217552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a66ab-c1b8-4450-93a0-1d529f009c0d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:49.226847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:49.249231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:49.258573 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239d12e-a01e-48f8-95b4-d322d2034c36 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:49.305190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fd354-86fe-4920-91e3-1669a55100da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:49.306087 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fd354-86fe-4920-91e3-1669a55100da None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:49.306378 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fd354-86fe-4920-91e3-1669a55100da None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:49.306653 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fd354-86fe-4920-91e3-1669a55100da None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:49.307929 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fd354-86fe-4920-91e3-1669a55100da None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:49.309972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fd354-86fe-4920-91e3-1669a55100da None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:49.311749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 49/88] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:15:49 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:49.312546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fd354-86fe-4920-91e3-1669a55100da None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:49.342862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a66ab-c1b8-4450-93a0-1d529f009c0d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:49.385502 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17316f1-2082-405e-81d6-a27bb609685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:49.386729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17316f1-2082-405e-81d6-a27bb609685a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:49.386729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17316f1-2082-405e-81d6-a27bb609685a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:49.386876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17316f1-2082-405e-81d6-a27bb609685a None admin] PATH_INFO: `/v3/users/5ee173f5cb884d6f8571ad755a0dd89a` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:49.389918 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17316f1-2082-405e-81d6-a27bb609685a None admin] RBAC: Authorizing `identity:get_user(user_id=5ee173f5cb884d6f8571ad755a0dd89a)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:49.390933 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17316f1-2082-405e-81d6-a27bb609685a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:49.392583 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 40/89] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:15:49 2022] GET /identity/v3/users/5ee173f5cb884d6f8571ad755a0dd89a => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:49.393444 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17316f1-2082-405e-81d6-a27bb609685a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:49.439830 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fd354-86fe-4920-91e3-1669a55100da None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:49.485701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f504ea3-76d3-4f5b-8e9a-0f485a486fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:49.486748 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f504ea3-76d3-4f5b-8e9a-0f485a486fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:49.487035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f504ea3-76d3-4f5b-8e9a-0f485a486fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:49.487325 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f504ea3-76d3-4f5b-8e9a-0f485a486fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:49.487448 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:49.488178 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f504ea3-76d3-4f5b-8e9a-0f485a486fd5 None admin] RBAC: Adding query filter params (role.id=3b7272bb6de3425fa18a474080a9c1a2, scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc, user.id=5ee173f5cb884d6f8571ad755a0dd89a) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:49.488500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f504ea3-76d3-4f5b-8e9a-0f485a486fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:49.490368 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f504ea3-76d3-4f5b-8e9a-0f485a486fd5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:49.500223 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 50/90] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:15:49 2022] GET /identity/v3/role_assignments?user.id=5ee173f5cb884d6f8571ad755a0dd89a&scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc&role.id=3b7272bb6de3425fa18a474080a9c1a2 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:49.501672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f504ea3-76d3-4f5b-8e9a-0f485a486fd5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:49.521843 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17316f1-2082-405e-81d6-a27bb609685a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:49.561590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:49.576715 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38feb47-fcda-4907-b9b7-d1ed5ba4eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:49.578068 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38feb47-fcda-4907-b9b7-d1ed5ba4eb58 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:49.578502 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38feb47-fcda-4907-b9b7-d1ed5ba4eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:49.578923 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38feb47-fcda-4907-b9b7-d1ed5ba4eb58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:49.655327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f504ea3-76d3-4f5b-8e9a-0f485a486fd5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:49.662866 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38feb47-fcda-4907-b9b7-d1ed5ba4eb58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:49.664696 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38feb47-fcda-4907-b9b7-d1ed5ba4eb58 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:49.712145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae809e5-e5ca-4939-8ee9-2bfc7573374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:49.713363 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae809e5-e5ca-4939-8ee9-2bfc7573374a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:49.713655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae809e5-e5ca-4939-8ee9-2bfc7573374a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:49.713939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae809e5-e5ca-4939-8ee9-2bfc7573374a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:49.714801 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae809e5-e5ca-4939-8ee9-2bfc7573374a None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc, user.id=f173d7158e2a4553aa3707927ef2704b) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:49.715164 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae809e5-e5ca-4939-8ee9-2bfc7573374a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:49.717642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae809e5-e5ca-4939-8ee9-2bfc7573374a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:49.725376 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 51/91] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:15:49 2022] GET /identity/v3/role_assignments?user.id=f173d7158e2a4553aa3707927ef2704b&scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:49.726033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae809e5-e5ca-4939-8ee9-2bfc7573374a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:49.790615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:49.849671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 41/92] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:15:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:15:49.853868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:49.855522 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38feb47-fcda-4907-b9b7-d1ed5ba4eb58 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:49.867860 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae809e5-e5ca-4939-8ee9-2bfc7573374a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:49.932696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde73f79-5ae1-48d9-9502-962b0b0e3927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:49.935142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde73f79-5ae1-48d9-9502-962b0b0e3927 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:49.935613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde73f79-5ae1-48d9-9502-962b0b0e3927 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:49.937340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde73f79-5ae1-48d9-9502-962b0b0e3927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:50.062873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38feb47-fcda-4907-b9b7-d1ed5ba4eb58 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:50.076947 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde73f79-5ae1-48d9-9502-962b0b0e3927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:50.078171 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde73f79-5ae1-48d9-9502-962b0b0e3927 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:50.100975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3642aa-d75e-4920-938d-3ee70ef9dcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:50.101948 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3642aa-d75e-4920-938d-3ee70ef9dcec None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:50.102243 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3642aa-d75e-4920-938d-3ee70ef9dcec None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:50.102533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3642aa-d75e-4920-938d-3ee70ef9dcec None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:50.105311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3642aa-d75e-4920-938d-3ee70ef9dcec None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:50.107468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3642aa-d75e-4920-938d-3ee70ef9dcec None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:50.109230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 42/93] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:15:49 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:50.115132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3642aa-d75e-4920-938d-3ee70ef9dcec None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:50.187642 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:50.286752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:50.312841 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3642aa-d75e-4920-938d-3ee70ef9dcec None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:50.315831 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 52/94] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:15:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:15:50.337916 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde73f79-5ae1-48d9-9502-962b0b0e3927 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:50.362188 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be1764-c7f5-434b-8ebc-f877c95e48ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:50.362866 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be1764-c7f5-434b-8ebc-f877c95e48ae None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:50.363162 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be1764-c7f5-434b-8ebc-f877c95e48ae None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:50.363443 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be1764-c7f5-434b-8ebc-f877c95e48ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:50.364405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be1764-c7f5-434b-8ebc-f877c95e48ae None admin] RBAC: Adding query filter params (role.id=ffad03b6b6d1473dba5d5b7296943f18, scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc, user.id=5ee173f5cb884d6f8571ad755a0dd89a) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:50.364710 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be1764-c7f5-434b-8ebc-f877c95e48ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:50.366202 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be1764-c7f5-434b-8ebc-f877c95e48ae None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:50.379537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 43/95] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:15:50 2022] GET /identity/v3/role_assignments?user.id=5ee173f5cb884d6f8571ad755a0dd89a&scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc&role.id=ffad03b6b6d1473dba5d5b7296943f18 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:50.505429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde73f79-5ae1-48d9-9502-962b0b0e3927 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:50.562618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346c396-98c2-465c-8d0f-4901cd328e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:50.563513 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346c396-98c2-465c-8d0f-4901cd328e58 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:50.563799 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346c396-98c2-465c-8d0f-4901cd328e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:50.564100 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346c396-98c2-465c-8d0f-4901cd328e58 None admin] PATH_INFO: `/v3/projects/36b901ca38a847ea89730753aa907842` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:50.565303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346c396-98c2-465c-8d0f-4901cd328e58 None admin] RBAC: Authorizing `identity:get_project(project_id=36b901ca38a847ea89730753aa907842)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:50.566755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346c396-98c2-465c-8d0f-4901cd328e58 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:50.568775 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 53/96] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:15:50 2022] GET /identity/v3/projects/36b901ca38a847ea89730753aa907842 => generated 312 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:50.575016 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be1764-c7f5-434b-8ebc-f877c95e48ae None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:50.720659 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be1764-c7f5-434b-8ebc-f877c95e48ae None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:50.728065 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:50.764650 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8aa463-eec8-4fb2-a095-02c1d70476a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:50.765585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aa463-eec8-4fb2-a095-02c1d70476a1 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:50.766059 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aa463-eec8-4fb2-a095-02c1d70476a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:50.766482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aa463-eec8-4fb2-a095-02c1d70476a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:50.767507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8aa463-eec8-4fb2-a095-02c1d70476a1 None admin] RBAC: Adding query filter params (role.id=3b7272bb6de3425fa18a474080a9c1a2, scope.project.id=36b901ca38a847ea89730753aa907842, user.id=5ee173f5cb884d6f8571ad755a0dd89a) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:50.767971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8aa463-eec8-4fb2-a095-02c1d70476a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:50.769638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8aa463-eec8-4fb2-a095-02c1d70476a1 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:50.775518 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 44/97] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:15:50 2022] GET /identity/v3/role_assignments?user.id=5ee173f5cb884d6f8571ad755a0dd89a&scope.project.id=36b901ca38a847ea89730753aa907842&role.id=3b7272bb6de3425fa18a474080a9c1a2 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:52.185209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641da1e-0745-4b0b-98c7-70bb70e2d64b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:52.185716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641da1e-0745-4b0b-98c7-70bb70e2d64b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:52.185797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641da1e-0745-4b0b-98c7-70bb70e2d64b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:52.187134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 54/98] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:52.192389 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf2113-cbfb-4cde-95df-4b9f2d919eab None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:52.192782 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf2113-cbfb-4cde-95df-4b9f2d919eab None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:52.192952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf2113-cbfb-4cde-95df-4b9f2d919eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:52.221882 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-e4bf2113-cbfb-4cde-95df-4b9f2d919eab None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:52.223076 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e4bf2113-cbfb-4cde-95df-4b9f2d919eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:52.310552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 45/99] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 21 22:15:52.356173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641da1e-0745-4b0b-98c7-70bb70e2d64b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:52.429724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:52.475859 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641da1e-0745-4b0b-98c7-70bb70e2d64b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:52.511557 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7d4bb-aec5-407c-b873-c4014d152663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:52.512423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7d4bb-aec5-407c-b873-c4014d152663 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:52.512991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7d4bb-aec5-407c-b873-c4014d152663 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:52.513279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7d4bb-aec5-407c-b873-c4014d152663 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:52.524150 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7d4bb-aec5-407c-b873-c4014d152663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c7f7d4bb-aec5-407c-b873-c4014d152663 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:52.533019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:52.533921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:52.534656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:52.534656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:52.534656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:52.534656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:52.534656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:52.534656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:52.534656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:52.534656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:52.534656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:52.534656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:52.534656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:15:52.534656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:15:52.534656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 55/100] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:15:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:52.542112 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf2113-cbfb-4cde-95df-4b9f2d919eab None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:52.555725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f1d32-cc97-498d-8563-f220dad5faf4 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:52.555904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f1d32-cc97-498d-8563-f220dad5faf4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:52.556174 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f1d32-cc97-498d-8563-f220dad5faf4 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:52.557738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 56/101] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:15:52.563223 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aa167-0d99-45eb-b626-63c6a172fdd1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:52.563223 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aa167-0d99-45eb-b626-63c6a172fdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:52.563516 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aa167-0d99-45eb-b626-63c6a172fdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:52.591286 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9d5aa167-0d99-45eb-b626-63c6a172fdd1 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:52.592625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9d5aa167-0d99-45eb-b626-63c6a172fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:52.724510 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 57/102] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:52.763072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5aa167-0d99-45eb-b626-63c6a172fdd1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:52.773138 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:52.776037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf2113-cbfb-4cde-95df-4b9f2d919eab None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:52.843370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9142c2-e0b8-4c86-a96c-d278ffdfb744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:52.844056 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9142c2-e0b8-4c86-a96c-d278ffdfb744 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:52.844347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9142c2-e0b8-4c86-a96c-d278ffdfb744 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:52.844627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9142c2-e0b8-4c86-a96c-d278ffdfb744 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:52.845428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9142c2-e0b8-4c86-a96c-d278ffdfb744 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:52.845741 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9142c2-e0b8-4c86-a96c-d278ffdfb744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:52.847139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9142c2-e0b8-4c86-a96c-d278ffdfb744 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:52.857277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:52.862018 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 46/103] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:15:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:52.863173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e87445-bee4-478e-9b04-241c3c4cf04a None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:52.863468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e87445-bee4-478e-9b04-241c3c4cf04a None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:52.863755 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e87445-bee4-478e-9b04-241c3c4cf04a None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:52.869926 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 47/104] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:52.870543 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e87445-bee4-478e-9b04-241c3c4cf04a None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:52.931527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5aa167-0d99-45eb-b626-63c6a172fdd1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:52.969729 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41333d96-1c57-469c-bde6-f2809691b67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:52.970637 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41333d96-1c57-469c-bde6-f2809691b67e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:52.970928 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41333d96-1c57-469c-bde6-f2809691b67e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:52.971208 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41333d96-1c57-469c-bde6-f2809691b67e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:52.972386 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41333d96-1c57-469c-bde6-f2809691b67e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:52.974132 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41333d96-1c57-469c-bde6-f2809691b67e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:52.975994 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 58/105] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:15:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:52.977022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2046c-2356-4732-9413-ad329f085bf5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:52.977409 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2046c-2356-4732-9413-ad329f085bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:52.977693 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2046c-2356-4732-9413-ad329f085bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:52.995174 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e87445-bee4-478e-9b04-241c3c4cf04a None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:52.995496 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4ef2046c-2356-4732-9413-ad329f085bf5 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:52.996736 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4ef2046c-2356-4732-9413-ad329f085bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:53.031237 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271d756-6f2c-42fd-86f8-e46c0a37853d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:53.032279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271d756-6f2c-42fd-86f8-e46c0a37853d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:53.032576 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271d756-6f2c-42fd-86f8-e46c0a37853d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:53.032862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271d756-6f2c-42fd-86f8-e46c0a37853d None admin] PATH_INFO: `/v3/users/f04b3bc5aba545fb83b4de6eb19a53a5` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:53.047828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271d756-6f2c-42fd-86f8-e46c0a37853d None admin] RBAC: Authorizing `identity:get_user(user_id=f04b3bc5aba545fb83b4de6eb19a53a5)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:53.049452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271d756-6f2c-42fd-86f8-e46c0a37853d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:53.051263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 48/106] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:15:52 2022] GET /identity/v3/users/f04b3bc5aba545fb83b4de6eb19a53a5 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:53.057186 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f30407-5ee6-4ae6-a997-890c33dc4b8f None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:53.057484 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f30407-5ee6-4ae6-a997-890c33dc4b8f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:53.057776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f30407-5ee6-4ae6-a997-890c33dc4b8f None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:53.059222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 49/107] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:53.059992 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f30407-5ee6-4ae6-a997-890c33dc4b8f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:53.078052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 59/108] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:53.078581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2046c-2356-4732-9413-ad329f085bf5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:53.091023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:53.133655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:53.187634 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f30407-5ee6-4ae6-a997-890c33dc4b8f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:53.188328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2046c-2356-4732-9413-ad329f085bf5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:53.225621 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af72653-9031-40f7-9aa2-ca8abdf1625b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:53.226338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72653-9031-40f7-9aa2-ca8abdf1625b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:53.226811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72653-9031-40f7-9aa2-ca8abdf1625b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:53.226811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72653-9031-40f7-9aa2-ca8abdf1625b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:53.232103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a7689-705c-48a8-ad3b-f41dbee3e6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:53.232778 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a7689-705c-48a8-ad3b-f41dbee3e6b3 None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:53.233134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a7689-705c-48a8-ad3b-f41dbee3e6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:53.233418 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a7689-705c-48a8-ad3b-f41dbee3e6b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:53.234138 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a7689-705c-48a8-ad3b-f41dbee3e6b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:53.235590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a7689-705c-48a8-ad3b-f41dbee3e6b3 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:53.266081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 50/109] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jul 21 22:15:53 2022] POST /identity/v3/projects => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:15:53.267708 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55444fa-668c-4a90-8845-9310a8b0eff5 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:53.268226 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55444fa-668c-4a90-8845-9310a8b0eff5 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:53.269303 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55444fa-668c-4a90-8845-9310a8b0eff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:53.297124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-a55444fa-668c-4a90-8845-9310a8b0eff5 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:53.298616 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a55444fa-668c-4a90-8845-9310a8b0eff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:53.310659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af72653-9031-40f7-9aa2-ca8abdf1625b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:53.313392 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af72653-9031-40f7-9aa2-ca8abdf1625b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:53.378817 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 51/110] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:53.383880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:53.385051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55444fa-668c-4a90-8845-9310a8b0eff5 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:53.388259 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:53.455852 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 60/111] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:15:53.457068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81870400-2cbf-4c3f-9875-521042c72a3e None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:53.457407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81870400-2cbf-4c3f-9875-521042c72a3e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:53.457638 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81870400-2cbf-4c3f-9875-521042c72a3e None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:53.458921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 61/112] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:53.459608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81870400-2cbf-4c3f-9875-521042c72a3e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:53.534257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55444fa-668c-4a90-8845-9310a8b0eff5 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:53.578611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997976a9-9647-42c1-a729-f46e52562f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:53.578804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81870400-2cbf-4c3f-9875-521042c72a3e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:53.579888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997976a9-9647-42c1-a729-f46e52562f11 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:53.580764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997976a9-9647-42c1-a729-f46e52562f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:53.581093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997976a9-9647-42c1-a729-f46e52562f11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:53.592742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997976a9-9647-42c1-a729-f46e52562f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-997976a9-9647-42c1-a729-f46e52562f11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:53.600594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:53.601559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:53.602333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:53.602333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:53.602333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:53.602333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:53.602333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:53.602333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:53.602333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:53.602333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:53.602333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:53.602333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:53.602333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:15:53.602333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:15:53.602333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 52/113] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:15:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:53.608273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943115e-5a83-46f2-acc2-a9673c7f57a3 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:53.608273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943115e-5a83-46f2-acc2-a9673c7f57a3 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:53.608273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943115e-5a83-46f2-acc2-a9673c7f57a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:53.619097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4ba22-4e5e-47aa-a438-87d420e1d282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:53.619908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4ba22-4e5e-47aa-a438-87d420e1d282 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:53.620179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4ba22-4e5e-47aa-a438-87d420e1d282 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:53.620454 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4ba22-4e5e-47aa-a438-87d420e1d282 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:53.624101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-8943115e-5a83-46f2-acc2-a9673c7f57a3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:53.625329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8943115e-5a83-46f2-acc2-a9673c7f57a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:53.631455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4ba22-4e5e-47aa-a438-87d420e1d282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-cca4ba22-4e5e-47aa-a438-87d420e1d282 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:53.639458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:53.640323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:53.641109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:53.641109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:53.641109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:53.641109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:53.641109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:53.641109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:53.641109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:53.641109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:53.641109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:53.641109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:53.641109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:15:53.641109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:15:53.641109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 62/114] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:15:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:53.641740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4ba22-4e5e-47aa-a438-87d420e1d282 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:53.653829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:53.699725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:53.713591 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 53/115] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:53.715065 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b25b5-f49b-4616-bfdb-f83215c92d1c None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:53.715420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b25b5-f49b-4616-bfdb-f83215c92d1c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:53.715766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b25b5-f49b-4616-bfdb-f83215c92d1c None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:53.717136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 54/116] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:53.717890 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b25b5-f49b-4616-bfdb-f83215c92d1c None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:53.758111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4ba22-4e5e-47aa-a438-87d420e1d282 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:53.795488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8c31d-eb8c-4bf9-876a-d99a6f96601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:53.796276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8c31d-eb8c-4bf9-876a-d99a6f96601c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:53.796567 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8c31d-eb8c-4bf9-876a-d99a6f96601c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:53.796850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8c31d-eb8c-4bf9-876a-d99a6f96601c None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:53.798088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8c31d-eb8c-4bf9-876a-d99a6f96601c None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:53.799577 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8c31d-eb8c-4bf9-876a-d99a6f96601c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:53.801474 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 63/117] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:15:53 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:53.806774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8c31d-eb8c-4bf9-876a-d99a6f96601c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:53.822770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b25b5-f49b-4616-bfdb-f83215c92d1c None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:53.861069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f22d1e-9133-4982-9e0b-b0d9bc5d3e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:53.861750 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f22d1e-9133-4982-9e0b-b0d9bc5d3e60 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:53.862041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f22d1e-9133-4982-9e0b-b0d9bc5d3e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:53.862323 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f22d1e-9133-4982-9e0b-b0d9bc5d3e60 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:53.863080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f22d1e-9133-4982-9e0b-b0d9bc5d3e60 None admin] RBAC: Adding query filter params (name=member) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:53.863820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f22d1e-9133-4982-9e0b-b0d9bc5d3e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:53.865523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f22d1e-9133-4982-9e0b-b0d9bc5d3e60 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:53.881183 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 55/118] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:15:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:53.881183 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d13a6-0ed9-428c-b343-e7c5ec8ab5d6 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:53.881183 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d13a6-0ed9-428c-b343-e7c5ec8ab5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:53.881183 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d13a6-0ed9-428c-b343-e7c5ec8ab5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:53.888428 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:53.899179 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-2b2d13a6-0ed9-428c-b343-e7c5ec8ab5d6 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:53.901130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2b2d13a6-0ed9-428c-b343-e7c5ec8ab5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:53.911759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8c31d-eb8c-4bf9-876a-d99a6f96601c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:53.947821 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736847a-1a6b-4e74-b576-e33c4f8b9e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:53.948495 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736847a-1a6b-4e74-b576-e33c4f8b9e11 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:53.948787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736847a-1a6b-4e74-b576-e33c4f8b9e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:53.949105 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736847a-1a6b-4e74-b576-e33c4f8b9e11 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:53.950417 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736847a-1a6b-4e74-b576-e33c4f8b9e11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:53.950731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736847a-1a6b-4e74-b576-e33c4f8b9e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:53.952133 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736847a-1a6b-4e74-b576-e33c4f8b9e11 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:53.955392 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:53.960900 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 64/119] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:15:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:53.961688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736847a-1a6b-4e74-b576-e33c4f8b9e11 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:53.985403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 56/120] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:53.986699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d13a6-0ed9-428c-b343-e7c5ec8ab5d6 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:54.083091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736847a-1a6b-4e74-b576-e33c4f8b9e11 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:54.105778 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d13a6-0ed9-428c-b343-e7c5ec8ab5d6 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:54.118100 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b9811-c338-46eb-bd77-4ee522edf0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:54.118919 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b9811-c338-46eb-bd77-4ee522edf0fd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:54.119211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b9811-c338-46eb-bd77-4ee522edf0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:54.119492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b9811-c338-46eb-bd77-4ee522edf0fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:54.127466 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:54.131981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b9811-c338-46eb-bd77-4ee522edf0fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-570b9811-c338-46eb-bd77-4ee522edf0fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:54.140952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:54.141782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:54.142522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:54.142522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:54.142522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:54.142522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:54.142522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:54.142522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:54.142522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:54.142522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:54.142522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:54.142522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:54.142522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:15:54.142522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:15:54.142522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 65/121] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:15:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:54.144296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a8b04-f5e2-4424-932c-d5cc8b7e60f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:54.144978 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a8b04-f5e2-4424-932c-d5cc8b7e60f7 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:54.145269 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a8b04-f5e2-4424-932c-d5cc8b7e60f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:54.145548 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a8b04-f5e2-4424-932c-d5cc8b7e60f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:54.146323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b9811-c338-46eb-bd77-4ee522edf0fd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:54.146434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a8b04-f5e2-4424-932c-d5cc8b7e60f7 None admin] RBAC: Adding query filter params (role.id=6a46f6859932445b83ab7334c94dbe9b, scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc, user.id=f04b3bc5aba545fb83b4de6eb19a53a5) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:54.146779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a8b04-f5e2-4424-932c-d5cc8b7e60f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:54.148256 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a8b04-f5e2-4424-932c-d5cc8b7e60f7 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:54.155128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 57/122] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:15:53 2022] GET /identity/v3/role_assignments?user.id=f04b3bc5aba545fb83b4de6eb19a53a5&scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc&role.id=6a46f6859932445b83ab7334c94dbe9b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:54.155974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a8b04-f5e2-4424-932c-d5cc8b7e60f7 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:54.241311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:54.289161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a8b04-f5e2-4424-932c-d5cc8b7e60f7 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:54.296642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b9811-c338-46eb-bd77-4ee522edf0fd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:54.332241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7d834-d299-444f-8d5e-7b62eeed91f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:54.333296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7d834-d299-444f-8d5e-7b62eeed91f8 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:54.333587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7d834-d299-444f-8d5e-7b62eeed91f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:54.334200 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7d834-d299-444f-8d5e-7b62eeed91f8 None admin] PATH_INFO: `/v3/users/f173d7158e2a4553aa3707927ef2704b` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:54.335754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7d834-d299-444f-8d5e-7b62eeed91f8 None admin] RBAC: Authorizing `identity:get_user(user_id=f173d7158e2a4553aa3707927ef2704b)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:54.338016 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7d834-d299-444f-8d5e-7b62eeed91f8 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:54.344737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 58/123] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:15:54 2022] GET /identity/v3/users/f173d7158e2a4553aa3707927ef2704b => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:54.344737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7d834-d299-444f-8d5e-7b62eeed91f8 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:54.346098 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843150c-cf6e-4f20-9fd2-e8780559f00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:54.347038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843150c-cf6e-4f20-9fd2-e8780559f00d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:54.347327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843150c-cf6e-4f20-9fd2-e8780559f00d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:54.347611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843150c-cf6e-4f20-9fd2-e8780559f00d None admin] PATH_INFO: `/v3/users/5ee173f5cb884d6f8571ad755a0dd89a` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:54.349182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843150c-cf6e-4f20-9fd2-e8780559f00d None admin] RBAC: Authorizing `identity:get_user(user_id=5ee173f5cb884d6f8571ad755a0dd89a)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:54.351716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843150c-cf6e-4f20-9fd2-e8780559f00d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:54.353413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 66/124] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:15:54 2022] GET /identity/v3/users/5ee173f5cb884d6f8571ad755a0dd89a => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:54.354183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843150c-cf6e-4f20-9fd2-e8780559f00d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:54.439983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:54.457171 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7d834-d299-444f-8d5e-7b62eeed91f8 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:54.477965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:54.486054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843150c-cf6e-4f20-9fd2-e8780559f00d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:54.503195 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b647c7-f5c8-4eb4-a89f-7a064b1b397a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:54.504744 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b647c7-f5c8-4eb4-a89f-7a064b1b397a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:54.505512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b647c7-f5c8-4eb4-a89f-7a064b1b397a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:54.506009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b647c7-f5c8-4eb4-a89f-7a064b1b397a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:54.520247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b647c7-f5c8-4eb4-a89f-7a064b1b397a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:54.526776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0697a4-9225-4d7b-af49-18bddcfe80dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:54.527559 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0697a4-9225-4d7b-af49-18bddcfe80dd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:54.528178 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0697a4-9225-4d7b-af49-18bddcfe80dd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:54.528473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0697a4-9225-4d7b-af49-18bddcfe80dd None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:54.529324 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0697a4-9225-4d7b-af49-18bddcfe80dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:54.529640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0697a4-9225-4d7b-af49-18bddcfe80dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:54.531149 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0697a4-9225-4d7b-af49-18bddcfe80dd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-b9b647c7-f5c8-4eb4-a89f-7a064b1b397a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:54.531373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:54.532178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:54.532961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:54.532961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:54.532961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:54.532961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:54.532961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:54.532961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:54.532961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:54.532961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:54.532961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:54.532961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:54.532961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:15:54.532961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:15:54.540584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 59/125] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:15:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:54.541956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b647c7-f5c8-4eb4-a89f-7a064b1b397a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:54.543600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 67/126] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:15:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:54.550088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0697a4-9225-4d7b-af49-18bddcfe80dd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:54.660430 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b647c7-f5c8-4eb4-a89f-7a064b1b397a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:54.670787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0697a4-9225-4d7b-af49-18bddcfe80dd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:54.695091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c55f5-c371-44c4-aa2f-5aefb17fa545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:54.696119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c55f5-c371-44c4-aa2f-5aefb17fa545 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:54.696513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c55f5-c371-44c4-aa2f-5aefb17fa545 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:54.696895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c55f5-c371-44c4-aa2f-5aefb17fa545 None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:54.698273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c55f5-c371-44c4-aa2f-5aefb17fa545 None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:54.699951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c55f5-c371-44c4-aa2f-5aefb17fa545 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:54.700965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:54.707051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 60/127] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:15:54 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:54.707051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c55f5-c371-44c4-aa2f-5aefb17fa545 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:54.716608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e52e3a-bcc1-485b-92eb-b08554159cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:54.717834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e52e3a-bcc1-485b-92eb-b08554159cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:54.718259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e52e3a-bcc1-485b-92eb-b08554159cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:54.718690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e52e3a-bcc1-485b-92eb-b08554159cc8 None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:54.720127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e52e3a-bcc1-485b-92eb-b08554159cc8 None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:54.721829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e52e3a-bcc1-485b-92eb-b08554159cc8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:54.724182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 68/128] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:15:54 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:54.725315 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e52e3a-bcc1-485b-92eb-b08554159cc8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:54.757116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:54.818910 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c55f5-c371-44c4-aa2f-5aefb17fa545 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:54.839388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e52e3a-bcc1-485b-92eb-b08554159cc8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:54.856474 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd90e9-4901-461a-a362-6e00fc8fe3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:54.857341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd90e9-4901-461a-a362-6e00fc8fe3fc None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:54.857833 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd90e9-4901-461a-a362-6e00fc8fe3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:54.858222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd90e9-4901-461a-a362-6e00fc8fe3fc None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:54.859192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd90e9-4901-461a-a362-6e00fc8fe3fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:54.859611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd90e9-4901-461a-a362-6e00fc8fe3fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:54.861135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd90e9-4901-461a-a362-6e00fc8fe3fc None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:54.870396 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 61/129] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:15:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:54.871509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd90e9-4901-461a-a362-6e00fc8fe3fc None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:54.877651 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff3ab9-12de-41ce-a257-f35d6b6c4b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:54.878746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff3ab9-12de-41ce-a257-f35d6b6c4b9f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:54.879169 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff3ab9-12de-41ce-a257-f35d6b6c4b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:54.879575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff3ab9-12de-41ce-a257-f35d6b6c4b9f None admin] PATH_INFO: `/v3/users/5ee173f5cb884d6f8571ad755a0dd89a` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:54.880982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff3ab9-12de-41ce-a257-f35d6b6c4b9f None admin] RBAC: Authorizing `identity:get_user(user_id=5ee173f5cb884d6f8571ad755a0dd89a)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:54.882700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff3ab9-12de-41ce-a257-f35d6b6c4b9f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:54.884948 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 69/130] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:15:54 2022] GET /identity/v3/users/5ee173f5cb884d6f8571ad755a0dd89a => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:54.885818 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff3ab9-12de-41ce-a257-f35d6b6c4b9f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:54.970282 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:55.004026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd90e9-4901-461a-a362-6e00fc8fe3fc None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:55.012984 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:55.024060 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff3ab9-12de-41ce-a257-f35d6b6c4b9f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:55.042224 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d5c43-bfcc-441d-98c7-4ffcd5e9bd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:55.043878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d5c43-bfcc-441d-98c7-4ffcd5e9bd17 None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:55.044270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d5c43-bfcc-441d-98c7-4ffcd5e9bd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:55.044653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d5c43-bfcc-441d-98c7-4ffcd5e9bd17 None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc/users/f173d7158e2a4553aa3707927ef2704b/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:55.046902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d5c43-bfcc-441d-98c7-4ffcd5e9bd17 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4684cfef7d430aad38eb190fb3f5fc, user_id=f173d7158e2a4553aa3707927ef2704b, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:55.048456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d5c43-bfcc-441d-98c7-4ffcd5e9bd17 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:55.063349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22336154-1a62-48b0-9b06-3ad306748ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:55.072967 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 62/131] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:15:54 2022] PUT /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc/users/f173d7158e2a4553aa3707927ef2704b/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:15:55.072967 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d5c43-bfcc-441d-98c7-4ffcd5e9bd17 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:55.073236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22336154-1a62-48b0-9b06-3ad306748ddb None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:55.073236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22336154-1a62-48b0-9b06-3ad306748ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:55.073236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22336154-1a62-48b0-9b06-3ad306748ddb None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc/users/5ee173f5cb884d6f8571ad755a0dd89a/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:55.081940 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22336154-1a62-48b0-9b06-3ad306748ddb None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4684cfef7d430aad38eb190fb3f5fc, user_id=5ee173f5cb884d6f8571ad755a0dd89a, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:55.084107 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22336154-1a62-48b0-9b06-3ad306748ddb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:55.110227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 70/132] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:15:54 2022] PUT /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc/users/5ee173f5cb884d6f8571ad755a0dd89a/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:15:55.111005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22336154-1a62-48b0-9b06-3ad306748ddb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:55.245081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22336154-1a62-48b0-9b06-3ad306748ddb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:55.276486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:55.293428 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f94a3-68ad-4dcb-b9d9-d4ebd545eda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:55.294833 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f94a3-68ad-4dcb-b9d9-d4ebd545eda9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:55.295128 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f94a3-68ad-4dcb-b9d9-d4ebd545eda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:55.295454 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f94a3-68ad-4dcb-b9d9-d4ebd545eda9 None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:55.297037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f94a3-68ad-4dcb-b9d9-d4ebd545eda9 None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:55.298516 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f94a3-68ad-4dcb-b9d9-d4ebd545eda9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:55.300507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 71/133] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:15:55 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:55.307488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f94a3-68ad-4dcb-b9d9-d4ebd545eda9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:55.319217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d5c43-bfcc-441d-98c7-4ffcd5e9bd17 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:55.374720 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2470b7-66a9-4709-91ed-37aa86827804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:55.376115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2470b7-66a9-4709-91ed-37aa86827804 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:55.376611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2470b7-66a9-4709-91ed-37aa86827804 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:55.377118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2470b7-66a9-4709-91ed-37aa86827804 None admin] PATH_INFO: `/v3/users/5ee173f5cb884d6f8571ad755a0dd89a` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:55.378619 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2470b7-66a9-4709-91ed-37aa86827804 None admin] RBAC: Authorizing `identity:get_user(user_id=5ee173f5cb884d6f8571ad755a0dd89a)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:55.380315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2470b7-66a9-4709-91ed-37aa86827804 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:55.382244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 63/134] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:15:55 2022] GET /identity/v3/users/5ee173f5cb884d6f8571ad755a0dd89a => generated 275 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:55.388114 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2470b7-66a9-4709-91ed-37aa86827804 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:55.428437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:55.441902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f94a3-68ad-4dcb-b9d9-d4ebd545eda9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:55.480826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d57e73-9bae-4d2d-9165-cd93bb1a5b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:55.481777 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d57e73-9bae-4d2d-9165-cd93bb1a5b8e None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:55.482065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d57e73-9bae-4d2d-9165-cd93bb1a5b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:55.482350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d57e73-9bae-4d2d-9165-cd93bb1a5b8e None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc/users/5ee173f5cb884d6f8571ad755a0dd89a/roles/ffad03b6b6d1473dba5d5b7296943f18` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:55.484703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d57e73-9bae-4d2d-9165-cd93bb1a5b8e None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4684cfef7d430aad38eb190fb3f5fc, user_id=5ee173f5cb884d6f8571ad755a0dd89a, role_id=ffad03b6b6d1473dba5d5b7296943f18)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:55.486270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d57e73-9bae-4d2d-9165-cd93bb1a5b8e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:55.505315 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 72/135] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:15:55 2022] PUT /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc/users/5ee173f5cb884d6f8571ad755a0dd89a/roles/ffad03b6b6d1473dba5d5b7296943f18 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:15:55.506722 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70520f-b594-42b6-82ef-79534894490c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:55.507180 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70520f-b594-42b6-82ef-79534894490c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:55.507574 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70520f-b594-42b6-82ef-79534894490c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:55.509335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 73/136] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:55.514346 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2470b7-66a9-4709-91ed-37aa86827804 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:55.521002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79af178-ecb0-42b0-8265-15eca7f24cdb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:55.521002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79af178-ecb0-42b0-8265-15eca7f24cdb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:55.521002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79af178-ecb0-42b0-8265-15eca7f24cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:55.542455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b79af178-ecb0-42b0-8265-15eca7f24cdb None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:55.544360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b79af178-ecb0-42b0-8265-15eca7f24cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:55.587672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99275bd1-24d3-4f42-b39d-55de1c104fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:55.588912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99275bd1-24d3-4f42-b39d-55de1c104fdc None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:55.589461 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99275bd1-24d3-4f42-b39d-55de1c104fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:55.589952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99275bd1-24d3-4f42-b39d-55de1c104fdc None admin] PATH_INFO: `/v3/projects/36b901ca38a847ea89730753aa907842` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:55.593770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99275bd1-24d3-4f42-b39d-55de1c104fdc None admin] RBAC: Authorizing `identity:get_project(project_id=36b901ca38a847ea89730753aa907842)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:55.595520 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99275bd1-24d3-4f42-b39d-55de1c104fdc None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:55.597632 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 64/137] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:15:55 2022] GET /identity/v3/projects/36b901ca38a847ea89730753aa907842 => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:55.603567 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99275bd1-24d3-4f42-b39d-55de1c104fdc None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:55.605252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:55.635157 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 74/138] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:15:55.691824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79af178-ecb0-42b0-8265-15eca7f24cdb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:55.758894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99275bd1-24d3-4f42-b39d-55de1c104fdc None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:55.764429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:55.831292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9c800-37fe-444f-ab29-9b5a0d84b128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:55.832245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9c800-37fe-444f-ab29-9b5a0d84b128 None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:55.832535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9c800-37fe-444f-ab29-9b5a0d84b128 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:55.832812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9c800-37fe-444f-ab29-9b5a0d84b128 None admin] PATH_INFO: `/v3/projects/36b901ca38a847ea89730753aa907842/users/5ee173f5cb884d6f8571ad755a0dd89a/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:55.837522 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9c800-37fe-444f-ab29-9b5a0d84b128 None admin] RBAC: Authorizing `identity:create_grant(project_id=36b901ca38a847ea89730753aa907842, user_id=5ee173f5cb884d6f8571ad755a0dd89a, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:55.839047 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9c800-37fe-444f-ab29-9b5a0d84b128 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:55.861449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 65/139] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:15:55 2022] PUT /identity/v3/projects/36b901ca38a847ea89730753aa907842/users/5ee173f5cb884d6f8571ad755a0dd89a/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:15:55.877950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79af178-ecb0-42b0-8265-15eca7f24cdb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:55.950765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39187ec3-cb41-4375-b637-732b77a22eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:55.951592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39187ec3-cb41-4375-b637-732b77a22eef None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:55.951920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39187ec3-cb41-4375-b637-732b77a22eef None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:55.952197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39187ec3-cb41-4375-b637-732b77a22eef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:55.953491 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39187ec3-cb41-4375-b637-732b77a22eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:55.954979 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39187ec3-cb41-4375-b637-732b77a22eef None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:55.956620 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 75/140] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:15:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:55.962279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9c800-37fe-444f-ab29-9b5a0d84b128 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:56.085004 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9c800-37fe-444f-ab29-9b5a0d84b128 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:56.132551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4aead1-26ce-41b8-a83e-eab4e132e0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:56.133268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4aead1-26ce-41b8-a83e-eab4e132e0d0 None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:56.133554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4aead1-26ce-41b8-a83e-eab4e132e0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:56.133832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4aead1-26ce-41b8-a83e-eab4e132e0d0 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:56.134563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4aead1-26ce-41b8-a83e-eab4e132e0d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:56.136014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4aead1-26ce-41b8-a83e-eab4e132e0d0 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:56.160333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 66/141] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:15:55 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:15:57.072357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841cc7d-e9c1-4543-8aa1-d7784097935a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:57.072879 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841cc7d-e9c1-4543-8aa1-d7784097935a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:57.072997 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841cc7d-e9c1-4543-8aa1-d7784097935a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:57.075196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 76/142] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:57.080964 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49ab3c-dac3-4e0f-981e-fb17149d752c None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:57.081393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49ab3c-dac3-4e0f-981e-fb17149d752c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:57.081572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49ab3c-dac3-4e0f-981e-fb17149d752c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:57.113946 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-9e49ab3c-dac3-4e0f-981e-fb17149d752c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:57.115146 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9e49ab3c-dac3-4e0f-981e-fb17149d752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:57.134860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:57.222646 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 67/143] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:15:57.265640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841cc7d-e9c1-4543-8aa1-d7784097935a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:57.327819 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:57.386036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841cc7d-e9c1-4543-8aa1-d7784097935a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:57.427735 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae8303-1220-4744-95f4-00f8144bd06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:57.428590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae8303-1220-4744-95f4-00f8144bd06a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:57.428880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae8303-1220-4744-95f4-00f8144bd06a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:57.429199 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae8303-1220-4744-95f4-00f8144bd06a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:57.443008 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae8303-1220-4744-95f4-00f8144bd06a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-eeae8303-1220-4744-95f4-00f8144bd06a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:57.451328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:57.452165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:57.452893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:57.452893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:57.452893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:57.452893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:57.452893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:57.452893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:57.452893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:57.452893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:57.452893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:57.452893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:57.452893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:15:57.452893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:15:57.452893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 77/144] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:15:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:57.458541 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49ab3c-dac3-4e0f-981e-fb17149d752c None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:57.577320 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49ab3c-dac3-4e0f-981e-fb17149d752c None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:57.619103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e390964-7d40-44d5-861f-728c2a5c35d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:57.619722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e390964-7d40-44d5-861f-728c2a5c35d4 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:57.620008 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e390964-7d40-44d5-861f-728c2a5c35d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:57.620288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e390964-7d40-44d5-861f-728c2a5c35d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:57.621626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e390964-7d40-44d5-861f-728c2a5c35d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:57.621947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e390964-7d40-44d5-861f-728c2a5c35d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:57.623346 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e390964-7d40-44d5-861f-728c2a5c35d4 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:57.632489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 68/145] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:15:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:57.638574 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae8303-1220-4744-95f4-00f8144bd06a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:57.750729 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae8303-1220-4744-95f4-00f8144bd06a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:57.765592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:57.791981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f9c65-5382-419a-a71c-e2c5ab326cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:57.792872 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f9c65-5382-419a-a71c-e2c5ab326cde None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:57.793706 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f9c65-5382-419a-a71c-e2c5ab326cde None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:57.793987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f9c65-5382-419a-a71c-e2c5ab326cde None admin] PATH_INFO: `/v3/users/f04b3bc5aba545fb83b4de6eb19a53a5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:57.795416 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f9c65-5382-419a-a71c-e2c5ab326cde None admin] RBAC: Authorizing `identity:get_user(user_id=f04b3bc5aba545fb83b4de6eb19a53a5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:57.796974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f9c65-5382-419a-a71c-e2c5ab326cde None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:57.798962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 78/146] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:15:57 2022] GET /identity/v3/users/f04b3bc5aba545fb83b4de6eb19a53a5 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:57.804442 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e390964-7d40-44d5-861f-728c2a5c35d4 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:57.831314 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:57.946985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e390964-7d40-44d5-861f-728c2a5c35d4 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:57.987980 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909086e4-97e3-4c85-ae78-fa38fa4ddd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:57.988868 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909086e4-97e3-4c85-ae78-fa38fa4ddd9c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:57.989188 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909086e4-97e3-4c85-ae78-fa38fa4ddd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:57.989472 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909086e4-97e3-4c85-ae78-fa38fa4ddd9c None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:57.990705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909086e4-97e3-4c85-ae78-fa38fa4ddd9c None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:57.992157 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909086e4-97e3-4c85-ae78-fa38fa4ddd9c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:57.995195 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 69/147] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:15:57 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:58.000686 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f9c65-5382-419a-a71c-e2c5ab326cde None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:58.162801 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f9c65-5382-419a-a71c-e2c5ab326cde None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:58.207551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a3264-eb0c-46ef-a75d-435183b67568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:58.208371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a3264-eb0c-46ef-a75d-435183b67568 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:58.208655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a3264-eb0c-46ef-a75d-435183b67568 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:58.208954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a3264-eb0c-46ef-a75d-435183b67568 None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc/users/f04b3bc5aba545fb83b4de6eb19a53a5/roles/6a46f6859932445b83ab7334c94dbe9b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:58.210957 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a3264-eb0c-46ef-a75d-435183b67568 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4684cfef7d430aad38eb190fb3f5fc, user_id=f04b3bc5aba545fb83b4de6eb19a53a5, role_id=6a46f6859932445b83ab7334c94dbe9b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:58.212412 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a3264-eb0c-46ef-a75d-435183b67568 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:58.236380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 79/148] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:15:57 2022] PUT /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc/users/f04b3bc5aba545fb83b4de6eb19a53a5/roles/6a46f6859932445b83ab7334c94dbe9b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:15:58.285893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a68e38-9ade-454d-ae48-69d88b73ce77 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:58.286912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a68e38-9ade-454d-ae48-69d88b73ce77 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:58.287393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a68e38-9ade-454d-ae48-69d88b73ce77 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:58.290645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 70/149] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:15:58.295948 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a780c4-e9ac-4fa7-930e-e5c8d9700085 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:58.296241 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a780c4-e9ac-4fa7-930e-e5c8d9700085 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:58.296522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a780c4-e9ac-4fa7-930e-e5c8d9700085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:58.322606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d3a780c4-e9ac-4fa7-930e-e5c8d9700085 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:58.323811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d3a780c4-e9ac-4fa7-930e-e5c8d9700085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:58.366943 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:58.429828 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 80/150] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:58.478756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a68e38-9ade-454d-ae48-69d88b73ce77 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:58.609441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:58.635764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a68e38-9ade-454d-ae48-69d88b73ce77 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:58.688682 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987c4cd-85fb-4d0d-baa8-16ab78e41a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:58.689919 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987c4cd-85fb-4d0d-baa8-16ab78e41a06 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:58.690348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987c4cd-85fb-4d0d-baa8-16ab78e41a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:58.690914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987c4cd-85fb-4d0d-baa8-16ab78e41a06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:58.707973 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987c4cd-85fb-4d0d-baa8-16ab78e41a06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:58.712125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3bddd-2254-479c-b403-db54ec745214 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:58.712585 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3bddd-2254-479c-b403-db54ec745214 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:58.713062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3bddd-2254-479c-b403-db54ec745214 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-c987c4cd-85fb-4d0d-baa8-16ab78e41a06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:58.716955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:58.717801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:58.718563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:58.718563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:58.718563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:58.718563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:58.718563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:58.718563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:58.718563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:58.718563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:58.718563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:58.718563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:58.718563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:15:58.718563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:15:58.719140 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 71/152] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:15:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:58.719590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 81/152] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:58.725410 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987c4cd-85fb-4d0d-baa8-16ab78e41a06 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:58.728209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ad83b-367b-4fa7-a121-a93fd9fb8b3a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:58.728677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ad83b-367b-4fa7-a121-a93fd9fb8b3a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:58.729197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ad83b-367b-4fa7-a121-a93fd9fb8b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:58.762004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fc8ad83b-367b-4fa7-a121-a93fd9fb8b3a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:58.763426 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fc8ad83b-367b-4fa7-a121-a93fd9fb8b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:58.884606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 82/153] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:15:58.922040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc053ca1-46e5-4ff6-916a-3831b0d6c40f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:58.922551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc053ca1-46e5-4ff6-916a-3831b0d6c40f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:58.923433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc053ca1-46e5-4ff6-916a-3831b0d6c40f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:58.929123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 83/154] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:15:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:15:58.931601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872d3d2-833b-4aaa-9c53-0985aa6f85b0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:58.932103 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872d3d2-833b-4aaa-9c53-0985aa6f85b0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:58.932744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872d3d2-833b-4aaa-9c53-0985aa6f85b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:58.951528 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0872d3d2-833b-4aaa-9c53-0985aa6f85b0 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:15:58.953058 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0872d3d2-833b-4aaa-9c53-0985aa6f85b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:15:58.972307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987c4cd-85fb-4d0d-baa8-16ab78e41a06 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:59.082525 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44d8df-1eaf-4bec-aaa3-6044d6322b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:59.083206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44d8df-1eaf-4bec-aaa3-6044d6322b60 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:59.083490 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44d8df-1eaf-4bec-aaa3-6044d6322b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:59.083761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44d8df-1eaf-4bec-aaa3-6044d6322b60 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:59.084516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44d8df-1eaf-4bec-aaa3-6044d6322b60 None admin] RBAC: Adding query filter params (name=member) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:59.084824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44d8df-1eaf-4bec-aaa3-6044d6322b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:59.086231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44d8df-1eaf-4bec-aaa3-6044d6322b60 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:59.092971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 84/155] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:15:59.092971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872d3d2-833b-4aaa-9c53-0985aa6f85b0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:59.097372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:59.104752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 72/156] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:15:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:59.110271 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44d8df-1eaf-4bec-aaa3-6044d6322b60 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:59.141240 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:59.244457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872d3d2-833b-4aaa-9c53-0985aa6f85b0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:59.315691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af994a-f790-4864-84d8-75ee534004b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:59.316504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af994a-f790-4864-84d8-75ee534004b2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:59.316788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af994a-f790-4864-84d8-75ee534004b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:59.317094 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af994a-f790-4864-84d8-75ee534004b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:59.335356 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44d8df-1eaf-4bec-aaa3-6044d6322b60 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:59.341011 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af994a-f790-4864-84d8-75ee534004b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-b1af994a-f790-4864-84d8-75ee534004b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:59.348914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:59.350010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:59.350840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:59.350840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:59.350840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:59.350840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:59.350840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:59.350840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:59.350840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:59.350840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:59.350840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:59.350840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:59.350840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:15:59.350840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:15:59.350840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 85/157] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:15:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:59.352287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af994a-f790-4864-84d8-75ee534004b2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:59.442643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:59.442914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5b453-4be0-4f2f-a811-a249c954d06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:59.443804 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5b453-4be0-4f2f-a811-a249c954d06f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:59.444088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5b453-4be0-4f2f-a811-a249c954d06f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:59.444369 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5b453-4be0-4f2f-a811-a249c954d06f None admin] PATH_INFO: `/v3/users/5ee173f5cb884d6f8571ad755a0dd89a` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:59.450182 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5b453-4be0-4f2f-a811-a249c954d06f None admin] RBAC: Authorizing `identity:get_user(user_id=5ee173f5cb884d6f8571ad755a0dd89a)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:59.451653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5b453-4be0-4f2f-a811-a249c954d06f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:59.455847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af994a-f790-4864-84d8-75ee534004b2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:59.457017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 73/158] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:15:59 2022] GET /identity/v3/users/5ee173f5cb884d6f8571ad755a0dd89a => generated 275 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:15:59.457828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5b453-4be0-4f2f-a811-a249c954d06f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:59.496955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702af57-e97a-4387-9ef6-0658f9a8e809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:59.497792 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702af57-e97a-4387-9ef6-0658f9a8e809 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:59.498078 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702af57-e97a-4387-9ef6-0658f9a8e809 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:59.498360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702af57-e97a-4387-9ef6-0658f9a8e809 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:59.509351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702af57-e97a-4387-9ef6-0658f9a8e809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-2702af57-e97a-4387-9ef6-0658f9a8e809 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:15:59.522962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:15:59.523834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:15:59.524700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:15:59.524700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:15:59.524700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:15:59.524700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:15:59.524700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:15:59.524700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:15:59.524700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:15:59.524700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:15:59.524700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:15:59.524700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:15:59.524700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:15:59.524700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:15:59.524700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 86/159] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:15:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:15:59.525938 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702af57-e97a-4387-9ef6-0658f9a8e809 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:59.611219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:59.659726 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5b453-4be0-4f2f-a811-a249c954d06f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:59.720657 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ab307-d7de-490d-8df5-585b1bd33736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:59.721557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ab307-d7de-490d-8df5-585b1bd33736 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:59.721851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ab307-d7de-490d-8df5-585b1bd33736 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:59.722131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ab307-d7de-490d-8df5-585b1bd33736 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:59.723049 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ab307-d7de-490d-8df5-585b1bd33736 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:59.723369 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ab307-d7de-490d-8df5-585b1bd33736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:59.725200 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ab307-d7de-490d-8df5-585b1bd33736 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:59.734953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 74/160] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:15:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:59.735795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ab307-d7de-490d-8df5-585b1bd33736 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:59.737312 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702af57-e97a-4387-9ef6-0658f9a8e809 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:59.818033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71953def-5ba8-4aea-abe1-434b4192fc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:59.819075 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71953def-5ba8-4aea-abe1-434b4192fc10 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:59.819616 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71953def-5ba8-4aea-abe1-434b4192fc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:59.820161 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71953def-5ba8-4aea-abe1-434b4192fc10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:59.862874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:59.904584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ab307-d7de-490d-8df5-585b1bd33736 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:15:59.937501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:59.942569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aba84-d2e8-465a-b4a1-04e4fc7d3c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:15:59.943247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aba84-d2e8-465a-b4a1-04e4fc7d3c37 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:15:59.943531 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aba84-d2e8-465a-b4a1-04e4fc7d3c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:15:59.943808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aba84-d2e8-465a-b4a1-04e4fc7d3c37 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:15:59.944709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86aba84-d2e8-465a-b4a1-04e4fc7d3c37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:15:59.945059 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86aba84-d2e8-465a-b4a1-04e4fc7d3c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:59.946440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86aba84-d2e8-465a-b4a1-04e4fc7d3c37 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:15:59.955751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 75/161] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:15:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:15:59.956674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aba84-d2e8-465a-b4a1-04e4fc7d3c37 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:15:59.967912 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71953def-5ba8-4aea-abe1-434b4192fc10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:15:59.969549 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71953def-5ba8-4aea-abe1-434b4192fc10 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:00.065226 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aba84-d2e8-465a-b4a1-04e4fc7d3c37 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:00.101842 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e29ef-69d0-4ffe-b153-55014a50ec72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:00.103108 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e29ef-69d0-4ffe-b153-55014a50ec72 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:00.103606 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e29ef-69d0-4ffe-b153-55014a50ec72 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:00.104075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e29ef-69d0-4ffe-b153-55014a50ec72 None admin] PATH_INFO: `/v3/users/f173d7158e2a4553aa3707927ef2704b` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:00.106014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e29ef-69d0-4ffe-b153-55014a50ec72 None admin] RBAC: Authorizing `identity:get_user(user_id=f173d7158e2a4553aa3707927ef2704b)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:00.107753 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e29ef-69d0-4ffe-b153-55014a50ec72 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:00.109968 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 76/162] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:15:59 2022] GET /identity/v3/users/f173d7158e2a4553aa3707927ef2704b => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:00.111391 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c577c-919c-4b6e-8503-4045810c15d7 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:00.111870 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c577c-919c-4b6e-8503-4045810c15d7 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:00.112333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c577c-919c-4b6e-8503-4045810c15d7 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:00.113955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 77/163] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:00.114823 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c577c-919c-4b6e-8503-4045810c15d7 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:00.151716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 87/164] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:00.153425 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569c818-42a2-4ab4-8266-6a9f6266924c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:00.153722 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569c818-42a2-4ab4-8266-6a9f6266924c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:00.154008 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569c818-42a2-4ab4-8266-6a9f6266924c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:00.179231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:00.181911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6569c818-42a2-4ab4-8266-6a9f6266924c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:00.183184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6569c818-42a2-4ab4-8266-6a9f6266924c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:00.222920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c577c-919c-4b6e-8503-4045810c15d7 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:00.257267 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:00.261264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f31a5-29db-4c35-b51e-665c4db238fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:00.263010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f31a5-29db-4c35-b51e-665c4db238fb None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:00.263512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f31a5-29db-4c35-b51e-665c4db238fb None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:00.263986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f31a5-29db-4c35-b51e-665c4db238fb None admin] PATH_INFO: `/v3/users/5ee173f5cb884d6f8571ad755a0dd89a` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:00.265607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f31a5-29db-4c35-b51e-665c4db238fb None admin] RBAC: Authorizing `identity:get_user(user_id=5ee173f5cb884d6f8571ad755a0dd89a)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:00.267322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f31a5-29db-4c35-b51e-665c4db238fb None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:00.269651 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 78/165] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:00 2022] GET /identity/v3/users/5ee173f5cb884d6f8571ad755a0dd89a => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:00.270649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f31a5-29db-4c35-b51e-665c4db238fb None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:00.302523 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 88/166] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:00.303377 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569c818-42a2-4ab4-8266-6a9f6266924c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:00.379034 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f31a5-29db-4c35-b51e-665c4db238fb None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:00.406302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:00.414662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1120b-0c2b-4989-892e-6eab7b192b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:00.415636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1120b-0c2b-4989-892e-6eab7b192b85 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:00.416116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1120b-0c2b-4989-892e-6eab7b192b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:00.416719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1120b-0c2b-4989-892e-6eab7b192b85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:00.485751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1120b-0c2b-4989-892e-6eab7b192b85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:00.487558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d1120b-0c2b-4989-892e-6eab7b192b85 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:00.519269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569c818-42a2-4ab4-8266-6a9f6266924c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:00.589495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 79/167] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:00.590736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1120b-0c2b-4989-892e-6eab7b192b85 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:00.624404 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:00.626155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41a8bd-c4ac-45d2-a3ce-21a04bfa72c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:00.626522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41a8bd-c4ac-45d2-a3ce-21a04bfa72c7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:00.626810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41a8bd-c4ac-45d2-a3ce-21a04bfa72c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:00.627097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41a8bd-c4ac-45d2-a3ce-21a04bfa72c7 None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:00.633913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41a8bd-c4ac-45d2-a3ce-21a04bfa72c7 None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:00.635451 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41a8bd-c4ac-45d2-a3ce-21a04bfa72c7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:00.637600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 89/168] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:00 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:00.638372 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41a8bd-c4ac-45d2-a3ce-21a04bfa72c7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:00.692993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1120b-0c2b-4989-892e-6eab7b192b85 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:00.727371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d08834-6ce8-4c95-8fff-dfc29a515621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:00.728372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d08834-6ce8-4c95-8fff-dfc29a515621 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:00.728851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d08834-6ce8-4c95-8fff-dfc29a515621 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:00.729364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d08834-6ce8-4c95-8fff-dfc29a515621 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:00.762356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:00.846716 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d08834-6ce8-4c95-8fff-dfc29a515621 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:00.849380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d08834-6ce8-4c95-8fff-dfc29a515621 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:00.862297 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41a8bd-c4ac-45d2-a3ce-21a04bfa72c7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:00.902437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:00.927833 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187ff56-8b7c-43e1-8f15-26591863e357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:00.929141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187ff56-8b7c-43e1-8f15-26591863e357 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:00.929618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187ff56-8b7c-43e1-8f15-26591863e357 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:00.930093 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187ff56-8b7c-43e1-8f15-26591863e357 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:00.951728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187ff56-8b7c-43e1-8f15-26591863e357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-5187ff56-8b7c-43e1-8f15-26591863e357 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:00.968355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:00.969251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:00.970022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:00.970022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:00.970022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:00.970022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:00.970022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:00.970022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:00.970022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:00.970022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:00.970022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:00.970022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:00.970022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:00.970022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:00.974888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 90/169] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:00.975890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187ff56-8b7c-43e1-8f15-26591863e357 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:01.051538 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 80/170] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:01.056475 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d08834-6ce8-4c95-8fff-dfc29a515621 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:01.103267 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187ff56-8b7c-43e1-8f15-26591863e357 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:01.111894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:01.150487 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f641429-34f2-43ea-9b7a-f194ad42a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:01.151367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f641429-34f2-43ea-9b7a-f194ad42a629 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:01.151655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f641429-34f2-43ea-9b7a-f194ad42a629 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:01.151939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f641429-34f2-43ea-9b7a-f194ad42a629 None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:01.153544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f641429-34f2-43ea-9b7a-f194ad42a629 None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:01.155068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f641429-34f2-43ea-9b7a-f194ad42a629 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:01.156780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 91/171] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:00 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:01.158115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165dedc-66d9-482c-86ee-9abea8fe39d2 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:01.158414 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165dedc-66d9-482c-86ee-9abea8fe39d2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:01.158682 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165dedc-66d9-482c-86ee-9abea8fe39d2 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:01.160474 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 92/172] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:01.161234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165dedc-66d9-482c-86ee-9abea8fe39d2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:01.204737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d08834-6ce8-4c95-8fff-dfc29a515621 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:01.236554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:01.248209 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141f61a-f36c-48fd-beb9-1e2e3e4f8e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:01.249349 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141f61a-f36c-48fd-beb9-1e2e3e4f8e19 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:01.249641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141f61a-f36c-48fd-beb9-1e2e3e4f8e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:01.249935 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141f61a-f36c-48fd-beb9-1e2e3e4f8e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:01.251083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141f61a-f36c-48fd-beb9-1e2e3e4f8e19 None admin] RBAC: Adding query filter params (role.id=3b7272bb6de3425fa18a474080a9c1a2, scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc, user.id=5ee173f5cb884d6f8571ad755a0dd89a) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:01.251456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141f61a-f36c-48fd-beb9-1e2e3e4f8e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:01.253100 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141f61a-f36c-48fd-beb9-1e2e3e4f8e19 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:01.263442 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 81/173] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:01 2022] GET /identity/v3/role_assignments?user.id=5ee173f5cb884d6f8571ad755a0dd89a&scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc&role.id=3b7272bb6de3425fa18a474080a9c1a2 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:01.268835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141f61a-f36c-48fd-beb9-1e2e3e4f8e19 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:01.322238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165dedc-66d9-482c-86ee-9abea8fe39d2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:01.391834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59183ab6-e617-445a-9046-ca66e0e09375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:01.392767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59183ab6-e617-445a-9046-ca66e0e09375 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:01.393445 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59183ab6-e617-445a-9046-ca66e0e09375 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:01.394516 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59183ab6-e617-445a-9046-ca66e0e09375 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:01.395695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59183ab6-e617-445a-9046-ca66e0e09375 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:01.398041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59183ab6-e617-445a-9046-ca66e0e09375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:01.399755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59183ab6-e617-445a-9046-ca66e0e09375 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:01.414717 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 93/174] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:01.419946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dbd04-d315-4fd9-9ef7-54a8b9992149 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:01.422179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dbd04-d315-4fd9-9ef7-54a8b9992149 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:01.422643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dbd04-d315-4fd9-9ef7-54a8b9992149 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:01.425973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 94/175] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:01.427417 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dbd04-d315-4fd9-9ef7-54a8b9992149 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:01.471292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141f61a-f36c-48fd-beb9-1e2e3e4f8e19 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:01.494151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:01.508669 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c149073-a137-414c-a0be-27edb9ca89dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:01.510014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c149073-a137-414c-a0be-27edb9ca89dc None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:01.510514 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c149073-a137-414c-a0be-27edb9ca89dc None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:01.510981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c149073-a137-414c-a0be-27edb9ca89dc None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:01.512482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c149073-a137-414c-a0be-27edb9ca89dc None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:01.514178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c149073-a137-414c-a0be-27edb9ca89dc None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:01.516105 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 82/176] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:01 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:01.517492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b1aa-52c4-42d3-ae7e-a23e2ddad6a2 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:01.517989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b1aa-52c4-42d3-ae7e-a23e2ddad6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:01.518457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b1aa-52c4-42d3-ae7e-a23e2ddad6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:01.541836 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-ffc5b1aa-52c4-42d3-ae7e-a23e2ddad6a2 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:01.543422 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ffc5b1aa-52c4-42d3-ae7e-a23e2ddad6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:01.571127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dbd04-d315-4fd9-9ef7-54a8b9992149 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:01.604127 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:01.615563 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c69e06-fffc-45d2-8046-571fd0292635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:01.616325 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c69e06-fffc-45d2-8046-571fd0292635 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:01.616606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c69e06-fffc-45d2-8046-571fd0292635 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:01.616901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c69e06-fffc-45d2-8046-571fd0292635 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:01.618464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c69e06-fffc-45d2-8046-571fd0292635 None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc, user.id=f173d7158e2a4553aa3707927ef2704b) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:01.618464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c69e06-fffc-45d2-8046-571fd0292635 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:01.619493 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c69e06-fffc-45d2-8046-571fd0292635 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:01.620394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 83/177] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:01.626106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b1aa-52c4-42d3-ae7e-a23e2ddad6a2 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:01.629173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 95/178] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:01 2022] GET /identity/v3/role_assignments?user.id=f173d7158e2a4553aa3707927ef2704b&scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:01.631002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa29ff-27da-4d89-892f-18ef39fe5c33 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:01.631002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa29ff-27da-4d89-892f-18ef39fe5c33 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:01.631197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa29ff-27da-4d89-892f-18ef39fe5c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:01.650331 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5efa29ff-27da-4d89-892f-18ef39fe5c33 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:01.651684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5efa29ff-27da-4d89-892f-18ef39fe5c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:01.735244 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 96/179] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:01.736062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa29ff-27da-4d89-892f-18ef39fe5c33 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:01.769731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:01.773493 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b1aa-52c4-42d3-ae7e-a23e2ddad6a2 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:01.815533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a19ca-1068-491b-be7c-313fc5a35157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:01.816450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a19ca-1068-491b-be7c-313fc5a35157 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:01.816858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a19ca-1068-491b-be7c-313fc5a35157 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:01.817195 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a19ca-1068-491b-be7c-313fc5a35157 None admin] PATH_INFO: `/v3/users/5ee173f5cb884d6f8571ad755a0dd89a` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:01.818919 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a19ca-1068-491b-be7c-313fc5a35157 None admin] RBAC: Authorizing `identity:get_user(user_id=5ee173f5cb884d6f8571ad755a0dd89a)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:01.820380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a19ca-1068-491b-be7c-313fc5a35157 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:01.822207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 84/180] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:01 2022] GET /identity/v3/users/5ee173f5cb884d6f8571ad755a0dd89a => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:01.823375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea298f-8205-4fa5-9f7a-c1b3c23b54f0 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:01.823662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea298f-8205-4fa5-9f7a-c1b3c23b54f0 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:01.823937 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea298f-8205-4fa5-9f7a-c1b3c23b54f0 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:01.825381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 85/181] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:01.829380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea298f-8205-4fa5-9f7a-c1b3c23b54f0 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:01.859438 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa29ff-27da-4d89-892f-18ef39fe5c33 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:01.891928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:01.894003 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb1b87-3d28-4b98-94f9-ec466bb5446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:01.894619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb1b87-3d28-4b98-94f9-ec466bb5446e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:01.894903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb1b87-3d28-4b98-94f9-ec466bb5446e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:01.895183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb1b87-3d28-4b98-94f9-ec466bb5446e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:01.896013 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb1b87-3d28-4b98-94f9-ec466bb5446e None admin] RBAC: Adding query filter params (role.id=ffad03b6b6d1473dba5d5b7296943f18, scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc, user.id=5ee173f5cb884d6f8571ad755a0dd89a) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:01.896329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb1b87-3d28-4b98-94f9-ec466bb5446e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:01.897802 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb1b87-3d28-4b98-94f9-ec466bb5446e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:01.903946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 97/182] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:01 2022] GET /identity/v3/role_assignments?user.id=5ee173f5cb884d6f8571ad755a0dd89a&scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc&role.id=ffad03b6b6d1473dba5d5b7296943f18 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:01.903946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f30c3-6f2d-4d2e-8b58-24b3640db105 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:01.903946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f30c3-6f2d-4d2e-8b58-24b3640db105 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:01.903946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f30c3-6f2d-4d2e-8b58-24b3640db105 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:01.903946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 98/183] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:01.903946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f30c3-6f2d-4d2e-8b58-24b3640db105 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:01.944319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea298f-8205-4fa5-9f7a-c1b3c23b54f0 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:01.984520 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fcdd6-98c0-40a9-8650-67a8c6094998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:01.985540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fcdd6-98c0-40a9-8650-67a8c6094998 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:01.985764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fcdd6-98c0-40a9-8650-67a8c6094998 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:01.986050 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fcdd6-98c0-40a9-8650-67a8c6094998 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:01.998302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fcdd6-98c0-40a9-8650-67a8c6094998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-c44fcdd6-98c0-40a9-8650-67a8c6094998 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:02.006516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:02.007478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:02.008265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:02.008265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:02.008265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:02.008265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:02.008265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:02.008265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:02.008265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:02.008265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:02.008265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:02.008265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:02.008265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:16:02.008265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:02.008265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 86/184] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:16:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:02.008915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fcdd6-98c0-40a9-8650-67a8c6094998 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:02.029356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:02.038931 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f30c3-6f2d-4d2e-8b58-24b3640db105 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:02.082596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e749fe-d55d-4ad2-bd99-ad3a554b6aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:02.084048 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e749fe-d55d-4ad2-bd99-ad3a554b6aef None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:02.084048 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e749fe-d55d-4ad2-bd99-ad3a554b6aef None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:02.084048 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e749fe-d55d-4ad2-bd99-ad3a554b6aef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:02.098519 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e749fe-d55d-4ad2-bd99-ad3a554b6aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-86e749fe-d55d-4ad2-bd99-ad3a554b6aef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:02.107176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:02.108065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:02.109424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:02.109424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:02.109424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:02.109424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:02.109424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:02.109424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:02.109424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:02.109424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:02.109424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:02.109424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:02.109424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:02.109424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:02.109424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 99/185] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:16:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:02.110663 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefb813-a76a-47aa-b11b-3180bba932e3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:02.110861 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefb813-a76a-47aa-b11b-3180bba932e3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:02.113490 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefb813-a76a-47aa-b11b-3180bba932e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:02.128254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2cefb813-a76a-47aa-b11b-3180bba932e3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:02.129461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2cefb813-a76a-47aa-b11b-3180bba932e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:02.135096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fcdd6-98c0-40a9-8650-67a8c6094998 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:02.151697 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:02.170175 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0df7b8-a776-452f-8ff5-ae006e2da32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:02.170832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0df7b8-a776-452f-8ff5-ae006e2da32f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:02.171125 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0df7b8-a776-452f-8ff5-ae006e2da32f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:02.171404 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0df7b8-a776-452f-8ff5-ae006e2da32f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:02.196633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 100/186] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:02.202427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082333c-5e81-4e06-b5b9-b651fdda98dd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:02.202427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082333c-5e81-4e06-b5b9-b651fdda98dd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:02.202427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082333c-5e81-4e06-b5b9-b651fdda98dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:02.214914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1082333c-5e81-4e06-b5b9-b651fdda98dd None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:02.216077 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1082333c-5e81-4e06-b5b9-b651fdda98dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:02.248303 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0df7b8-a776-452f-8ff5-ae006e2da32f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:02.249718 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0df7b8-a776-452f-8ff5-ae006e2da32f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:02.280533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 101/187] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:02.281380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082333c-5e81-4e06-b5b9-b651fdda98dd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:02.296713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:02.349030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 87/188] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:02.349908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0df7b8-a776-452f-8ff5-ae006e2da32f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:02.368196 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:02.384170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082333c-5e81-4e06-b5b9-b651fdda98dd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:02.418677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729d245-67e0-43a5-818b-1352600018ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:02.419350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729d245-67e0-43a5-818b-1352600018ca None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:02.419632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729d245-67e0-43a5-818b-1352600018ca None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:02.419911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729d245-67e0-43a5-818b-1352600018ca None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:02.420657 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729d245-67e0-43a5-818b-1352600018ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:02.420989 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729d245-67e0-43a5-818b-1352600018ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:02.422404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729d245-67e0-43a5-818b-1352600018ca None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:02.430231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 102/189] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:02.431002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729d245-67e0-43a5-818b-1352600018ca None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:02.446970 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0df7b8-a776-452f-8ff5-ae006e2da32f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:02.481024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07254433-1a53-4f3d-8b4b-1a4e58052be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:02.481965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07254433-1a53-4f3d-8b4b-1a4e58052be7 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:02.482252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07254433-1a53-4f3d-8b4b-1a4e58052be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:02.482527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07254433-1a53-4f3d-8b4b-1a4e58052be7 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:02.483282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07254433-1a53-4f3d-8b4b-1a4e58052be7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:02.483589 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07254433-1a53-4f3d-8b4b-1a4e58052be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:02.484989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07254433-1a53-4f3d-8b4b-1a4e58052be7 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:02.492625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 88/190] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:02.493440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07254433-1a53-4f3d-8b4b-1a4e58052be7 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:02.509360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:02.533023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729d245-67e0-43a5-818b-1352600018ca None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:02.565741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7744f6d-002b-481e-a6d9-12019eaa077f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:02.566527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7744f6d-002b-481e-a6d9-12019eaa077f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:02.566807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7744f6d-002b-481e-a6d9-12019eaa077f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:02.567081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7744f6d-002b-481e-a6d9-12019eaa077f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:02.568232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7744f6d-002b-481e-a6d9-12019eaa077f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:02.569696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7744f6d-002b-481e-a6d9-12019eaa077f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:02.571297 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 103/191] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:02.572037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7744f6d-002b-481e-a6d9-12019eaa077f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:02.573351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:02.592743 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07254433-1a53-4f3d-8b4b-1a4e58052be7 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:02.625969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def61f22-c523-43e1-adb7-e386233f5f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:02.626757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def61f22-c523-43e1-adb7-e386233f5f13 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:02.627050 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def61f22-c523-43e1-adb7-e386233f5f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:02.627333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def61f22-c523-43e1-adb7-e386233f5f13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:02.637197 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def61f22-c523-43e1-adb7-e386233f5f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-def61f22-c523-43e1-adb7-e386233f5f13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:02.644853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:02.645746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:02.646529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:02.646529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:02.646529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:02.646529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:02.646529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:02.646529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:02.646529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:02.646529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:02.646529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:02.646529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:02.646529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:16:02.646529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:02.646529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 89/192] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:02.648167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def61f22-c523-43e1-adb7-e386233f5f13 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:02.668388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7744f6d-002b-481e-a6d9-12019eaa077f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:02.701606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da4522-8999-4183-ad6c-496d04495875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:02.702469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da4522-8999-4183-ad6c-496d04495875 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:02.702751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da4522-8999-4183-ad6c-496d04495875 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:02.703027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da4522-8999-4183-ad6c-496d04495875 None admin] PATH_INFO: `/v3/projects/36b901ca38a847ea89730753aa907842` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:02.704200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da4522-8999-4183-ad6c-496d04495875 None admin] RBAC: Authorizing `identity:get_project(project_id=36b901ca38a847ea89730753aa907842)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:02.705661 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da4522-8999-4183-ad6c-496d04495875 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:02.707350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 104/193] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:02 2022] GET /identity/v3/projects/36b901ca38a847ea89730753aa907842 => generated 312 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:02.708174 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da4522-8999-4183-ad6c-496d04495875 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:02.722704 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:02.750817 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def61f22-c523-43e1-adb7-e386233f5f13 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:02.783329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a63b3-588d-4244-a5b3-bab450cc7f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:02.784139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a63b3-588d-4244-a5b3-bab450cc7f25 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:02.784420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a63b3-588d-4244-a5b3-bab450cc7f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:02.784689 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a63b3-588d-4244-a5b3-bab450cc7f25 None admin] PATH_INFO: `/v3/users/a8adddcd4d1f4be3a0acf55519146a71` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:02.794570 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:02.798190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a63b3-588d-4244-a5b3-bab450cc7f25 None admin] RBAC: Authorizing `identity:get_user(user_id=a8adddcd4d1f4be3a0acf55519146a71)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:02.799660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a63b3-588d-4244-a5b3-bab450cc7f25 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:02.801340 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 90/194] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:02 2022] GET /identity/v3/users/a8adddcd4d1f4be3a0acf55519146a71 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:02.805752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a63b3-588d-4244-a5b3-bab450cc7f25 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:02.807302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da4522-8999-4183-ad6c-496d04495875 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:02.840917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa7a85-214d-40de-af7b-3b3c4ed564b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:02.841803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa7a85-214d-40de-af7b-3b3c4ed564b2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:02.842083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa7a85-214d-40de-af7b-3b3c4ed564b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:02.842355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa7a85-214d-40de-af7b-3b3c4ed564b2 None admin] PATH_INFO: `/v3/users/a8adddcd4d1f4be3a0acf55519146a71` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:02.843587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa7a85-214d-40de-af7b-3b3c4ed564b2 None admin] RBAC: Authorizing `identity:get_user(user_id=a8adddcd4d1f4be3a0acf55519146a71)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:02.845425 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa7a85-214d-40de-af7b-3b3c4ed564b2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:02.847413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 105/195] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:02 2022] GET /identity/v3/users/a8adddcd4d1f4be3a0acf55519146a71 => generated 283 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:02.848521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa7a85-214d-40de-af7b-3b3c4ed564b2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:02.902772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a63b3-588d-4244-a5b3-bab450cc7f25 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:02.927625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:02.936363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dfaa3-df2e-4fed-890a-fb3ebc690f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:02.937057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dfaa3-df2e-4fed-890a-fb3ebc690f62 None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:02.937341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dfaa3-df2e-4fed-890a-fb3ebc690f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:02.937615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dfaa3-df2e-4fed-890a-fb3ebc690f62 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:02.938320 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dfaa3-df2e-4fed-890a-fb3ebc690f62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:02.939736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931dfaa3-df2e-4fed-890a-fb3ebc690f62 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:02.946385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa7a85-214d-40de-af7b-3b3c4ed564b2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:02.967941 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 91/196] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:16:02 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:16:02.969030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dfaa3-df2e-4fed-890a-fb3ebc690f62 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:02.982418 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca5ae2-c81b-40cf-b24d-ba36586d0068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:02.983108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca5ae2-c81b-40cf-b24d-ba36586d0068 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:02.983393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca5ae2-c81b-40cf-b24d-ba36586d0068 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:02.983670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca5ae2-c81b-40cf-b24d-ba36586d0068 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:02.984441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca5ae2-c81b-40cf-b24d-ba36586d0068 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:02.984749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca5ae2-c81b-40cf-b24d-ba36586d0068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:02.986226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca5ae2-c81b-40cf-b24d-ba36586d0068 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:02.997170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 106/197] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:03.002838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca5ae2-c81b-40cf-b24d-ba36586d0068 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:03.032962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:03.089311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dfaa3-df2e-4fed-890a-fb3ebc690f62 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:03.127255 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca5ae2-c81b-40cf-b24d-ba36586d0068 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:03.129899 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62866c9e-9c99-43db-988c-532a0073135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:03.130571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62866c9e-9c99-43db-988c-532a0073135b None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:03.130859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62866c9e-9c99-43db-988c-532a0073135b None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:03.131141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62866c9e-9c99-43db-988c-532a0073135b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:03.131996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62866c9e-9c99-43db-988c-532a0073135b None admin] RBAC: Adding query filter params (role.id=3b7272bb6de3425fa18a474080a9c1a2, scope.project.id=36b901ca38a847ea89730753aa907842, user.id=5ee173f5cb884d6f8571ad755a0dd89a) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:03.132315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62866c9e-9c99-43db-988c-532a0073135b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:03.133805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62866c9e-9c99-43db-988c-532a0073135b None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:03.141325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 92/198] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:02 2022] GET /identity/v3/role_assignments?user.id=5ee173f5cb884d6f8571ad755a0dd89a&scope.project.id=36b901ca38a847ea89730753aa907842&role.id=3b7272bb6de3425fa18a474080a9c1a2 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:03.142169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62866c9e-9c99-43db-988c-532a0073135b None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:03.176496 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a69c5-0645-4316-898e-cf8d4ac959c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:03.177246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a69c5-0645-4316-898e-cf8d4ac959c7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:03.177800 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a69c5-0645-4316-898e-cf8d4ac959c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:03.178083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a69c5-0645-4316-898e-cf8d4ac959c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:03.196120 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:03.287739 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62866c9e-9c99-43db-988c-532a0073135b None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:03.300061 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a69c5-0645-4316-898e-cf8d4ac959c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:03.302394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a69c5-0645-4316-898e-cf8d4ac959c7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:03.312826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:03.346862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9951cbc-9315-4867-941a-8cfa2a422a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:03.347705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9951cbc-9315-4867-941a-8cfa2a422a3d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:03.348002 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9951cbc-9315-4867-941a-8cfa2a422a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:03.348282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9951cbc-9315-4867-941a-8cfa2a422a3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:03.428214 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9951cbc-9315-4867-941a-8cfa2a422a3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:03.432881 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 107/199] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:03.432881 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a69c5-0645-4316-898e-cf8d4ac959c7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:03.435429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9951cbc-9315-4867-941a-8cfa2a422a3d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:03.479361 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:03.547505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a69c5-0645-4316-898e-cf8d4ac959c7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:03.570995 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 93/200] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:03.571940 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9951cbc-9315-4867-941a-8cfa2a422a3d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:03.591556 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:03.594316 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef688a-4939-4476-a5c4-bad3b0f00dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:03.595904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef688a-4939-4476-a5c4-bad3b0f00dab None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:03.596632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef688a-4939-4476-a5c4-bad3b0f00dab None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:03.597170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef688a-4939-4476-a5c4-bad3b0f00dab None admin] PATH_INFO: `/v3/users/f04b3bc5aba545fb83b4de6eb19a53a5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:03.599137 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef688a-4939-4476-a5c4-bad3b0f00dab None admin] RBAC: Authorizing `identity:get_user(user_id=f04b3bc5aba545fb83b4de6eb19a53a5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:03.601210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef688a-4939-4476-a5c4-bad3b0f00dab None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:03.603746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 108/201] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:03 2022] GET /identity/v3/users/f04b3bc5aba545fb83b4de6eb19a53a5 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:03.605460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef688a-4939-4476-a5c4-bad3b0f00dab None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:03.676561 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9951cbc-9315-4867-941a-8cfa2a422a3d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:03.713222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258e920-f192-417c-aa97-e2f3d1d61d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:03.714215 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258e920-f192-417c-aa97-e2f3d1d61d28 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:03.714574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258e920-f192-417c-aa97-e2f3d1d61d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:03.714957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258e920-f192-417c-aa97-e2f3d1d61d28 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:03.716383 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258e920-f192-417c-aa97-e2f3d1d61d28 None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:03.718095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258e920-f192-417c-aa97-e2f3d1d61d28 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:03.719952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 94/202] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:03 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:03.724904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258e920-f192-417c-aa97-e2f3d1d61d28 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:03.735703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef688a-4939-4476-a5c4-bad3b0f00dab None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:03.747459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:03.775123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cd71a-58af-4f33-aa8f-30d407b314d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:03.776508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd71a-58af-4f33-aa8f-30d407b314d1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:03.776941 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd71a-58af-4f33-aa8f-30d407b314d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:03.777401 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd71a-58af-4f33-aa8f-30d407b314d1 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:03.779410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cd71a-58af-4f33-aa8f-30d407b314d1 None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:03.781721 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cd71a-58af-4f33-aa8f-30d407b314d1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:03.784406 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 109/203] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:03 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:03.789650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cd71a-58af-4f33-aa8f-30d407b314d1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:03.841343 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:03.859941 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258e920-f192-417c-aa97-e2f3d1d61d28 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:03.895450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d82b60-fe10-410a-b446-703256a13667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:03.896160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d82b60-fe10-410a-b446-703256a13667 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:03.896444 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d82b60-fe10-410a-b446-703256a13667 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:03.896716 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d82b60-fe10-410a-b446-703256a13667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:03.919872 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cd71a-58af-4f33-aa8f-30d407b314d1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:03.955251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c4efd-a01c-46da-8bf4-206ae0bc1e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:03.955913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4efd-a01c-46da-8bf4-206ae0bc1e3a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:03.956195 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4efd-a01c-46da-8bf4-206ae0bc1e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:03.956470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4efd-a01c-46da-8bf4-206ae0bc1e3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:03.957335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c4efd-a01c-46da-8bf4-206ae0bc1e3a None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=bf617240dd564a84b2b9fde284824719, user.id=a8adddcd4d1f4be3a0acf55519146a71) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:03.957644 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c4efd-a01c-46da-8bf4-206ae0bc1e3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:03.959378 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c4efd-a01c-46da-8bf4-206ae0bc1e3a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:03.965569 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 110/204] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:03 2022] GET /identity/v3/role_assignments?user.id=a8adddcd4d1f4be3a0acf55519146a71&scope.project.id=bf617240dd564a84b2b9fde284824719&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:03.966380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c4efd-a01c-46da-8bf4-206ae0bc1e3a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:03.997767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d82b60-fe10-410a-b446-703256a13667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:03.999258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d82b60-fe10-410a-b446-703256a13667 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:04.046816 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:04.169986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:04.171008 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c4efd-a01c-46da-8bf4-206ae0bc1e3a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:04.192305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 95/205] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:04.198301 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d82b60-fe10-410a-b446-703256a13667 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:04.241621 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0275c-d248-4b9a-a5fe-442a5b255254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:04.242530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0275c-d248-4b9a-a5fe-442a5b255254 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:04.242954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0275c-d248-4b9a-a5fe-442a5b255254 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:04.243369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0275c-d248-4b9a-a5fe-442a5b255254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:04.244370 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0275c-d248-4b9a-a5fe-442a5b255254 None admin] RBAC: Adding query filter params (role.id=ffad03b6b6d1473dba5d5b7296943f18, scope.project.id=bf617240dd564a84b2b9fde284824719, user.id=a8adddcd4d1f4be3a0acf55519146a71) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:04.244824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0275c-d248-4b9a-a5fe-442a5b255254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:04.246456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0275c-d248-4b9a-a5fe-442a5b255254 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:04.266905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 111/206] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:03 2022] GET /identity/v3/role_assignments?user.id=a8adddcd4d1f4be3a0acf55519146a71&scope.project.id=bf617240dd564a84b2b9fde284824719&role.id=ffad03b6b6d1473dba5d5b7296943f18 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:04.312471 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d82b60-fe10-410a-b446-703256a13667 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:04.351148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917b615-b43e-4c36-a835-4b1ab0b1880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:04.352027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b615-b43e-4c36-a835-4b1ab0b1880c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:04.352307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b615-b43e-4c36-a835-4b1ab0b1880c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:04.352575 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b615-b43e-4c36-a835-4b1ab0b1880c None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:04.353832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917b615-b43e-4c36-a835-4b1ab0b1880c None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:04.356247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917b615-b43e-4c36-a835-4b1ab0b1880c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:04.363366 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 96/207] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:04 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:04.366819 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0275c-d248-4b9a-a5fe-442a5b255254 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:04.517237 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0275c-d248-4b9a-a5fe-442a5b255254 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:04.532256 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:04.567056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036f5ee-6cc5-4470-80dd-363abefcb6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:04.568089 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036f5ee-6cc5-4470-80dd-363abefcb6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:04.568589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036f5ee-6cc5-4470-80dd-363abefcb6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:04.569086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036f5ee-6cc5-4470-80dd-363abefcb6e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:04.570112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036f5ee-6cc5-4470-80dd-363abefcb6e9 None admin] RBAC: Adding query filter params (role.id=6a46f6859932445b83ab7334c94dbe9b, scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc, user.id=f04b3bc5aba545fb83b4de6eb19a53a5) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:04.570640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036f5ee-6cc5-4470-80dd-363abefcb6e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:04.572276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036f5ee-6cc5-4470-80dd-363abefcb6e9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:04.579290 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 112/208] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:04 2022] GET /identity/v3/role_assignments?user.id=f04b3bc5aba545fb83b4de6eb19a53a5&scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc&role.id=6a46f6859932445b83ab7334c94dbe9b => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:05.376729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e20ac-4520-452c-a2bd-e393643416ac None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:05.377757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e20ac-4520-452c-a2bd-e393643416ac None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:05.378239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e20ac-4520-452c-a2bd-e393643416ac None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:05.380090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 97/209] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:05.381082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c27e7f-125c-48be-96e8-639db16c3154 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:05.381615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c27e7f-125c-48be-96e8-639db16c3154 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:05.382117 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c27e7f-125c-48be-96e8-639db16c3154 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:05.383924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 113/210] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:16:05.385146 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c42b8c-2a77-4901-befd-4b803650526b None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:05.385441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c42b8c-2a77-4901-befd-4b803650526b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:05.385721 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c42b8c-2a77-4901-befd-4b803650526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:05.390254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eece59-1420-4c07-acff-aa44fc031b8d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:05.390779 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eece59-1420-4c07-acff-aa44fc031b8d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:05.391279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eece59-1420-4c07-acff-aa44fc031b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:05.405647 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-22c42b8c-2a77-4901-befd-4b803650526b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:05.407768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-22c42b8c-2a77-4901-befd-4b803650526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:05.414274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-95eece59-1420-4c07-acff-aa44fc031b8d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:05.415702 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-95eece59-1420-4c07-acff-aa44fc031b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:05.468546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:05.490920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 98/211] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:16:05.500708 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 114/212] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:16:05.518139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c42b8c-2a77-4901-befd-4b803650526b None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:05.526336 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eece59-1420-4c07-acff-aa44fc031b8d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:05.626467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c42b8c-2a77-4901-befd-4b803650526b None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:05.631403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:05.634072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eece59-1420-4c07-acff-aa44fc031b8d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:05.669361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187458f-9891-4e35-9c01-7033584588b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:05.670301 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187458f-9891-4e35-9c01-7033584588b5 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:05.670678 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187458f-9891-4e35-9c01-7033584588b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:05.670965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187458f-9891-4e35-9c01-7033584588b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:05.672849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704e4d9-c42f-4d85-ab46-c88a7e4e0b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:05.673967 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e4d9-c42f-4d85-ab46-c88a7e4e0b66 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:05.674465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e4d9-c42f-4d85-ab46-c88a7e4e0b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:05.674879 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e4d9-c42f-4d85-ab46-c88a7e4e0b66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:05.676309 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704e4d9-c42f-4d85-ab46-c88a7e4e0b66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:05.678038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704e4d9-c42f-4d85-ab46-c88a7e4e0b66 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:05.680069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 115/213] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:05.686448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704e4d9-c42f-4d85-ab46-c88a7e4e0b66 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:05.687891 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187458f-9891-4e35-9c01-7033584588b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-0187458f-9891-4e35-9c01-7033584588b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:05.697361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:05.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:05.699075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:05.699075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:05.699075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:05.699075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:05.699075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:05.699075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:05.699075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:05.699075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:05.699075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:05.699075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:05.699075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:05.699075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:05.699075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 99/214] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:05.704419 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187458f-9891-4e35-9c01-7033584588b5 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:05.752293 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:05.818653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187458f-9891-4e35-9c01-7033584588b5 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:05.820184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704e4d9-c42f-4d85-ab46-c88a7e4e0b66 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:05.857066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbe329-5964-4276-9a78-70dffe685313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:05.857886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbe329-5964-4276-9a78-70dffe685313 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:05.858171 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbe329-5964-4276-9a78-70dffe685313 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:05.858442 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbe329-5964-4276-9a78-70dffe685313 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:05.859156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbe329-5964-4276-9a78-70dffe685313 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:05.860601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbe329-5964-4276-9a78-70dffe685313 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:05.864771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1d53a-7bd2-479b-833d-4f8738d539ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:05.865708 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1d53a-7bd2-479b-833d-4f8738d539ba None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:05.866189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1d53a-7bd2-479b-833d-4f8738d539ba None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:05.866686 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1d53a-7bd2-479b-833d-4f8738d539ba None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:05.867916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1d53a-7bd2-479b-833d-4f8738d539ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:05.868840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1d53a-7bd2-479b-833d-4f8738d539ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:05.871935 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1d53a-7bd2-479b-833d-4f8738d539ba None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:05.881710 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 100/215] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:05.887739 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1d53a-7bd2-479b-833d-4f8738d539ba None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:05.888299 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 116/216] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:16:05 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:16:06.009151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1d53a-7bd2-479b-833d-4f8738d539ba None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:06.017685 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:06.048992 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba99a7-37ab-47b5-9eb3-52baf796f1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:06.049919 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba99a7-37ab-47b5-9eb3-52baf796f1fa None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:06.050205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba99a7-37ab-47b5-9eb3-52baf796f1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:06.050481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba99a7-37ab-47b5-9eb3-52baf796f1fa None admin] PATH_INFO: `/v3/users/861b6526b0384e0d87b18329ab6121cb` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:06.066341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba99a7-37ab-47b5-9eb3-52baf796f1fa None admin] RBAC: Authorizing `identity:get_user(user_id=861b6526b0384e0d87b18329ab6121cb)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:06.068176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba99a7-37ab-47b5-9eb3-52baf796f1fa None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:06.071707 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 101/217] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:05 2022] GET /identity/v3/users/861b6526b0384e0d87b18329ab6121cb => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:06.080022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbe329-5964-4276-9a78-70dffe685313 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:06.107116 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:06.187830 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbe329-5964-4276-9a78-70dffe685313 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:06.227449 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcc33c-79bd-4360-84c0-ea160db5616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:06.228394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcc33c-79bd-4360-84c0-ea160db5616d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:06.228814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcc33c-79bd-4360-84c0-ea160db5616d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:06.229264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcc33c-79bd-4360-84c0-ea160db5616d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:06.304204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcc33c-79bd-4360-84c0-ea160db5616d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:06.305963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcc33c-79bd-4360-84c0-ea160db5616d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:06.312049 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7b46c-6e79-4f95-a94b-0871c8b8194d None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:06.312336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7b46c-6e79-4f95-a94b-0871c8b8194d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:06.312616 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7b46c-6e79-4f95-a94b-0871c8b8194d None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:06.314312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 102/218] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:16:06.319272 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7f29d-d80f-4fd2-ae6e-90e2892e23a4 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:06.319529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7f29d-d80f-4fd2-ae6e-90e2892e23a4 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:06.319809 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7f29d-d80f-4fd2-ae6e-90e2892e23a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:06.336083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:06.365124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-9bf7f29d-d80f-4fd2-ae6e-90e2892e23a4 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:06.366316 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9bf7f29d-d80f-4fd2-ae6e-90e2892e23a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:06.466346 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 103/219] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:06.470858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 117/220] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:06.478361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7f29d-d80f-4fd2-ae6e-90e2892e23a4 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:06.533254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcc33c-79bd-4360-84c0-ea160db5616d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:06.586997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:06.594089 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7f29d-d80f-4fd2-ae6e-90e2892e23a4 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:06.629276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc6f80-b327-42ff-9d9f-a1fdc2395440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:06.630380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc6f80-b327-42ff-9d9f-a1fdc2395440 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:06.630802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc6f80-b327-42ff-9d9f-a1fdc2395440 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:06.631241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc6f80-b327-42ff-9d9f-a1fdc2395440 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:06.632590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc6f80-b327-42ff-9d9f-a1fdc2395440 None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:06.634207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc6f80-b327-42ff-9d9f-a1fdc2395440 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:06.636069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 104/221] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:06 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:06.645556 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcc33c-79bd-4360-84c0-ea160db5616d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:06.646201 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc6f80-b327-42ff-9d9f-a1fdc2395440 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:06.672790 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:06.693976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd2bea-a1ac-4695-bdaf-076033202519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:06.694787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd2bea-a1ac-4695-bdaf-076033202519 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:06.695066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd2bea-a1ac-4695-bdaf-076033202519 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:06.695340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd2bea-a1ac-4695-bdaf-076033202519 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:06.713615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd2bea-a1ac-4695-bdaf-076033202519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a0dd2bea-a1ac-4695-bdaf-076033202519 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:06.722142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:06.722991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:06.723760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:06.723760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:06.723760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:06.723760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:06.723760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:06.723760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:06.723760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:06.723760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:06.723760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:06.723760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:06.723760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:16:06.723760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:06.723760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 118/222] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:16:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:16:06.724857 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a415fb-e25c-42e7-bbe1-61e7a80068ee None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:06.724857 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a415fb-e25c-42e7-bbe1-61e7a80068ee None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:06.725180 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a415fb-e25c-42e7-bbe1-61e7a80068ee None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:06.726876 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 119/223] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:06.731574 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a415fb-e25c-42e7-bbe1-61e7a80068ee None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:06.770338 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc6f80-b327-42ff-9d9f-a1fdc2395440 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:06.804964 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fee4b-e353-4389-bc73-4d3e8f217f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:06.805671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fee4b-e353-4389-bc73-4d3e8f217f19 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:06.806006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fee4b-e353-4389-bc73-4d3e8f217f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:06.806209 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fee4b-e353-4389-bc73-4d3e8f217f19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:06.807336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fee4b-e353-4389-bc73-4d3e8f217f19 None admin] RBAC: Adding query filter params (role.id=3b7272bb6de3425fa18a474080a9c1a2, scope.project.id=bf617240dd564a84b2b9fde284824719, user.id=861b6526b0384e0d87b18329ab6121cb) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:06.807336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fee4b-e353-4389-bc73-4d3e8f217f19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:06.808889 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fee4b-e353-4389-bc73-4d3e8f217f19 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:06.815075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 105/224] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:06 2022] GET /identity/v3/role_assignments?user.id=861b6526b0384e0d87b18329ab6121cb&scope.project.id=bf617240dd564a84b2b9fde284824719&role.id=3b7272bb6de3425fa18a474080a9c1a2 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:06.816382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927864e-6ff3-486b-b9c9-f2bceda631d9 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:06.816672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927864e-6ff3-486b-b9c9-f2bceda631d9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:06.817065 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927864e-6ff3-486b-b9c9-f2bceda631d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:06.835482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-3927864e-6ff3-486b-b9c9-f2bceda631d9 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:06.836822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-3927864e-6ff3-486b-b9c9-f2bceda631d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:06.861375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:06.867240 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a415fb-e25c-42e7-bbe1-61e7a80068ee None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:06.913434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e1cf7-cb0c-4bd2-9fe4-b3627e844e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:06.914667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e1cf7-cb0c-4bd2-9fe4-b3627e844e7b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:06.915269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e1cf7-cb0c-4bd2-9fe4-b3627e844e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:06.915740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e1cf7-cb0c-4bd2-9fe4-b3627e844e7b None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:06.916398 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 106/225] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:06.916856 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e1cf7-cb0c-4bd2-9fe4-b3627e844e7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:06.917311 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e1cf7-cb0c-4bd2-9fe4-b3627e844e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:06.919362 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e1cf7-cb0c-4bd2-9fe4-b3627e844e7b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:06.928802 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 120/226] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:06.938259 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927864e-6ff3-486b-b9c9-f2bceda631d9 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:06.958523 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e1cf7-cb0c-4bd2-9fe4-b3627e844e7b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:07.048128 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:07.054424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927864e-6ff3-486b-b9c9-f2bceda631d9 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:07.091245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba86de-065f-42dc-a71b-98d72208e79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:07.092133 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba86de-065f-42dc-a71b-98d72208e79a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:07.092412 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba86de-065f-42dc-a71b-98d72208e79a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:07.092688 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba86de-065f-42dc-a71b-98d72208e79a None admin] PATH_INFO: `/v3/users/a8adddcd4d1f4be3a0acf55519146a71` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:07.093929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba86de-065f-42dc-a71b-98d72208e79a None admin] RBAC: Authorizing `identity:get_user(user_id=a8adddcd4d1f4be3a0acf55519146a71)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:07.095358 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba86de-065f-42dc-a71b-98d72208e79a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:07.097171 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 107/227] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:06 2022] GET /identity/v3/users/a8adddcd4d1f4be3a0acf55519146a71 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:07.102518 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba86de-065f-42dc-a71b-98d72208e79a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:07.129789 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:07.195034 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e1cf7-cb0c-4bd2-9fe4-b3627e844e7b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:07.209839 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba86de-065f-42dc-a71b-98d72208e79a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:07.246442 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fa3b8-5e69-488b-aa68-9dee4f9fbc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:07.247307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fa3b8-5e69-488b-aa68-9dee4f9fbc6d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:07.247593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fa3b8-5e69-488b-aa68-9dee4f9fbc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:07.247869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fa3b8-5e69-488b-aa68-9dee4f9fbc6d None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:07.249092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fa3b8-5e69-488b-aa68-9dee4f9fbc6d None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:07.250596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fa3b8-5e69-488b-aa68-9dee4f9fbc6d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:07.256070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 108/228] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:07 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:07.258504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fa3b8-5e69-488b-aa68-9dee4f9fbc6d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:07.290540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f30b09-2ac0-4584-ba17-37af8e36b378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:07.291365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f30b09-2ac0-4584-ba17-37af8e36b378 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:07.291648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f30b09-2ac0-4584-ba17-37af8e36b378 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:07.291924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f30b09-2ac0-4584-ba17-37af8e36b378 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:07.319893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f30b09-2ac0-4584-ba17-37af8e36b378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-63f30b09-2ac0-4584-ba17-37af8e36b378 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:07.328564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:07.329456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:07.330215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:07.330215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:07.330215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:07.330215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:07.330215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:07.330215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:07.330215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:07.330215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:07.330215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:07.330215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:07.330215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:07.330215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:07.338207 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 121/229] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:16:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:07.357947 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f30b09-2ac0-4584-ba17-37af8e36b378 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:07.360845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:07.372317 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fa3b8-5e69-488b-aa68-9dee4f9fbc6d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:07.409959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58c02a-f162-441e-8e27-0aa138d8fd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:07.410851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58c02a-f162-441e-8e27-0aa138d8fd44 None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:07.411131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58c02a-f162-441e-8e27-0aa138d8fd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:07.411406 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58c02a-f162-441e-8e27-0aa138d8fd44 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719/users/a8adddcd4d1f4be3a0acf55519146a71/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:07.413613 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58c02a-f162-441e-8e27-0aa138d8fd44 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf617240dd564a84b2b9fde284824719, user_id=a8adddcd4d1f4be3a0acf55519146a71, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:07.415120 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58c02a-f162-441e-8e27-0aa138d8fd44 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:07.431273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 109/230] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:16:07 2022] PUT /identity/v3/projects/bf617240dd564a84b2b9fde284824719/users/a8adddcd4d1f4be3a0acf55519146a71/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:07.550600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f30b09-2ac0-4584-ba17-37af8e36b378 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:07.564459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:07.593505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cb6ae-ac82-4bee-90bd-021febcbd392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:07.594407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cb6ae-ac82-4bee-90bd-021febcbd392 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:07.594845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cb6ae-ac82-4bee-90bd-021febcbd392 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:07.595129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cb6ae-ac82-4bee-90bd-021febcbd392 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:07.595890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cb6ae-ac82-4bee-90bd-021febcbd392 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:07.596200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cb6ae-ac82-4bee-90bd-021febcbd392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:07.597680 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cb6ae-ac82-4bee-90bd-021febcbd392 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:07.607619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 122/231] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:07.613775 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58c02a-f162-441e-8e27-0aa138d8fd44 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:07.723472 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58c02a-f162-441e-8e27-0aa138d8fd44 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:07.759170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3a6d0-f824-496e-8c19-73aef35237da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:07.760422 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3a6d0-f824-496e-8c19-73aef35237da None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:07.760898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3a6d0-f824-496e-8c19-73aef35237da None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:07.761446 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3a6d0-f824-496e-8c19-73aef35237da None admin] PATH_INFO: `/v3/users/a8adddcd4d1f4be3a0acf55519146a71` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:07.762860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3a6d0-f824-496e-8c19-73aef35237da None admin] RBAC: Authorizing `identity:get_user(user_id=a8adddcd4d1f4be3a0acf55519146a71)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:07.764689 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3a6d0-f824-496e-8c19-73aef35237da None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:07.771022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 110/232] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:07 2022] GET /identity/v3/users/a8adddcd4d1f4be3a0acf55519146a71 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:07.772558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cb6ae-ac82-4bee-90bd-021febcbd392 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:07.883138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cb6ae-ac82-4bee-90bd-021febcbd392 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:07.931326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f9a54-a2be-4a30-94da-21653e249202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:07.932562 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f9a54-a2be-4a30-94da-21653e249202 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:07.933076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f9a54-a2be-4a30-94da-21653e249202 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:07.934158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f9a54-a2be-4a30-94da-21653e249202 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:07.941656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f9a54-a2be-4a30-94da-21653e249202 None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:07.943352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f9a54-a2be-4a30-94da-21653e249202 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:07.945486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 123/233] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:07 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:07.951536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3a6d0-f824-496e-8c19-73aef35237da None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:07.975694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:08.056840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3a6d0-f824-496e-8c19-73aef35237da None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:08.093024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239a2aa-3457-46c3-b564-6c47bd2ffce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:08.094188 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239a2aa-3457-46c3-b564-6c47bd2ffce8 None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:08.094663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239a2aa-3457-46c3-b564-6c47bd2ffce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:08.095167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239a2aa-3457-46c3-b564-6c47bd2ffce8 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719/users/a8adddcd4d1f4be3a0acf55519146a71/roles/ffad03b6b6d1473dba5d5b7296943f18` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:08.097590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239a2aa-3457-46c3-b564-6c47bd2ffce8 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf617240dd564a84b2b9fde284824719, user_id=a8adddcd4d1f4be3a0acf55519146a71, role_id=ffad03b6b6d1473dba5d5b7296943f18)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:08.099228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239a2aa-3457-46c3-b564-6c47bd2ffce8 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:08.121257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 111/234] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:16:07 2022] PUT /identity/v3/projects/bf617240dd564a84b2b9fde284824719/users/a8adddcd4d1f4be3a0acf55519146a71/roles/ffad03b6b6d1473dba5d5b7296943f18 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:08.413750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c34ef8-ae4f-4eae-8a8f-739107d56a97 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:08.414402 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c34ef8-ae4f-4eae-8a8f-739107d56a97 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:08.414895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c34ef8-ae4f-4eae-8a8f-739107d56a97 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:08.416755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 124/235] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:08.421908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936e4e6-38f6-428d-b973-3af6cdc1e0c0 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:08.422432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936e4e6-38f6-428d-b973-3af6cdc1e0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:08.422924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936e4e6-38f6-428d-b973-3af6cdc1e0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:08.443834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-6936e4e6-38f6-428d-b973-3af6cdc1e0c0 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:08.445545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6936e4e6-38f6-428d-b973-3af6cdc1e0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:08.527832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 112/236] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:08.577971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c34ef8-ae4f-4eae-8a8f-739107d56a97 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:08.627407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:08.714632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c34ef8-ae4f-4eae-8a8f-739107d56a97 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:08.759932 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53076dc1-9fad-4c00-a734-c9aacaaa3b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:08.761111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53076dc1-9fad-4c00-a734-c9aacaaa3b8a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:08.761691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53076dc1-9fad-4c00-a734-c9aacaaa3b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:08.762182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53076dc1-9fad-4c00-a734-c9aacaaa3b8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:08.764749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53076dc1-9fad-4c00-a734-c9aacaaa3b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:08.766413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53076dc1-9fad-4c00-a734-c9aacaaa3b8a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:08.768598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 125/237] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:08.773697 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936e4e6-38f6-428d-b973-3af6cdc1e0c0 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:08.808956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:08.868861 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f4abd-e45f-4932-b309-e30e0c7bc097 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:08.869781 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f4abd-e45f-4932-b309-e30e0c7bc097 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:08.870277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f4abd-e45f-4932-b309-e30e0c7bc097 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:08.871879 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 126/238] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:08.876779 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8146d-b41e-4525-978c-7a8caeb9aa69 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:08.877315 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8146d-b41e-4525-978c-7a8caeb9aa69 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:08.877781 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8146d-b41e-4525-978c-7a8caeb9aa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:08.904130 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fec8146d-b41e-4525-978c-7a8caeb9aa69 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:08.906682 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fec8146d-b41e-4525-978c-7a8caeb9aa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:08.926418 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936e4e6-38f6-428d-b973-3af6cdc1e0c0 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:08.998778 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d970809-3d50-483c-84e5-9399e5160db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:08.999869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d970809-3d50-483c-84e5-9399e5160db5 None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:09.000359 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d970809-3d50-483c-84e5-9399e5160db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:09.000828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d970809-3d50-483c-84e5-9399e5160db5 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:09.001789 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d970809-3d50-483c-84e5-9399e5160db5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:09.003476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d970809-3d50-483c-84e5-9399e5160db5 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:09.044124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 113/239] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:16:08 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:16:09.046629 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 127/240] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:09.082230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d970809-3d50-483c-84e5-9399e5160db5 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:09.192037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:09.244949 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d970809-3d50-483c-84e5-9399e5160db5 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:09.282558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9efa94-4d68-434d-9015-17ca1b60230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:09.283367 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9efa94-4d68-434d-9015-17ca1b60230d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:09.283646 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9efa94-4d68-434d-9015-17ca1b60230d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:09.283915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9efa94-4d68-434d-9015-17ca1b60230d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:09.295468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9efa94-4d68-434d-9015-17ca1b60230d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-0b9efa94-4d68-434d-9015-17ca1b60230d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:09.303102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:09.304000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:09.305254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:09.305254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:09.305254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:09.305254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:09.305254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:09.305254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:09.305254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:09.305254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:09.305254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:09.305254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:09.305254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:16:09.305254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:09.305254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 114/241] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:09.310455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8146d-b41e-4525-978c-7a8caeb9aa69 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:09.343489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:09.413375 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8146d-b41e-4525-978c-7a8caeb9aa69 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:09.453616 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8a421-5252-49ac-9c51-7bba4a38380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:09.454294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8a421-5252-49ac-9c51-7bba4a38380b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:09.454581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8a421-5252-49ac-9c51-7bba4a38380b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:09.454858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8a421-5252-49ac-9c51-7bba4a38380b None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:09.455618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8a421-5252-49ac-9c51-7bba4a38380b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:09.455923 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8a421-5252-49ac-9c51-7bba4a38380b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:09.457344 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8a421-5252-49ac-9c51-7bba4a38380b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:09.469134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 128/242] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:09.474480 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9efa94-4d68-434d-9015-17ca1b60230d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:09.538665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283881a-0d62-497f-ade8-3dd2330f6229 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:09.539360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283881a-0d62-497f-ade8-3dd2330f6229 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:09.539643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283881a-0d62-497f-ade8-3dd2330f6229 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:09.541059 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 129/243] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:16:09.546440 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ffbfc-de46-4c64-bd53-af30dd895db4 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:09.546832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ffbfc-de46-4c64-bd53-af30dd895db4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:09.547011 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ffbfc-de46-4c64-bd53-af30dd895db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:09.566333 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7a4ffbfc-de46-4c64-bd53-af30dd895db4 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:09.567748 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7a4ffbfc-de46-4c64-bd53-af30dd895db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:09.619628 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9efa94-4d68-434d-9015-17ca1b60230d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:09.649287 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:09.659082 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c53d5-bf3c-475b-897a-a501ad2fb8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:09.659249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 130/244] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:16:09.659774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c53d5-bf3c-475b-897a-a501ad2fb8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:09.660040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c53d5-bf3c-475b-897a-a501ad2fb8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:09.660306 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c53d5-bf3c-475b-897a-a501ad2fb8a9 None admin] PATH_INFO: `/v3/users/7a6b1b071d4240b0a519c89ea7e65161` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:09.675916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c53d5-bf3c-475b-897a-a501ad2fb8a9 None admin] RBAC: Authorizing `identity:get_user(user_id=7a6b1b071d4240b0a519c89ea7e65161)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:09.677414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c53d5-bf3c-475b-897a-a501ad2fb8a9 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:09.679152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 115/245] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:09 2022] GET /identity/v3/users/7a6b1b071d4240b0a519c89ea7e65161 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:09.684671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ffbfc-de46-4c64-bd53-af30dd895db4 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:09.686971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c53d5-bf3c-475b-897a-a501ad2fb8a9 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:09.733312 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:09.798058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c53d5-bf3c-475b-897a-a501ad2fb8a9 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:09.806207 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ffbfc-de46-4c64-bd53-af30dd895db4 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:09.838171 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc9714-ac68-4141-9e4c-72c1b944fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:09.838986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc9714-ac68-4141-9e4c-72c1b944fb80 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:09.839272 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc9714-ac68-4141-9e4c-72c1b944fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:09.840116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc9714-ac68-4141-9e4c-72c1b944fb80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:09.851904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc9714-ac68-4141-9e4c-72c1b944fb80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:09.854457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bcceb-9ff8-4a57-987f-5953fc94fc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:09.855151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bcceb-9ff8-4a57-987f-5953fc94fc0c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:09.855925 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bcceb-9ff8-4a57-987f-5953fc94fc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:09.856198 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bcceb-9ff8-4a57-987f-5953fc94fc0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-3dfc9714-ac68-4141-9e4c-72c1b944fb80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:09.861495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:09.862390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:09.863227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:09.863227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:09.863227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:09.863227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:09.863227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:09.863227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:09.863227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:09.863227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:09.863227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:09.863227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:09.863227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:09.863227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:09.863227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 116/246] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:16:09.868409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc9714-ac68-4141-9e4c-72c1b944fb80 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:09.917461 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:09.951728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bcceb-9ff8-4a57-987f-5953fc94fc0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:09.958418 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bcceb-9ff8-4a57-987f-5953fc94fc0c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:09.976277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc9714-ac68-4141-9e4c-72c1b944fb80 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:10.005819 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:10.039730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6071a-6d1b-488b-aff5-97fe62bf26c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:10.040409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6071a-6d1b-488b-aff5-97fe62bf26c4 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:10.040687 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6071a-6d1b-488b-aff5-97fe62bf26c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:10.040979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6071a-6d1b-488b-aff5-97fe62bf26c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:10.041799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6071a-6d1b-488b-aff5-97fe62bf26c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:10.042104 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6071a-6d1b-488b-aff5-97fe62bf26c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:10.043593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6071a-6d1b-488b-aff5-97fe62bf26c4 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:10.060427 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 117/247] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:10.069934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6071a-6d1b-488b-aff5-97fe62bf26c4 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:10.163193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 131/248] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:10.170407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bcceb-9ff8-4a57-987f-5953fc94fc0c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:10.274494 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6071a-6d1b-488b-aff5-97fe62bf26c4 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:10.288330 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:10.339108 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830ee30-9fc1-48f0-b424-7bb8662b4eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:10.340444 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830ee30-9fc1-48f0-b424-7bb8662b4eae None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:10.340722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830ee30-9fc1-48f0-b424-7bb8662b4eae None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:10.341016 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830ee30-9fc1-48f0-b424-7bb8662b4eae None admin] PATH_INFO: `/v3/users/861b6526b0384e0d87b18329ab6121cb` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:10.342297 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830ee30-9fc1-48f0-b424-7bb8662b4eae None admin] RBAC: Authorizing `identity:get_user(user_id=861b6526b0384e0d87b18329ab6121cb)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:10.343748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830ee30-9fc1-48f0-b424-7bb8662b4eae None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:10.345582 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 118/249] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:10 2022] GET /identity/v3/users/861b6526b0384e0d87b18329ab6121cb => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:10.352329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de622bcf-11ae-4000-936e-ad77b1934713 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:10.352621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de622bcf-11ae-4000-936e-ad77b1934713 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:10.352903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de622bcf-11ae-4000-936e-ad77b1934713 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:10.354274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 119/250] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:10.358472 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bcceb-9ff8-4a57-987f-5953fc94fc0c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:10.360370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de622bcf-11ae-4000-936e-ad77b1934713 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:10.398449 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:10.415241 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e2ccc-fa28-4532-a4b4-ac316c47b550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:10.416157 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e2ccc-fa28-4532-a4b4-ac316c47b550 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:10.416441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e2ccc-fa28-4532-a4b4-ac316c47b550 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:10.416715 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e2ccc-fa28-4532-a4b4-ac316c47b550 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:10.418581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e2ccc-fa28-4532-a4b4-ac316c47b550 None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:10.420030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e2ccc-fa28-4532-a4b4-ac316c47b550 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:10.421751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 132/251] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:10 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:10.424070 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400871e-b21f-4ed7-9740-185cc5678fac None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:10.424351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400871e-b21f-4ed7-9740-185cc5678fac None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:10.424628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400871e-b21f-4ed7-9740-185cc5678fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:10.456234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c400871e-b21f-4ed7-9740-185cc5678fac None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:10.457281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c400871e-b21f-4ed7-9740-185cc5678fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:10.574723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de622bcf-11ae-4000-936e-ad77b1934713 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:10.590074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 133/252] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:10.590920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400871e-b21f-4ed7-9740-185cc5678fac None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:10.644061 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b169c4-24f6-463d-9a27-344b3e7232f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:10.644997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b169c4-24f6-463d-9a27-344b3e7232f9 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:10.645246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b169c4-24f6-463d-9a27-344b3e7232f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:10.645525 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b169c4-24f6-463d-9a27-344b3e7232f9 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:10.648123 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b169c4-24f6-463d-9a27-344b3e7232f9 None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:10.649609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b169c4-24f6-463d-9a27-344b3e7232f9 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:10.652080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 120/253] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:10 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:10.658628 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab44a1-d997-47c1-a6a1-45d31d8ae97e None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:10.658921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab44a1-d997-47c1-a6a1-45d31d8ae97e None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:10.659208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab44a1-d997-47c1-a6a1-45d31d8ae97e None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:10.664751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 121/254] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:10.664751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab44a1-d997-47c1-a6a1-45d31d8ae97e None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:10.716951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:10.735226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400871e-b21f-4ed7-9740-185cc5678fac None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:10.764275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:10.776787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e4969-0a55-4905-a1d1-b34732dd8c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:10.777745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e4969-0a55-4905-a1d1-b34732dd8c2f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:10.778478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e4969-0a55-4905-a1d1-b34732dd8c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:10.778956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e4969-0a55-4905-a1d1-b34732dd8c2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:10.780013 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e4969-0a55-4905-a1d1-b34732dd8c2f None admin] RBAC: Adding query filter params (role.id=6a46f6859932445b83ab7334c94dbe9b, scope.project.id=bf617240dd564a84b2b9fde284824719, user.id=7a6b1b071d4240b0a519c89ea7e65161) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:10.780527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e4969-0a55-4905-a1d1-b34732dd8c2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:10.782211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e4969-0a55-4905-a1d1-b34732dd8c2f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:10.787920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab44a1-d997-47c1-a6a1-45d31d8ae97e None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:10.788750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 134/255] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:10 2022] GET /identity/v3/role_assignments?user.id=7a6b1b071d4240b0a519c89ea7e65161&scope.project.id=bf617240dd564a84b2b9fde284824719&role.id=6a46f6859932445b83ab7334c94dbe9b => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:10.789761 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e4969-0a55-4905-a1d1-b34732dd8c2f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:10.881782 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b766a-c6d8-4964-83ec-778398d18ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:10.882520 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b766a-c6d8-4964-83ec-778398d18ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:10.882805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b766a-c6d8-4964-83ec-778398d18ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:10.883081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b766a-c6d8-4964-83ec-778398d18ed7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:10.912284 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b766a-c6d8-4964-83ec-778398d18ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:10.931446 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e4969-0a55-4905-a1d1-b34732dd8c2f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-2b3b766a-c6d8-4964-83ec-778398d18ed7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:10.933022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:10.934492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:10.935288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:10.935288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:10.935288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:10.935288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:10.935288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:10.935288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:10.935288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:10.935288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:10.935288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:10.935288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:10.935288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:16:10.935288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:10.935288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 122/256] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:16:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:10.936682 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5a378-9de0-44fb-81b8-646fd9b4fb15 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:10.936682 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5a378-9de0-44fb-81b8-646fd9b4fb15 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:10.936837 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5a378-9de0-44fb-81b8-646fd9b4fb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:10.972222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-50b5a378-9de0-44fb-81b8-646fd9b4fb15 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:10.973464 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-50b5a378-9de0-44fb-81b8-646fd9b4fb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:11.012053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d73f6-96d4-4851-9211-f5206acadf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:11.012954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d73f6-96d4-4851-9211-f5206acadf54 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:11.013278 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d73f6-96d4-4851-9211-f5206acadf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:11.013519 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d73f6-96d4-4851-9211-f5206acadf54 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719/users/861b6526b0384e0d87b18329ab6121cb/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:11.018017 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d73f6-96d4-4851-9211-f5206acadf54 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf617240dd564a84b2b9fde284824719, user_id=861b6526b0384e0d87b18329ab6121cb, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:11.019958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d73f6-96d4-4851-9211-f5206acadf54 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:11.037483 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 135/257] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:16:10 2022] PUT /identity/v3/projects/bf617240dd564a84b2b9fde284824719/users/861b6526b0384e0d87b18329ab6121cb/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:11.038200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d73f6-96d4-4851-9211-f5206acadf54 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:11.061940 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 123/258] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:11.088480 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5a378-9de0-44fb-81b8-646fd9b4fb15 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:11.122853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:11.160527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:11.253760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d73f6-96d4-4851-9211-f5206acadf54 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:11.292328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ac6a5-2164-46c3-984d-93408452d506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:11.293806 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ac6a5-2164-46c3-984d-93408452d506 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:11.294099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ac6a5-2164-46c3-984d-93408452d506 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:11.294381 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ac6a5-2164-46c3-984d-93408452d506 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:11.295149 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ac6a5-2164-46c3-984d-93408452d506 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:11.295460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ac6a5-2164-46c3-984d-93408452d506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:11.296892 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ac6a5-2164-46c3-984d-93408452d506 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:11.298907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5a378-9de0-44fb-81b8-646fd9b4fb15 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:11.308035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 136/259] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:11.314445 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ac6a5-2164-46c3-984d-93408452d506 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:11.390824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff93db-3f6b-4c65-99ef-6f94d0ecdfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:11.391648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff93db-3f6b-4c65-99ef-6f94d0ecdfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:11.391939 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff93db-3f6b-4c65-99ef-6f94d0ecdfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:11.393375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff93db-3f6b-4c65-99ef-6f94d0ecdfe3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:11.415375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff93db-3f6b-4c65-99ef-6f94d0ecdfe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-7bff93db-3f6b-4c65-99ef-6f94d0ecdfe3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:11.427132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:11.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:11.428952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:11.428952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:11.428952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:11.428952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:11.428952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:11.428952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:11.428952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:11.428952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:11.428952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:11.428952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:11.428952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:11.428952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:11.428952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 124/260] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:16:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:11.441119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff93db-3f6b-4c65-99ef-6f94d0ecdfe3 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:11.483680 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ac6a5-2164-46c3-984d-93408452d506 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:11.506944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:11.554279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdae337-1892-4784-b2f8-05065bfa8850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:11.555561 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdae337-1892-4784-b2f8-05065bfa8850 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:11.556045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdae337-1892-4784-b2f8-05065bfa8850 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:11.556516 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdae337-1892-4784-b2f8-05065bfa8850 None admin] PATH_INFO: `/v3/users/a8adddcd4d1f4be3a0acf55519146a71` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:11.562017 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdae337-1892-4784-b2f8-05065bfa8850 None admin] RBAC: Authorizing `identity:get_user(user_id=a8adddcd4d1f4be3a0acf55519146a71)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:11.563788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdae337-1892-4784-b2f8-05065bfa8850 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:11.566111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 137/261] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:11 2022] GET /identity/v3/users/a8adddcd4d1f4be3a0acf55519146a71 => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:11.578115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdae337-1892-4784-b2f8-05065bfa8850 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:11.595742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:11.612976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff93db-3f6b-4c65-99ef-6f94d0ecdfe3 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:11.660543 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e0730-69f0-42b9-b6a3-62e6faef12ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:11.665554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e0730-69f0-42b9-b6a3-62e6faef12ed None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:11.665798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e0730-69f0-42b9-b6a3-62e6faef12ed None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:11.666090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e0730-69f0-42b9-b6a3-62e6faef12ed None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:11.666885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e0730-69f0-42b9-b6a3-62e6faef12ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:11.667193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e0730-69f0-42b9-b6a3-62e6faef12ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:11.668685 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e0730-69f0-42b9-b6a3-62e6faef12ed None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:11.682432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 125/262] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:11.688243 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e0730-69f0-42b9-b6a3-62e6faef12ed None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:11.777127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdae337-1892-4784-b2f8-05065bfa8850 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:11.844974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e0730-69f0-42b9-b6a3-62e6faef12ed None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:11.857652 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce396cff-affe-4fe3-a2b9-9ebe80565e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:11.858708 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce396cff-affe-4fe3-a2b9-9ebe80565e96 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:11.859185 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce396cff-affe-4fe3-a2b9-9ebe80565e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:11.859652 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce396cff-affe-4fe3-a2b9-9ebe80565e96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:11.896646 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ca9b6-28aa-489d-96f4-457d5a935553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:11.897582 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ca9b6-28aa-489d-96f4-457d5a935553 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:11.897869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ca9b6-28aa-489d-96f4-457d5a935553 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:11.898149 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ca9b6-28aa-489d-96f4-457d5a935553 None admin] PATH_INFO: `/v3/users/a8adddcd4d1f4be3a0acf55519146a71` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:11.899422 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ca9b6-28aa-489d-96f4-457d5a935553 None admin] RBAC: Authorizing `identity:get_user(user_id=a8adddcd4d1f4be3a0acf55519146a71)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:11.905167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ca9b6-28aa-489d-96f4-457d5a935553 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:11.913189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 126/263] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:11 2022] GET /identity/v3/users/a8adddcd4d1f4be3a0acf55519146a71 => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:11.914139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ca9b6-28aa-489d-96f4-457d5a935553 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:11.969390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:11.981303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:12.010037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce396cff-affe-4fe3-a2b9-9ebe80565e96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:12.011568 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce396cff-affe-4fe3-a2b9-9ebe80565e96 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:12.078511 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ca9b6-28aa-489d-96f4-457d5a935553 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:12.154670 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9ce82-f0a5-40d2-bf31-4ae2171db280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:12.155341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9ce82-f0a5-40d2-bf31-4ae2171db280 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:12.155634 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9ce82-f0a5-40d2-bf31-4ae2171db280 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:12.155922 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9ce82-f0a5-40d2-bf31-4ae2171db280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:12.177750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 138/264] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:16:12.182603 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f6ad8-dd9c-4aa4-8511-1d70df54e200 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:12.182898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f6ad8-dd9c-4aa4-8511-1d70df54e200 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:12.183209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f6ad8-dd9c-4aa4-8511-1d70df54e200 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:12.187130 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 139/265] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:12.187864 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f6ad8-dd9c-4aa4-8511-1d70df54e200 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:12.272979 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:12.298052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f6ad8-dd9c-4aa4-8511-1d70df54e200 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:12.329794 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9ce82-f0a5-40d2-bf31-4ae2171db280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:12.331282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9ce82-f0a5-40d2-bf31-4ae2171db280 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:12.334396 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b253f7-37e4-446d-8319-c15fddc2342e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:12.335305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b253f7-37e4-446d-8319-c15fddc2342e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:12.335615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b253f7-37e4-446d-8319-c15fddc2342e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:12.335901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b253f7-37e4-446d-8319-c15fddc2342e None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:12.337119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b253f7-37e4-446d-8319-c15fddc2342e None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:12.338972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b253f7-37e4-446d-8319-c15fddc2342e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:12.340999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 140/266] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:12 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:12.341959 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aba563-6635-4567-89ed-2fca0fcbf9c3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:12.346526 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aba563-6635-4567-89ed-2fca0fcbf9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:12.346835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aba563-6635-4567-89ed-2fca0fcbf9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:12.365292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a9aba563-6635-4567-89ed-2fca0fcbf9c3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:12.366640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a9aba563-6635-4567-89ed-2fca0fcbf9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:12.379712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:12.439557 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 141/267] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:12.440760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aba563-6635-4567-89ed-2fca0fcbf9c3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:12.477060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 127/268] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:16:12.482869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdce14-5332-42fc-9d82-eb4ca8560e37 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:12.482869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdce14-5332-42fc-9d82-eb4ca8560e37 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:12.482869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdce14-5332-42fc-9d82-eb4ca8560e37 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:12.482869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 128/269] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:12.485300 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdce14-5332-42fc-9d82-eb4ca8560e37 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:12.533379 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:12.553568 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aba563-6635-4567-89ed-2fca0fcbf9c3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:12.591730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdce14-5332-42fc-9d82-eb4ca8560e37 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:12.600244 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c34e2-9de1-4664-b0d7-46ed5abef543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:12.601663 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c34e2-9de1-4664-b0d7-46ed5abef543 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:12.602148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c34e2-9de1-4664-b0d7-46ed5abef543 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:12.602963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c34e2-9de1-4664-b0d7-46ed5abef543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:12.604344 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c34e2-9de1-4664-b0d7-46ed5abef543 None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=bf617240dd564a84b2b9fde284824719, user.id=a8adddcd4d1f4be3a0acf55519146a71) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:12.604877 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c34e2-9de1-4664-b0d7-46ed5abef543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:12.607545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c34e2-9de1-4664-b0d7-46ed5abef543 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:12.616066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 142/270] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:12 2022] GET /identity/v3/role_assignments?user.id=a8adddcd4d1f4be3a0acf55519146a71&scope.project.id=bf617240dd564a84b2b9fde284824719&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:12.619989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:12.620112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c34e2-9de1-4664-b0d7-46ed5abef543 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:12.645010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022e7e7-3478-4ed2-8098-7f42a1fa5747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:12.646917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022e7e7-3478-4ed2-8098-7f42a1fa5747 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:12.647203 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022e7e7-3478-4ed2-8098-7f42a1fa5747 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:12.648334 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022e7e7-3478-4ed2-8098-7f42a1fa5747 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:12.677863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022e7e7-3478-4ed2-8098-7f42a1fa5747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-4022e7e7-3478-4ed2-8098-7f42a1fa5747 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:12.686414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:12.687547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:12.688533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:12.688533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:12.688533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:12.688533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:12.688533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:12.688533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:12.688533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:12.688533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:12.688533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:12.688533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:12.688533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:12.688533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:12.688533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 129/271] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:12.689440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3710d-40cb-40c0-b659-c675c5b8b596 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:12.689440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3710d-40cb-40c0-b659-c675c5b8b596 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:12.690379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3710d-40cb-40c0-b659-c675c5b8b596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:12.725397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-fce3710d-40cb-40c0-b659-c675c5b8b596 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:12.728879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-fce3710d-40cb-40c0-b659-c675c5b8b596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:12.851228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 130/272] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:12.852803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3710d-40cb-40c0-b659-c675c5b8b596 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:12.856452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c34e2-9de1-4664-b0d7-46ed5abef543 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:12.914762 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad76022-e531-45d6-8f96-bd6b26554857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:12.915637 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad76022-e531-45d6-8f96-bd6b26554857 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:12.915921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad76022-e531-45d6-8f96-bd6b26554857 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:12.916195 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad76022-e531-45d6-8f96-bd6b26554857 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:12.917424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad76022-e531-45d6-8f96-bd6b26554857 None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:12.918927 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad76022-e531-45d6-8f96-bd6b26554857 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:12.920628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 143/273] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:12 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:12.921706 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad76022-e531-45d6-8f96-bd6b26554857 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:12.932016 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:12.982684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3710d-40cb-40c0-b659-c675c5b8b596 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:13.000997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:13.029102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18079f8c-6cb0-4081-a7dd-82e8d857a993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:13.029965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18079f8c-6cb0-4081-a7dd-82e8d857a993 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:13.030254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18079f8c-6cb0-4081-a7dd-82e8d857a993 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:13.030534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18079f8c-6cb0-4081-a7dd-82e8d857a993 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:13.031859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18079f8c-6cb0-4081-a7dd-82e8d857a993 None admin] RBAC: Adding query filter params (name=member) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:13.031981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18079f8c-6cb0-4081-a7dd-82e8d857a993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:13.033639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18079f8c-6cb0-4081-a7dd-82e8d857a993 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:13.038237 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad76022-e531-45d6-8f96-bd6b26554857 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:13.046226 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 131/274] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:13.047514 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18079f8c-6cb0-4081-a7dd-82e8d857a993 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:13.089558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0b8b1-2bf3-4e09-bf00-30665b44fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:13.091257 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0b8b1-2bf3-4e09-bf00-30665b44fa3f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:13.091871 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0b8b1-2bf3-4e09-bf00-30665b44fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:13.092346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0b8b1-2bf3-4e09-bf00-30665b44fa3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:13.093793 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0b8b1-2bf3-4e09-bf00-30665b44fa3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:13.095443 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0b8b1-2bf3-4e09-bf00-30665b44fa3f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:13.097366 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 144/275] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:13.098520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0b8b1-2bf3-4e09-bf00-30665b44fa3f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:13.164071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18079f8c-6cb0-4081-a7dd-82e8d857a993 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:13.188488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:13.200578 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744caedb-68f0-414a-902a-61a618d2560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:13.201415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744caedb-68f0-414a-902a-61a618d2560c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:13.201704 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744caedb-68f0-414a-902a-61a618d2560c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:13.201989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744caedb-68f0-414a-902a-61a618d2560c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:13.202828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744caedb-68f0-414a-902a-61a618d2560c None admin] RBAC: Adding query filter params (role.id=ffad03b6b6d1473dba5d5b7296943f18, scope.project.id=bf617240dd564a84b2b9fde284824719, user.id=a8adddcd4d1f4be3a0acf55519146a71) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:13.203142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744caedb-68f0-414a-902a-61a618d2560c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:13.204959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744caedb-68f0-414a-902a-61a618d2560c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:13.211221 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 132/276] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:13 2022] GET /identity/v3/role_assignments?user.id=a8adddcd4d1f4be3a0acf55519146a71&scope.project.id=bf617240dd564a84b2b9fde284824719&role.id=ffad03b6b6d1473dba5d5b7296943f18 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:13.212300 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744caedb-68f0-414a-902a-61a618d2560c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:13.218584 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0b8b1-2bf3-4e09-bf00-30665b44fa3f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:13.260110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aafc03-bbc5-441e-8cc4-a130f136f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:13.262227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aafc03-bbc5-441e-8cc4-a130f136f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:13.262732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aafc03-bbc5-441e-8cc4-a130f136f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:13.263216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aafc03-bbc5-441e-8cc4-a130f136f6a7 None admin] PATH_INFO: `/v3/users/12d07bb947d248258b06b6f49b2cc3a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:13.280995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aafc03-bbc5-441e-8cc4-a130f136f6a7 None admin] RBAC: Authorizing `identity:get_user(user_id=12d07bb947d248258b06b6f49b2cc3a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:13.282942 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aafc03-bbc5-441e-8cc4-a130f136f6a7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:13.285437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 145/277] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:13 2022] GET /identity/v3/users/12d07bb947d248258b06b6f49b2cc3a2 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:13.294488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aafc03-bbc5-441e-8cc4-a130f136f6a7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:13.297287 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:13.372977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744caedb-68f0-414a-902a-61a618d2560c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:13.404194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f81b4c-4e77-47c0-bdf6-950fe562f677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:13.404858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f81b4c-4e77-47c0-bdf6-950fe562f677 None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:13.405170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f81b4c-4e77-47c0-bdf6-950fe562f677 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:13.405530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f81b4c-4e77-47c0-bdf6-950fe562f677 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:13.406255 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f81b4c-4e77-47c0-bdf6-950fe562f677 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:13.407705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f81b4c-4e77-47c0-bdf6-950fe562f677 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:13.430578 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 133/278] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:16:13 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:16:13.471641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aafc03-bbc5-441e-8cc4-a130f136f6a7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:13.515484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93ce5e-d813-414f-b05c-ac5852682fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:13.516259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93ce5e-d813-414f-b05c-ac5852682fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:13.516546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93ce5e-d813-414f-b05c-ac5852682fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:13.516824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93ce5e-d813-414f-b05c-ac5852682fc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:13.517707 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93ce5e-d813-414f-b05c-ac5852682fc2 None admin] RBAC: Adding query filter params (role.id=3b7272bb6de3425fa18a474080a9c1a2, user.id=12d07bb947d248258b06b6f49b2cc3a2, scope.system=all) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:13.518021 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93ce5e-d813-414f-b05c-ac5852682fc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:13.519596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93ce5e-d813-414f-b05c-ac5852682fc2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:13.521449 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:13.528356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 146/279] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Jul 21 22:16:13 2022] GET /identity/v3/role_assignments?user.id=12d07bb947d248258b06b6f49b2cc3a2&scope.system=all&role.id=3b7272bb6de3425fa18a474080a9c1a2 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:13.642545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d395d-c600-4c89-828f-0b1e62e77e50 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:13.642865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d395d-c600-4c89-828f-0b1e62e77e50 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:13.643740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d395d-c600-4c89-828f-0b1e62e77e50 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:13.645447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 134/280] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:13.650996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f91d6-5e2e-43e9-9db9-e126a1024e95 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:13.651283 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f91d6-5e2e-43e9-9db9-e126a1024e95 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:13.651562 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f91d6-5e2e-43e9-9db9-e126a1024e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:13.672313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d64f91d6-5e2e-43e9-9db9-e126a1024e95 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:13.673554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d64f91d6-5e2e-43e9-9db9-e126a1024e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:13.748049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 147/281] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:13.771669 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d395d-c600-4c89-828f-0b1e62e77e50 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:13.853621 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65e068-6090-445d-a78a-f7e8d1eb454c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:13.853943 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65e068-6090-445d-a78a-f7e8d1eb454c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:13.854186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65e068-6090-445d-a78a-f7e8d1eb454c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:13.855894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 148/282] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:13.866092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e9a2e-ddd7-4b40-8bca-5b2334f78e39 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:13.866678 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e9a2e-ddd7-4b40-8bca-5b2334f78e39 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:13.866678 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e9a2e-ddd7-4b40-8bca-5b2334f78e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:13.890995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a02e9a2e-ddd7-4b40-8bca-5b2334f78e39 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:13.891699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:13.892253 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a02e9a2e-ddd7-4b40-8bca-5b2334f78e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:13.897345 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d395d-c600-4c89-828f-0b1e62e77e50 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:13.934497 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f6682-cac2-46d1-b785-6fce10d76cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:13.935302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f6682-cac2-46d1-b785-6fce10d76cce None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:13.935586 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f6682-cac2-46d1-b785-6fce10d76cce None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:13.935861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f6682-cac2-46d1-b785-6fce10d76cce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:13.950463 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f6682-cac2-46d1-b785-6fce10d76cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-1b4f6682-cac2-46d1-b785-6fce10d76cce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:13.958268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:13.959168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:13.960093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:13.960093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:13.960093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:13.960093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:13.960093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:13.960093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:13.960093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:13.960093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:13.960093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:13.960093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:13.960093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:16:13.960093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:13.960093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 135/283] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:13.965689 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f6682-cac2-46d1-b785-6fce10d76cce None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:13.991647 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 149/284] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:16:14.034727 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e9a2e-ddd7-4b40-8bca-5b2334f78e39 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:14.109862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:14.160172 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e9a2e-ddd7-4b40-8bca-5b2334f78e39 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:14.171683 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f6682-cac2-46d1-b785-6fce10d76cce None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:14.201928 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71019f81-48e5-41cc-a916-0bc275933bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:14.202732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71019f81-48e5-41cc-a916-0bc275933bee None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:14.203012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71019f81-48e5-41cc-a916-0bc275933bee None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:14.203285 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71019f81-48e5-41cc-a916-0bc275933bee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:14.215740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71019f81-48e5-41cc-a916-0bc275933bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-71019f81-48e5-41cc-a916-0bc275933bee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:14.223505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:14.224369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:14.225155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:14.225155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:14.225155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:14.225155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:14.225155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:14.225155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:14.225155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:14.225155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:14.225155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:14.225155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:14.225155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:14.225155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:14.226269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 150/285] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:14.231633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71019f81-48e5-41cc-a916-0bc275933bee None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:14.253594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c2529-e62f-466f-b623-1cbe734ee83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:14.254266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c2529-e62f-466f-b623-1cbe734ee83e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:14.254544 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c2529-e62f-466f-b623-1cbe734ee83e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:14.256499 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c2529-e62f-466f-b623-1cbe734ee83e None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:14.258613 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c2529-e62f-466f-b623-1cbe734ee83e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:14.258924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c2529-e62f-466f-b623-1cbe734ee83e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:14.262475 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c2529-e62f-466f-b623-1cbe734ee83e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:14.281644 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 136/286] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:14.288270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c2529-e62f-466f-b623-1cbe734ee83e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:14.325060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:14.397742 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71019f81-48e5-41cc-a916-0bc275933bee None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:14.437297 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:14.479536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c2529-e62f-466f-b623-1cbe734ee83e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:14.479789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b33234-e015-487d-ab7c-85ea61762cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:14.480758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b33234-e015-487d-ab7c-85ea61762cca None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:14.481066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b33234-e015-487d-ab7c-85ea61762cca None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:14.481351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b33234-e015-487d-ab7c-85ea61762cca None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:14.482120 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b33234-e015-487d-ab7c-85ea61762cca None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:14.482430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b33234-e015-487d-ab7c-85ea61762cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:14.483836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b33234-e015-487d-ab7c-85ea61762cca None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:14.494085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 151/287] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:14.500119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b33234-e015-487d-ab7c-85ea61762cca None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:14.520290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32797b76-3214-430c-9da8-93019430d18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:14.521524 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32797b76-3214-430c-9da8-93019430d18e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:14.522007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32797b76-3214-430c-9da8-93019430d18e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:14.522501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32797b76-3214-430c-9da8-93019430d18e None admin] PATH_INFO: `/v3/users/7a6b1b071d4240b0a519c89ea7e65161` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:14.523897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32797b76-3214-430c-9da8-93019430d18e None admin] RBAC: Authorizing `identity:get_user(user_id=7a6b1b071d4240b0a519c89ea7e65161)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:14.525614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32797b76-3214-430c-9da8-93019430d18e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:14.527554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 137/288] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:14 2022] GET /identity/v3/users/7a6b1b071d4240b0a519c89ea7e65161 => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:14.533304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32797b76-3214-430c-9da8-93019430d18e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:14.620545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:14.638961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32797b76-3214-430c-9da8-93019430d18e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:14.697243 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfab45d-4d81-41dc-ae07-f23562068020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:14.698660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab45d-4d81-41dc-ae07-f23562068020 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:14.700138 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab45d-4d81-41dc-ae07-f23562068020 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:14.700767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab45d-4d81-41dc-ae07-f23562068020 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:14.703405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfab45d-4d81-41dc-ae07-f23562068020 None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:14.705230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfab45d-4d81-41dc-ae07-f23562068020 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:14.708163 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 138/289] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:14 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:14.711971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b33234-e015-487d-ab7c-85ea61762cca None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:14.726250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfab45d-4d81-41dc-ae07-f23562068020 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:14.775910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f0ecd-73ce-4ade-814e-2f4807d59a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:14.776690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0ecd-73ce-4ade-814e-2f4807d59a56 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:14.777527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0ecd-73ce-4ade-814e-2f4807d59a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:14.777805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0ecd-73ce-4ade-814e-2f4807d59a56 None admin] PATH_INFO: `/v3/users/861b6526b0384e0d87b18329ab6121cb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:14.781645 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f0ecd-73ce-4ade-814e-2f4807d59a56 None admin] RBAC: Authorizing `identity:get_user(user_id=861b6526b0384e0d87b18329ab6121cb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:14.783096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f0ecd-73ce-4ade-814e-2f4807d59a56 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:14.785075 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 152/290] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:14 2022] GET /identity/v3/users/861b6526b0384e0d87b18329ab6121cb => generated 297 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:14.790184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f0ecd-73ce-4ade-814e-2f4807d59a56 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:14.846205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfab45d-4d81-41dc-ae07-f23562068020 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:14.882232 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dbbfe-d0ce-4865-b584-062a1891df0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:14.883448 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dbbfe-d0ce-4865-b584-062a1891df0f None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:14.883929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dbbfe-d0ce-4865-b584-062a1891df0f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:14.884402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dbbfe-d0ce-4865-b584-062a1891df0f None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719/users/7a6b1b071d4240b0a519c89ea7e65161/roles/6a46f6859932445b83ab7334c94dbe9b` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:14.885593 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:14.893763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8dbbfe-d0ce-4865-b584-062a1891df0f None admin] RBAC: Authorizing `identity:create_grant(project_id=bf617240dd564a84b2b9fde284824719, user_id=7a6b1b071d4240b0a519c89ea7e65161, role_id=6a46f6859932445b83ab7334c94dbe9b)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:14.897803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8dbbfe-d0ce-4865-b584-062a1891df0f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:14.919624 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 139/291] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:16:14 2022] PUT /identity/v3/projects/bf617240dd564a84b2b9fde284824719/users/7a6b1b071d4240b0a519c89ea7e65161/roles/6a46f6859932445b83ab7334c94dbe9b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:14.977995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f0ecd-73ce-4ade-814e-2f4807d59a56 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:15.026796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99163f3-2563-4585-a16f-ee9743a35cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:15.028264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99163f3-2563-4585-a16f-ee9743a35cbb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:15.028756 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99163f3-2563-4585-a16f-ee9743a35cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:15.029250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99163f3-2563-4585-a16f-ee9743a35cbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:15.126303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99163f3-2563-4585-a16f-ee9743a35cbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:15.127837 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99163f3-2563-4585-a16f-ee9743a35cbb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:15.177738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:15.237603 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 153/292] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:16:15.242901 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dbbfe-d0ce-4865-b584-062a1891df0f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:15.264038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:15.361619 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dbbfe-d0ce-4865-b584-062a1891df0f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:15.396903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b9d9f-ffb6-43ad-a6da-b4a55f3f0e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:15.398141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b9d9f-ffb6-43ad-a6da-b4a55f3f0e20 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:15.398646 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b9d9f-ffb6-43ad-a6da-b4a55f3f0e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:15.399123 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b9d9f-ffb6-43ad-a6da-b4a55f3f0e20 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:15.400527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b9d9f-ffb6-43ad-a6da-b4a55f3f0e20 None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:15.402245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b9d9f-ffb6-43ad-a6da-b4a55f3f0e20 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:15.404808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 140/293] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:15 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:15.415125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99163f3-2563-4585-a16f-ee9743a35cbb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:15.550045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99163f3-2563-4585-a16f-ee9743a35cbb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:15.598514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ad27d-3799-4c1b-911b-d39f65a2807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:15.599577 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ad27d-3799-4c1b-911b-d39f65a2807c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:15.600060 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ad27d-3799-4c1b-911b-d39f65a2807c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:15.600532 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ad27d-3799-4c1b-911b-d39f65a2807c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:15.601665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ad27d-3799-4c1b-911b-d39f65a2807c None admin] RBAC: Adding query filter params (role.id=3b7272bb6de3425fa18a474080a9c1a2, scope.project.id=bf617240dd564a84b2b9fde284824719, user.id=861b6526b0384e0d87b18329ab6121cb) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:15.602192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ad27d-3799-4c1b-911b-d39f65a2807c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:15.603835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ad27d-3799-4c1b-911b-d39f65a2807c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:15.613732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 154/294] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:15 2022] GET /identity/v3/role_assignments?user.id=861b6526b0384e0d87b18329ab6121cb&scope.project.id=bf617240dd564a84b2b9fde284824719&role.id=3b7272bb6de3425fa18a474080a9c1a2 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:16.051139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff21018-9573-4742-9467-da3a1cae4cb7 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:16.051503 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff21018-9573-4742-9467-da3a1cae4cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:16.051698 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff21018-9573-4742-9467-da3a1cae4cb7 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:16.053408 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 141/295] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:16.063404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dcef1-9e1e-4889-8281-c9904603133d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:16.064388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dcef1-9e1e-4889-8281-c9904603133d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:16.064869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dcef1-9e1e-4889-8281-c9904603133d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:16.091813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-652dcef1-9e1e-4889-8281-c9904603133d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:16.093349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-652dcef1-9e1e-4889-8281-c9904603133d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:16.100946 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f660c-b854-4326-93ea-b373de9520fb None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:16.100946 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f660c-b854-4326-93ea-b373de9520fb None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:16.100946 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f660c-b854-4326-93ea-b373de9520fb None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:16.100946 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 142/296] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:16:16.103131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:16.110666 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a045556-02ec-491d-a196-c0406e5a3091 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:16.110956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a045556-02ec-491d-a196-c0406e5a3091 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:16.111238 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a045556-02ec-491d-a196-c0406e5a3091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:16.133769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-9a045556-02ec-491d-a196-c0406e5a3091 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:16.134956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9a045556-02ec-491d-a196-c0406e5a3091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:16.189661 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 155/297] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:16.191120 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cc260-b73f-4e48-a7b9-e507a83620b8 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:16.191411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cc260-b73f-4e48-a7b9-e507a83620b8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:16.191685 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cc260-b73f-4e48-a7b9-e507a83620b8 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:16.193076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 156/298] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:16.198118 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce780d-9be7-402b-aa93-e9b8be4b3e52 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:16.198401 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce780d-9be7-402b-aa93-e9b8be4b3e52 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:16.198710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce780d-9be7-402b-aa93-e9b8be4b3e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:16.217120 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-60ce780d-9be7-402b-aa93-e9b8be4b3e52 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:16.218309 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-60ce780d-9be7-402b-aa93-e9b8be4b3e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:16.219639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 143/299] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:16:16.220971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a045556-02ec-491d-a196-c0406e5a3091 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:16.235449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:16.293187 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 157/300] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:16:16.294051 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce780d-9be7-402b-aa93-e9b8be4b3e52 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:16.338503 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a045556-02ec-491d-a196-c0406e5a3091 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:16.370258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:16.374737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aec0c-20c1-4ac2-bce8-ef552167f233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:16.375532 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aec0c-20c1-4ac2-bce8-ef552167f233 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:16.376257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aec0c-20c1-4ac2-bce8-ef552167f233 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:16.376520 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aec0c-20c1-4ac2-bce8-ef552167f233 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:16.388313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aec0c-20c1-4ac2-bce8-ef552167f233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-0b1aec0c-20c1-4ac2-bce8-ef552167f233 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:16.396147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:16.397066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:16.397825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:16.397825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:16.397825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:16.397825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:16.397825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:16.397825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:16.397825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:16.397825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:16.397825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:16.397825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:16.397825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:16.397825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:16.397825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 144/301] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:16.398476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aec0c-20c1-4ac2-bce8-ef552167f233 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:16.407897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce780d-9be7-402b-aa93-e9b8be4b3e52 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:16.443388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f4407-f485-4324-8940-dd030dc713ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:16.444190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f4407-f485-4324-8940-dd030dc713ec None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:16.444472 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f4407-f485-4324-8940-dd030dc713ec None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:16.444768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f4407-f485-4324-8940-dd030dc713ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:16.455413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f4407-f485-4324-8940-dd030dc713ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-7b1f4407-f485-4324-8940-dd030dc713ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:16.463010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:16.464068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:16.465529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:16.465529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:16.465529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:16.465529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:16.465529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:16.465529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:16.465529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:16.465529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:16.465529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:16.465529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:16.465529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:16:16.465529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:16.465529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 158/302] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:16.466236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f4407-f485-4324-8940-dd030dc713ec None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:16.477395 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:16.511244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aec0c-20c1-4ac2-bce8-ef552167f233 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:16.546371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1e7ea-622f-4775-9728-a37600f21ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:16.547165 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1e7ea-622f-4775-9728-a37600f21ffd None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:16.547452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1e7ea-622f-4775-9728-a37600f21ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:16.547723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1e7ea-622f-4775-9728-a37600f21ffd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:16.548886 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1e7ea-622f-4775-9728-a37600f21ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:16.550336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1e7ea-622f-4775-9728-a37600f21ffd None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:16.551945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 145/303] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:16.552697 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1e7ea-622f-4775-9728-a37600f21ffd None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:16.593530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f4407-f485-4324-8940-dd030dc713ec None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:16.624318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:16.630778 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930970e-8feb-47f2-84a8-ff1ee69d793f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:16.631712 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930970e-8feb-47f2-84a8-ff1ee69d793f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:16.632139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930970e-8feb-47f2-84a8-ff1ee69d793f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:16.632583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930970e-8feb-47f2-84a8-ff1ee69d793f None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:16.633605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930970e-8feb-47f2-84a8-ff1ee69d793f None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:16.634077 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930970e-8feb-47f2-84a8-ff1ee69d793f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:16.635651 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930970e-8feb-47f2-84a8-ff1ee69d793f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:16.644574 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 159/304] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:16.645753 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930970e-8feb-47f2-84a8-ff1ee69d793f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:16.655963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1e7ea-622f-4775-9728-a37600f21ffd None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:16.692458 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7065151-d97f-470b-a95e-8a1fe1333ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:16.693480 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7065151-d97f-470b-a95e-8a1fe1333ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:16.693774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7065151-d97f-470b-a95e-8a1fe1333ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:16.694058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7065151-d97f-470b-a95e-8a1fe1333ab8 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:16.694813 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7065151-d97f-470b-a95e-8a1fe1333ab8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:16.695132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7065151-d97f-470b-a95e-8a1fe1333ab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:16.696499 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7065151-d97f-470b-a95e-8a1fe1333ab8 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:16.701696 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:16.706717 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 146/305] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:16.708085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7065151-d97f-470b-a95e-8a1fe1333ab8 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:16.765109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930970e-8feb-47f2-84a8-ff1ee69d793f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:16.804624 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7496fd4-7f2b-49c1-93d9-4d17eeacac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:16.805329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7496fd4-7f2b-49c1-93d9-4d17eeacac1a None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:16.805619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7496fd4-7f2b-49c1-93d9-4d17eeacac1a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:16.805913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7496fd4-7f2b-49c1-93d9-4d17eeacac1a None admin] PATH_INFO: `/v3/groups` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:16.806604 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7496fd4-7f2b-49c1-93d9-4d17eeacac1a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:16.808054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7496fd4-7f2b-49c1-93d9-4d17eeacac1a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:16.810642 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7065151-d97f-470b-a95e-8a1fe1333ab8 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:16.825931 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 160/306] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Jul 21 22:16:16 2022] POST /identity/v3/groups => generated 229 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:16:16.826558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7496fd4-7f2b-49c1-93d9-4d17eeacac1a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:16.866449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195da9c-d13a-40bd-98ec-4b2195b4a4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:16.867957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195da9c-d13a-40bd-98ec-4b2195b4a4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:16.868702 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195da9c-d13a-40bd-98ec-4b2195b4a4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:16.869715 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195da9c-d13a-40bd-98ec-4b2195b4a4d6 None admin] PATH_INFO: `/v3/users/12d07bb947d248258b06b6f49b2cc3a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:16.872489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195da9c-d13a-40bd-98ec-4b2195b4a4d6 None admin] RBAC: Authorizing `identity:get_user(user_id=12d07bb947d248258b06b6f49b2cc3a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:16.874958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195da9c-d13a-40bd-98ec-4b2195b4a4d6 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:16.878296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 147/307] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:16 2022] GET /identity/v3/users/12d07bb947d248258b06b6f49b2cc3a2 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:16.883738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195da9c-d13a-40bd-98ec-4b2195b4a4d6 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:16.911009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:16.970626 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7496fd4-7f2b-49c1-93d9-4d17eeacac1a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:16.990935 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:17.029559 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0c5ba-6b96-4b72-b029-9342e13adf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:17.030541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0c5ba-6b96-4b72-b029-9342e13adf5e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:17.030983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0c5ba-6b96-4b72-b029-9342e13adf5e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:17.031276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0c5ba-6b96-4b72-b029-9342e13adf5e None admin] PATH_INFO: `/v3/users/3f729dc8c47d4e7fb5971220ca1aff62` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:17.036873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195da9c-d13a-40bd-98ec-4b2195b4a4d6 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:17.048782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0c5ba-6b96-4b72-b029-9342e13adf5e None admin] RBAC: Authorizing `identity:get_user(user_id=3f729dc8c47d4e7fb5971220ca1aff62)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:17.050397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0c5ba-6b96-4b72-b029-9342e13adf5e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:17.052237 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 161/308] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:16 2022] GET /identity/v3/users/3f729dc8c47d4e7fb5971220ca1aff62 => generated 293 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:17.057736 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0c5ba-6b96-4b72-b029-9342e13adf5e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:17.083927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc26f6-c23f-49de-ae2a-ddedd9644cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:17.085071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc26f6-c23f-49de-ae2a-ddedd9644cc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:17.085500 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc26f6-c23f-49de-ae2a-ddedd9644cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:17.086063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc26f6-c23f-49de-ae2a-ddedd9644cc3 None admin] PATH_INFO: `/v3/system/users/12d07bb947d248258b06b6f49b2cc3a2/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:17.087808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc26f6-c23f-49de-ae2a-ddedd9644cc3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=12d07bb947d248258b06b6f49b2cc3a2, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:17.090002 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc26f6-c23f-49de-ae2a-ddedd9644cc3 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:17.102635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 148/309] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Jul 21 22:16:16 2022] PUT /identity/v3/system/users/12d07bb947d248258b06b6f49b2cc3a2/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:17.172459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0c5ba-6b96-4b72-b029-9342e13adf5e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:17.187425 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:17.209653 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3977763-7499-4e24-a84b-1f55e0c29863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:17.210325 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3977763-7499-4e24-a84b-1f55e0c29863 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:17.210605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3977763-7499-4e24-a84b-1f55e0c29863 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:17.210880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3977763-7499-4e24-a84b-1f55e0c29863 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:17.211720 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3977763-7499-4e24-a84b-1f55e0c29863 None admin] RBAC: Adding query filter params (role.id=6a46f6859932445b83ab7334c94dbe9b, user.id=3f729dc8c47d4e7fb5971220ca1aff62, scope.system=all) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:17.212030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3977763-7499-4e24-a84b-1f55e0c29863 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:17.213527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3977763-7499-4e24-a84b-1f55e0c29863 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:17.220506 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 162/310] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Jul 21 22:16:17 2022] GET /identity/v3/role_assignments?user.id=3f729dc8c47d4e7fb5971220ca1aff62&scope.system=all&role.id=6a46f6859932445b83ab7334c94dbe9b => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:17.296651 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79eb63d-5fc1-4398-813d-6f8df7a7d2fd None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:17.296987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79eb63d-5fc1-4398-813d-6f8df7a7d2fd None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:17.297256 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79eb63d-5fc1-4398-813d-6f8df7a7d2fd None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:17.298680 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 149/311] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:17.304346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c5c06-28d1-4853-8740-06dc6e5042b2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:17.304645 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c5c06-28d1-4853-8740-06dc6e5042b2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:17.304915 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c5c06-28d1-4853-8740-06dc6e5042b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:17.322470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d05c5c06-28d1-4853-8740-06dc6e5042b2 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:17.324217 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d05c5c06-28d1-4853-8740-06dc6e5042b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:17.397058 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 163/312] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:17.421648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79eb63d-5fc1-4398-813d-6f8df7a7d2fd None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:17.525271 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79eb63d-5fc1-4398-813d-6f8df7a7d2fd None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:17.555790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:17.560978 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24cb16-a807-403c-ad47-26ef44e291b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:17.562001 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24cb16-a807-403c-ad47-26ef44e291b4 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:17.562544 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24cb16-a807-403c-ad47-26ef44e291b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:17.563007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24cb16-a807-403c-ad47-26ef44e291b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:17.575936 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24cb16-a807-403c-ad47-26ef44e291b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-8f24cb16-a807-403c-ad47-26ef44e291b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:17.583982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:17.584863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:17.585684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:17.585684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:17.585684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:17.585684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:17.585684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:17.585684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:17.585684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:17.585684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:17.585684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:17.585684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:17.585684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:16:17.585684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:17.585684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 150/313] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:17.591469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c5c06-28d1-4853-8740-06dc6e5042b2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:17.696516 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c5c06-28d1-4853-8740-06dc6e5042b2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:17.704250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:17.732896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caf670-e4f8-4a04-827c-1c069fb2c199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:17.733590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caf670-e4f8-4a04-827c-1c069fb2c199 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:17.733876 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caf670-e4f8-4a04-827c-1c069fb2c199 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:17.734160 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caf670-e4f8-4a04-827c-1c069fb2c199 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:17.734911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caf670-e4f8-4a04-827c-1c069fb2c199 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:17.735222 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caf670-e4f8-4a04-827c-1c069fb2c199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:17.736609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caf670-e4f8-4a04-827c-1c069fb2c199 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:17.745740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 164/314] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:17.751204 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24cb16-a807-403c-ad47-26ef44e291b4 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:17.854537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24cb16-a807-403c-ad47-26ef44e291b4 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:17.888435 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0812004-2963-4cd2-8b1e-e22ed4ff2a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:17.889335 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0812004-2963-4cd2-8b1e-e22ed4ff2a8d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:17.889619 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0812004-2963-4cd2-8b1e-e22ed4ff2a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:17.889898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0812004-2963-4cd2-8b1e-e22ed4ff2a8d None admin] PATH_INFO: `/v3/users/7a6b1b071d4240b0a519c89ea7e65161` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:17.891097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0812004-2963-4cd2-8b1e-e22ed4ff2a8d None admin] RBAC: Authorizing `identity:get_user(user_id=7a6b1b071d4240b0a519c89ea7e65161)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:17.892539 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0812004-2963-4cd2-8b1e-e22ed4ff2a8d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:17.894546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 151/315] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:17 2022] GET /identity/v3/users/7a6b1b071d4240b0a519c89ea7e65161 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:17.899695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caf670-e4f8-4a04-827c-1c069fb2c199 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:18.008911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caf670-e4f8-4a04-827c-1c069fb2c199 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:18.045847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b9972-7db8-4f35-8eeb-159a5b603093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:18.046521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b9972-7db8-4f35-8eeb-159a5b603093 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:18.046809 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b9972-7db8-4f35-8eeb-159a5b603093 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:18.047090 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b9972-7db8-4f35-8eeb-159a5b603093 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:18.085348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:18.122562 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b9972-7db8-4f35-8eeb-159a5b603093 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:18.123946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b9972-7db8-4f35-8eeb-159a5b603093 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:18.228138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 165/316] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:18.234068 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0812004-2963-4cd2-8b1e-e22ed4ff2a8d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:18.298639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:18.339673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0812004-2963-4cd2-8b1e-e22ed4ff2a8d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:18.374187 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e69190-f0f9-4b2e-8ed5-48e9b6661588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:18.374963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e69190-f0f9-4b2e-8ed5-48e9b6661588 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:18.375243 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e69190-f0f9-4b2e-8ed5-48e9b6661588 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:18.375517 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e69190-f0f9-4b2e-8ed5-48e9b6661588 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:18.376700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e69190-f0f9-4b2e-8ed5-48e9b6661588 None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:18.378172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e69190-f0f9-4b2e-8ed5-48e9b6661588 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:18.380233 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 152/317] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:18 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:18.386005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b9972-7db8-4f35-8eeb-159a5b603093 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:18.458351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:18.495452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b9972-7db8-4f35-8eeb-159a5b603093 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:18.531517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee8460-8d93-4588-8ae0-b4f6cb4938e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:18.532670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee8460-8d93-4588-8ae0-b4f6cb4938e9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:18.533257 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee8460-8d93-4588-8ae0-b4f6cb4938e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:18.533851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee8460-8d93-4588-8ae0-b4f6cb4938e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:18.535065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee8460-8d93-4588-8ae0-b4f6cb4938e9 None admin] RBAC: Adding query filter params (role.id=6a46f6859932445b83ab7334c94dbe9b, scope.project.id=bf617240dd564a84b2b9fde284824719, user.id=7a6b1b071d4240b0a519c89ea7e65161) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:18.535600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee8460-8d93-4588-8ae0-b4f6cb4938e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:18.537402 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee8460-8d93-4588-8ae0-b4f6cb4938e9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:18.545339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 166/318] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:18 2022] GET /identity/v3/role_assignments?user.id=7a6b1b071d4240b0a519c89ea7e65161&scope.project.id=bf617240dd564a84b2b9fde284824719&role.id=6a46f6859932445b83ab7334c94dbe9b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:19.054333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcde2f-7028-4b7c-9a82-573366bea8e1 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:19.054855 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcde2f-7028-4b7c-9a82-573366bea8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:19.054938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcde2f-7028-4b7c-9a82-573366bea8e1 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:19.056401 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 153/319] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:19.063113 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39f8d6-b6aa-4fcf-9dd5-3c93017a7f46 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:19.063403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39f8d6-b6aa-4fcf-9dd5-3c93017a7f46 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:19.063681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39f8d6-b6aa-4fcf-9dd5-3c93017a7f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:19.089360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8f39f8d6-b6aa-4fcf-9dd5-3c93017a7f46 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:19.090582 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8f39f8d6-b6aa-4fcf-9dd5-3c93017a7f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:19.164009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 167/320] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:16:19.183666 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcde2f-7028-4b7c-9a82-573366bea8e1 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:19.245723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e95ced-29ef-4ec6-bcb4-6aa5d74088ae None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:19.246242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e95ced-29ef-4ec6-bcb4-6aa5d74088ae None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:19.246328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e95ced-29ef-4ec6-bcb4-6aa5d74088ae None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:19.247640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 168/321] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:16:19.252590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d6634-d202-4f78-8bf1-04d1011ed3d5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:19.252885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d6634-d202-4f78-8bf1-04d1011ed3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:19.253207 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d6634-d202-4f78-8bf1-04d1011ed3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:19.270868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2d9d6634-d202-4f78-8bf1-04d1011ed3d5 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:19.272030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2d9d6634-d202-4f78-8bf1-04d1011ed3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:19.292043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcde2f-7028-4b7c-9a82-573366bea8e1 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:19.319775 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:19.328334 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a3d24-0952-45e3-b00e-27c347447c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:19.329168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a3d24-0952-45e3-b00e-27c347447c13 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:19.329460 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a3d24-0952-45e3-b00e-27c347447c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:19.329743 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a3d24-0952-45e3-b00e-27c347447c13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:19.330902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a3d24-0952-45e3-b00e-27c347447c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:19.332361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a3d24-0952-45e3-b00e-27c347447c13 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:19.333108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:19.334050 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 154/322] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:19.340549 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a3d24-0952-45e3-b00e-27c347447c13 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:19.345076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 169/323] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:16:19.368562 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d6634-d202-4f78-8bf1-04d1011ed3d5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:19.441282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a3d24-0952-45e3-b00e-27c347447c13 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:19.463217 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d6634-d202-4f78-8bf1-04d1011ed3d5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:19.474319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e2f5e-0c5e-4532-ab7d-41894ade2567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:19.474989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e2f5e-0c5e-4532-ab7d-41894ade2567 None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:19.475274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e2f5e-0c5e-4532-ab7d-41894ade2567 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:19.475553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e2f5e-0c5e-4532-ab7d-41894ade2567 None admin] PATH_INFO: `/v3/groups` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:19.476238 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e2f5e-0c5e-4532-ab7d-41894ade2567 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:19.477711 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e2f5e-0c5e-4532-ab7d-41894ade2567 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:19.492394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 155/324] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Jul 21 22:16:19 2022] POST /identity/v3/groups => generated 226 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:16:19.493854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb6a67-e445-4209-b0ea-9a2e9dad2db1 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:19.494147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb6a67-e445-4209-b0ea-9a2e9dad2db1 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:19.494429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb6a67-e445-4209-b0ea-9a2e9dad2db1 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:19.495728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 156/325] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:19.501461 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f6720-de94-4577-8114-1a6fe308bcf9 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:19.501798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f6720-de94-4577-8114-1a6fe308bcf9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:19.502033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f6720-de94-4577-8114-1a6fe308bcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:19.505074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325898e5-8f53-4000-b9a8-6128d97533ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:19.505891 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325898e5-8f53-4000-b9a8-6128d97533ad None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:19.506232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325898e5-8f53-4000-b9a8-6128d97533ad None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:19.506511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325898e5-8f53-4000-b9a8-6128d97533ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:19.518369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325898e5-8f53-4000-b9a8-6128d97533ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:19.525819 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-c90f6720-de94-4577-8114-1a6fe308bcf9 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-325898e5-8f53-4000-b9a8-6128d97533ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:19.526192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:19.527541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:19.528641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:19.528641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:19.528641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:19.528641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:19.528641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:19.528641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:19.528641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:19.528641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:19.528641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:19.528641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:19.528641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:19.528641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:19.529744 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c90f6720-de94-4577-8114-1a6fe308bcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:19.529815 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 170/326] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:16:19.534459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325898e5-8f53-4000-b9a8-6128d97533ad None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:19.586173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:19.596336 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:19.606478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 157/327] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:16:19.628954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f6720-de94-4577-8114-1a6fe308bcf9 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:19.650500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325898e5-8f53-4000-b9a8-6128d97533ad None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:19.687272 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb68a7-6149-414c-be31-b0570ce9b736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:19.687515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb68a7-6149-414c-be31-b0570ce9b736 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:19.687797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb68a7-6149-414c-be31-b0570ce9b736 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:19.688080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb68a7-6149-414c-be31-b0570ce9b736 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:19.688830 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb68a7-6149-414c-be31-b0570ce9b736 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:19.689187 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb68a7-6149-414c-be31-b0570ce9b736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:19.690577 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb68a7-6149-414c-be31-b0570ce9b736 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:19.699311 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 171/328] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:19.705287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb68a7-6149-414c-be31-b0570ce9b736 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:19.749026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f6720-de94-4577-8114-1a6fe308bcf9 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:19.785646 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b0a4b-65a7-49b3-9df7-4747f194073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:19.786451 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b0a4b-65a7-49b3-9df7-4747f194073c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:19.786730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b0a4b-65a7-49b3-9df7-4747f194073c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:19.787001 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b0a4b-65a7-49b3-9df7-4747f194073c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:19.797803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b0a4b-65a7-49b3-9df7-4747f194073c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-4e7b0a4b-65a7-49b3-9df7-4747f194073c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:19.805564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:19.806655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:19.807622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:19.807622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:19.807622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:19.807622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:19.807622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:19.807622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:19.807622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:19.807622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:19.807622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:19.807622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:19.807622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:16:19.807622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:19.807622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 158/329] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:16:19.813211 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b0a4b-65a7-49b3-9df7-4747f194073c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:19.831893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb68a7-6149-414c-be31-b0570ce9b736 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:19.848680 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:19.877913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:19.882928 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947f817-142d-4643-8b4e-0997ee5badf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:19.883818 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947f817-142d-4643-8b4e-0997ee5badf8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:19.884106 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947f817-142d-4643-8b4e-0997ee5badf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:19.884380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947f817-142d-4643-8b4e-0997ee5badf8 None admin] PATH_INFO: `/v3/users/12d07bb947d248258b06b6f49b2cc3a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:19.887425 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947f817-142d-4643-8b4e-0997ee5badf8 None admin] RBAC: Authorizing `identity:get_user(user_id=12d07bb947d248258b06b6f49b2cc3a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:19.888916 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947f817-142d-4643-8b4e-0997ee5badf8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:19.890741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 172/330] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:19 2022] GET /identity/v3/users/12d07bb947d248258b06b6f49b2cc3a2 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:19.896733 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947f817-142d-4643-8b4e-0997ee5badf8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:19.953504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b0a4b-65a7-49b3-9df7-4747f194073c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:19.996152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a86b42-7add-481e-bd42-4c049c09cb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:19.997510 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a86b42-7add-481e-bd42-4c049c09cb24 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:19.997937 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a86b42-7add-481e-bd42-4c049c09cb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:19.998685 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a86b42-7add-481e-bd42-4c049c09cb24 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:19.999587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a86b42-7add-481e-bd42-4c049c09cb24 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:20.000312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a86b42-7add-481e-bd42-4c049c09cb24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:20.002372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a86b42-7add-481e-bd42-4c049c09cb24 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:20.019869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 159/331] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:20.021505 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a86b42-7add-481e-bd42-4c049c09cb24 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:20.030908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947f817-142d-4643-8b4e-0997ee5badf8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:20.099456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bc869-6e4a-4954-a4f3-007e2ef8b76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:20.100316 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bc869-6e4a-4954-a4f3-007e2ef8b76c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:20.100721 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bc869-6e4a-4954-a4f3-007e2ef8b76c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:20.101148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bc869-6e4a-4954-a4f3-007e2ef8b76c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:20.102110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bc869-6e4a-4954-a4f3-007e2ef8b76c None admin] RBAC: Adding query filter params (role.id=3b7272bb6de3425fa18a474080a9c1a2, user.id=12d07bb947d248258b06b6f49b2cc3a2, scope.system=all) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:20.102530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bc869-6e4a-4954-a4f3-007e2ef8b76c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:20.104391 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bc869-6e4a-4954-a4f3-007e2ef8b76c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:20.120444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 173/332] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Jul 21 22:16:19 2022] GET /identity/v3/role_assignments?user.id=12d07bb947d248258b06b6f49b2cc3a2&scope.system=all&role.id=3b7272bb6de3425fa18a474080a9c1a2 => generated 510 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:20.161653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a86b42-7add-481e-bd42-4c049c09cb24 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:20.175480 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:20.207021 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7ffbd-ea77-4cc2-ae8a-fc19fe6265ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:20.208244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7ffbd-ea77-4cc2-ae8a-fc19fe6265ea None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:20.208666 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7ffbd-ea77-4cc2-ae8a-fc19fe6265ea None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:20.209121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7ffbd-ea77-4cc2-ae8a-fc19fe6265ea None admin] PATH_INFO: `/v3/users/3f729dc8c47d4e7fb5971220ca1aff62` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:20.210547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7ffbd-ea77-4cc2-ae8a-fc19fe6265ea None admin] RBAC: Authorizing `identity:get_user(user_id=3f729dc8c47d4e7fb5971220ca1aff62)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:20.212196 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7ffbd-ea77-4cc2-ae8a-fc19fe6265ea None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:20.215959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 160/333] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:20 2022] GET /identity/v3/users/3f729dc8c47d4e7fb5971220ca1aff62 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:20.221258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bc869-6e4a-4954-a4f3-007e2ef8b76c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:20.282484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:20.350503 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bc869-6e4a-4954-a4f3-007e2ef8b76c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:20.391405 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dbbf5-4940-41b8-81ee-e7d420a27343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:20.392290 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dbbf5-4940-41b8-81ee-e7d420a27343 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:20.392575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dbbf5-4940-41b8-81ee-e7d420a27343 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:20.392854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dbbf5-4940-41b8-81ee-e7d420a27343 None admin] PATH_INFO: `/v3/system/users/3f729dc8c47d4e7fb5971220ca1aff62/roles/6a46f6859932445b83ab7334c94dbe9b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:20.394397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dbbf5-4940-41b8-81ee-e7d420a27343 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3f729dc8c47d4e7fb5971220ca1aff62, role_id=6a46f6859932445b83ab7334c94dbe9b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:20.395783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dbbf5-4940-41b8-81ee-e7d420a27343 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:20.407874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 174/334] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Jul 21 22:16:20 2022] PUT /identity/v3/system/users/3f729dc8c47d4e7fb5971220ca1aff62/roles/6a46f6859932445b83ab7334c94dbe9b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:22.346776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6da5b-6693-46c9-8f2d-3c62e50c6756 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:22.347805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6da5b-6693-46c9-8f2d-3c62e50c6756 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:22.348285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6da5b-6693-46c9-8f2d-3c62e50c6756 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:22.350202 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 161/335] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:22.355170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa5a0d-f442-47ba-acf7-b35b7b17648c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:22.355996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa5a0d-f442-47ba-acf7-b35b7b17648c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:22.356483 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa5a0d-f442-47ba-acf7-b35b7b17648c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:22.368056 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434293a8-2690-4d38-a3a9-18d28112fda7 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:22.368670 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434293a8-2690-4d38-a3a9-18d28112fda7 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:22.369182 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434293a8-2690-4d38-a3a9-18d28112fda7 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:22.371293 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 162/336] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:16:22.376347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717334-3f11-42d2-9373-9bfdbb44121c None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:22.376869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717334-3f11-42d2-9373-9bfdbb44121c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:22.377399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66717334-3f11-42d2-9373-9bfdbb44121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:22.395629 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-01fa5a0d-f442-47ba-acf7-b35b7b17648c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:22.397156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-01fa5a0d-f442-47ba-acf7-b35b7b17648c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:22.407300 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-66717334-3f11-42d2-9373-9bfdbb44121c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:22.413092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-66717334-3f11-42d2-9373-9bfdbb44121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:22.510328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 175/337] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:22.547477 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa5a0d-f442-47ba-acf7-b35b7b17648c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:22.550593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 163/338] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:16:22.552167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e3324-89e8-402b-bf96-ffbf7a963695 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:22.552594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e3324-89e8-402b-bf96-ffbf7a963695 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:22.553060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e3324-89e8-402b-bf96-ffbf7a963695 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:22.554486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 164/339] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:22.570639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641d46f-c509-4726-b9f2-d33c5392e3d0 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:22.571144 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641d46f-c509-4726-b9f2-d33c5392e3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:22.571561 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641d46f-c509-4726-b9f2-d33c5392e3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:22.595772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-0641d46f-c509-4726-b9f2-d33c5392e3d0 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:22.597295 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0641d46f-c509-4726-b9f2-d33c5392e3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:22.599991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:22.664155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa5a0d-f442-47ba-acf7-b35b7b17648c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:22.696038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 165/340] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:22.697290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641d46f-c509-4726-b9f2-d33c5392e3d0 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:22.703175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fffb44-6877-45c6-8dd3-9f1b80106ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:22.708952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fffb44-6877-45c6-8dd3-9f1b80106ebb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:22.708952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fffb44-6877-45c6-8dd3-9f1b80106ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:22.708952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fffb44-6877-45c6-8dd3-9f1b80106ebb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:22.716032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fffb44-6877-45c6-8dd3-9f1b80106ebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-f3fffb44-6877-45c6-8dd3-9f1b80106ebb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:22.724468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:22.728843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:22.729675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:22.729675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:22.729675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:22.729675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:22.729675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:22.729675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:22.729675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:22.729675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:22.729675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:22.729675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:22.729675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:22.729675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:22.729675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 176/341] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:16:22.732284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fffb44-6877-45c6-8dd3-9f1b80106ebb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:22.752621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:22.827959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641d46f-c509-4726-b9f2-d33c5392e3d0 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:22.854158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fffb44-6877-45c6-8dd3-9f1b80106ebb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:22.863652 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:22.867056 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e789a-3c0e-4d67-baf6-d0c0469be67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:22.868007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e789a-3c0e-4d67-baf6-d0c0469be67f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:22.868389 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e789a-3c0e-4d67-baf6-d0c0469be67f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:22.868791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e789a-3c0e-4d67-baf6-d0c0469be67f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:22.883719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e789a-3c0e-4d67-baf6-d0c0469be67f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-747e789a-3c0e-4d67-baf6-d0c0469be67f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:22.893554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:22.894626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:22.895428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:22.895428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:22.895428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:22.895428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:22.895428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:22.895428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:22.895428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:22.895428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:22.895428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:22.895428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:22.895428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:22.895428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:22.895428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 166/342] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:16:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:22.896653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e789a-3c0e-4d67-baf6-d0c0469be67f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:22.906000 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645dc4c-e0f9-4f6e-86ca-2c14a37f74e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:22.906683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645dc4c-e0f9-4f6e-86ca-2c14a37f74e0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:22.906966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645dc4c-e0f9-4f6e-86ca-2c14a37f74e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:22.907243 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645dc4c-e0f9-4f6e-86ca-2c14a37f74e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:22.907999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645dc4c-e0f9-4f6e-86ca-2c14a37f74e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:22.908307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645dc4c-e0f9-4f6e-86ca-2c14a37f74e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:22.909855 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645dc4c-e0f9-4f6e-86ca-2c14a37f74e0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:22.919553 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 177/343] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:22.920459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645dc4c-e0f9-4f6e-86ca-2c14a37f74e0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:23.001752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:23.007790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e789a-3c0e-4d67-baf6-d0c0469be67f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:23.042029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645dc4c-e0f9-4f6e-86ca-2c14a37f74e0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:23.045387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aa016-581c-4d09-b2db-eab20fb7c2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:23.046307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aa016-581c-4d09-b2db-eab20fb7c2cb None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:23.046589 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aa016-581c-4d09-b2db-eab20fb7c2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:23.046864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aa016-581c-4d09-b2db-eab20fb7c2cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:23.063524 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631aa016-581c-4d09-b2db-eab20fb7c2cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-631aa016-581c-4d09-b2db-eab20fb7c2cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:23.077867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:23.078814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:23.079611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:23.079611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:23.079611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:23.079611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:23.079611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:23.079611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:23.079611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:23.079611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:23.079611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:23.079611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:23.079611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:23.079611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:23.079611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 167/344] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:23.080290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aa016-581c-4d09-b2db-eab20fb7c2cb None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:23.084950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a48c6-9038-46c5-ba99-e7d81617e263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:23.084950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a48c6-9038-46c5-ba99-e7d81617e263 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:23.084950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a48c6-9038-46c5-ba99-e7d81617e263 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:23.084950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a48c6-9038-46c5-ba99-e7d81617e263 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:23.085252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a48c6-9038-46c5-ba99-e7d81617e263 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:23.086873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a48c6-9038-46c5-ba99-e7d81617e263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:23.088262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a48c6-9038-46c5-ba99-e7d81617e263 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:23.098523 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 178/345] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:23.100350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46699e-35e7-4771-a5fb-dedb9677ad0e None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:23.100642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46699e-35e7-4771-a5fb-dedb9677ad0e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:23.100920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46699e-35e7-4771-a5fb-dedb9677ad0e None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:23.103152 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 179/346] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:23.103975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46699e-35e7-4771-a5fb-dedb9677ad0e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:23.133458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:23.226999 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aa016-581c-4d09-b2db-eab20fb7c2cb None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:23.247056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46699e-35e7-4771-a5fb-dedb9677ad0e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:23.273351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051693a-9f03-4722-b11a-d981c0c3edf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:23.274014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051693a-9f03-4722-b11a-d981c0c3edf3 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:23.274297 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051693a-9f03-4722-b11a-d981c0c3edf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:23.274573 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051693a-9f03-4722-b11a-d981c0c3edf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:23.289788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0fcdc-39bc-4bef-b8af-beeefae482f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:23.290686 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0fcdc-39bc-4bef-b8af-beeefae482f9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:23.290795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0fcdc-39bc-4bef-b8af-beeefae482f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:23.291057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0fcdc-39bc-4bef-b8af-beeefae482f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:23.291895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0fcdc-39bc-4bef-b8af-beeefae482f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:23.292161 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0fcdc-39bc-4bef-b8af-beeefae482f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:23.294752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0fcdc-39bc-4bef-b8af-beeefae482f9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:23.304796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 180/347] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:23.306075 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0fcdc-39bc-4bef-b8af-beeefae482f9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:23.317457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:23.365663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051693a-9f03-4722-b11a-d981c0c3edf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:23.367158 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051693a-9f03-4722-b11a-d981c0c3edf3 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:23.421916 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:23.446274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0fcdc-39bc-4bef-b8af-beeefae482f9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:23.484219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f9387-86fe-469c-8924-44814c2cc687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:23.484876 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f9387-86fe-469c-8924-44814c2cc687 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:23.485202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f9387-86fe-469c-8924-44814c2cc687 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:23.485479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f9387-86fe-469c-8924-44814c2cc687 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:23.507713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 168/348] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:23.509785 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02649313-db6b-414d-997b-1797f8e43395 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:23.510274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02649313-db6b-414d-997b-1797f8e43395 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:23.510743 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02649313-db6b-414d-997b-1797f8e43395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:23.535993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-02649313-db6b-414d-997b-1797f8e43395 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:23.537644 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-02649313-db6b-414d-997b-1797f8e43395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:23.566065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f9387-86fe-469c-8924-44814c2cc687 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:23.567606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f9387-86fe-469c-8924-44814c2cc687 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:23.598552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:23.616259 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 169/349] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:23.617710 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02649313-db6b-414d-997b-1797f8e43395 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:23.654753 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:23.678349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 181/350] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:23.679210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f9387-86fe-469c-8924-44814c2cc687 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:23.727205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02649313-db6b-414d-997b-1797f8e43395 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:23.763787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e7ea4-2cbb-499c-9ca4-a8ec5645aa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:23.764909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e7ea4-2cbb-499c-9ca4-a8ec5645aa6f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:23.765533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e7ea4-2cbb-499c-9ca4-a8ec5645aa6f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:23.766029 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e7ea4-2cbb-499c-9ca4-a8ec5645aa6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:23.786734 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f9387-86fe-469c-8924-44814c2cc687 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:23.822076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19804e-3024-4cb6-bcae-772fa0ab7536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:23.823136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19804e-3024-4cb6-bcae-772fa0ab7536 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:23.823253 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19804e-3024-4cb6-bcae-772fa0ab7536 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:23.823590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19804e-3024-4cb6-bcae-772fa0ab7536 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:23.825284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19804e-3024-4cb6-bcae-772fa0ab7536 None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:23.826869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19804e-3024-4cb6-bcae-772fa0ab7536 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:23.829025 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 182/351] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:23 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:23.830032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19804e-3024-4cb6-bcae-772fa0ab7536 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:23.833354 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:23.846475 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e7ea4-2cbb-499c-9ca4-a8ec5645aa6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:23.848482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e7ea4-2cbb-499c-9ca4-a8ec5645aa6f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:23.891216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:23.960700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19804e-3024-4cb6-bcae-772fa0ab7536 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:23.979397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 170/352] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:23.982560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e7ea4-2cbb-499c-9ca4-a8ec5645aa6f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:24.012954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d84bb-0de6-4024-9075-e5574d3bd6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:24.014375 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d84bb-0de6-4024-9075-e5574d3bd6ea None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:24.014375 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d84bb-0de6-4024-9075-e5574d3bd6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:24.014751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d84bb-0de6-4024-9075-e5574d3bd6ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:24.033546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d84bb-0de6-4024-9075-e5574d3bd6ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3d4d84bb-0de6-4024-9075-e5574d3bd6ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:24.043643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:24.044996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:24.046304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:24.046304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:24.046304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:24.046304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:24.046304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:24.046304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:24.046304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:24.046304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:24.046304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:24.046304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:24.046304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 22:16:24.046304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:24.046304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 183/353] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:24.046304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d84bb-0de6-4024-9075-e5574d3bd6ea None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:24.096916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:24.117290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e7ea4-2cbb-499c-9ca4-a8ec5645aa6f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:24.163881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8326b41-f17f-42f1-ae34-404886c55571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:24.164896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8326b41-f17f-42f1-ae34-404886c55571 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:24.165208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8326b41-f17f-42f1-ae34-404886c55571 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:24.165535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8326b41-f17f-42f1-ae34-404886c55571 None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:24.169319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8326b41-f17f-42f1-ae34-404886c55571 None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:24.170408 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8326b41-f17f-42f1-ae34-404886c55571 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:24.172169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 171/354] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:23 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:24.173576 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c822f8-f6ac-4d12-9294-156d7b8d1543 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:24.173866 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c822f8-f6ac-4d12-9294-156d7b8d1543 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:24.174146 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c822f8-f6ac-4d12-9294-156d7b8d1543 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:24.175374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 172/355] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:24.176067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c822f8-f6ac-4d12-9294-156d7b8d1543 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:24.181831 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d84bb-0de6-4024-9075-e5574d3bd6ea None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:24.193476 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:24.226039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de854ff-9488-4ef6-961a-1750022e6e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:24.226935 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de854ff-9488-4ef6-961a-1750022e6e3d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:24.227216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de854ff-9488-4ef6-961a-1750022e6e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:24.227487 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de854ff-9488-4ef6-961a-1750022e6e3d None admin] PATH_INFO: `/v3/groups/a946f3adcb454b468eaf2a2f877f90ff` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:24.233831 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de854ff-9488-4ef6-961a-1750022e6e3d None admin] RBAC: Authorizing `identity:get_group(group_id=a946f3adcb454b468eaf2a2f877f90ff)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:24.235288 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de854ff-9488-4ef6-961a-1750022e6e3d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:24.237775 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 184/356] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jul 21 22:16:24 2022] GET /identity/v3/groups/a946f3adcb454b468eaf2a2f877f90ff => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:24.238612 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de854ff-9488-4ef6-961a-1750022e6e3d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:24.304579 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c822f8-f6ac-4d12-9294-156d7b8d1543 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:24.346509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac41a5-4dd8-4337-941c-21549017db50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:24.347403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac41a5-4dd8-4337-941c-21549017db50 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:24.347681 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac41a5-4dd8-4337-941c-21549017db50 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:24.347955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac41a5-4dd8-4337-941c-21549017db50 None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:24.349188 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac41a5-4dd8-4337-941c-21549017db50 None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:24.350686 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac41a5-4dd8-4337-941c-21549017db50 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:24.352713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 173/357] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:24 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:24.353528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac41a5-4dd8-4337-941c-21549017db50 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:24.376218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de854ff-9488-4ef6-961a-1750022e6e3d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:24.381452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:24.424725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36a531-474e-4350-8ed2-f2774b0aa745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:24.425473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36a531-474e-4350-8ed2-f2774b0aa745 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:24.425980 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36a531-474e-4350-8ed2-f2774b0aa745 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:24.426290 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36a531-474e-4350-8ed2-f2774b0aa745 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:24.427051 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36a531-474e-4350-8ed2-f2774b0aa745 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:24.427364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36a531-474e-4350-8ed2-f2774b0aa745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:24.428740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36a531-474e-4350-8ed2-f2774b0aa745 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:24.438373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 185/358] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:24.439459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ddce-0bae-4b93-8d45-b505202de46d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:24.440482 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ddce-0bae-4b93-8d45-b505202de46d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:24.440482 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ddce-0bae-4b93-8d45-b505202de46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:24.456713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2122ddce-0bae-4b93-8d45-b505202de46d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:24.457967 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2122ddce-0bae-4b93-8d45-b505202de46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:24.477645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac41a5-4dd8-4337-941c-21549017db50 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:24.494433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:24.514727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999600ba-1168-44db-ba75-4bbd5785e56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:24.515590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999600ba-1168-44db-ba75-4bbd5785e56d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:24.516023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999600ba-1168-44db-ba75-4bbd5785e56d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:24.516134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999600ba-1168-44db-ba75-4bbd5785e56d None admin] PATH_INFO: `/v3/groups/a946f3adcb454b468eaf2a2f877f90ff` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:24.517352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999600ba-1168-44db-ba75-4bbd5785e56d None admin] RBAC: Authorizing `identity:get_group(group_id=a946f3adcb454b468eaf2a2f877f90ff)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:24.518783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999600ba-1168-44db-ba75-4bbd5785e56d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:24.520982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 174/359] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jul 21 22:16:24 2022] GET /identity/v3/groups/a946f3adcb454b468eaf2a2f877f90ff => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:24.521368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999600ba-1168-44db-ba75-4bbd5785e56d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:24.542906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 186/360] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:24.543975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122ddce-0bae-4b93-8d45-b505202de46d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:24.634266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:24.647099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999600ba-1168-44db-ba75-4bbd5785e56d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:24.665431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122ddce-0bae-4b93-8d45-b505202de46d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:24.688636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c019263-2685-4a4c-886b-8739fb52d52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:24.689331 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c019263-2685-4a4c-886b-8739fb52d52e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:24.689620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c019263-2685-4a4c-886b-8739fb52d52e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:24.689895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c019263-2685-4a4c-886b-8739fb52d52e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:24.690735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c019263-2685-4a4c-886b-8739fb52d52e None admin] RBAC: Adding query filter params (group.id=a946f3adcb454b468eaf2a2f877f90ff, role.id=3b7272bb6de3425fa18a474080a9c1a2, scope.project.id=bf617240dd564a84b2b9fde284824719) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:24.691049 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c019263-2685-4a4c-886b-8739fb52d52e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:24.692480 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c019263-2685-4a4c-886b-8739fb52d52e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:24.699657 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 175/361] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jul 21 22:16:24 2022] GET /identity/v3/role_assignments?group.id=a946f3adcb454b468eaf2a2f877f90ff&scope.project.id=bf617240dd564a84b2b9fde284824719&role.id=3b7272bb6de3425fa18a474080a9c1a2 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:24.701081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e613-9918-4877-b806-e4f750c3fad6 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:24.701440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e613-9918-4877-b806-e4f750c3fad6 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:24.701725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e613-9918-4877-b806-e4f750c3fad6 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:24.703021 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 176/362] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:24.703750 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e613-9918-4877-b806-e4f750c3fad6 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:24.712880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7aca5e-5baa-45a9-9d40-87be41982883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:24.713798 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aca5e-5baa-45a9-9d40-87be41982883 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:24.714120 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aca5e-5baa-45a9-9d40-87be41982883 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:24.714394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aca5e-5baa-45a9-9d40-87be41982883 None admin] PATH_INFO: `/v3/groups/a946f3adcb454b468eaf2a2f877f90ff` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:24.715668 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7aca5e-5baa-45a9-9d40-87be41982883 None admin] RBAC: Authorizing `identity:get_group(group_id=a946f3adcb454b468eaf2a2f877f90ff)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:24.720980 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7aca5e-5baa-45a9-9d40-87be41982883 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:24.729057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 187/363] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jul 21 22:16:24 2022] GET /identity/v3/groups/a946f3adcb454b468eaf2a2f877f90ff => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:24.729057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7aca5e-5baa-45a9-9d40-87be41982883 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:24.771062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:24.838989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e613-9918-4877-b806-e4f750c3fad6 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:24.873038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7aca5e-5baa-45a9-9d40-87be41982883 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:24.890231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c5fad-136b-4292-925d-3d0503180aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:24.891533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c5fad-136b-4292-925d-3d0503180aed None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:24.892030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c5fad-136b-4292-925d-3d0503180aed None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:24.893221 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c5fad-136b-4292-925d-3d0503180aed None admin] PATH_INFO: `/v3/users/3f729dc8c47d4e7fb5971220ca1aff62` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:24.894856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c5fad-136b-4292-925d-3d0503180aed None admin] RBAC: Authorizing `identity:get_user(user_id=3f729dc8c47d4e7fb5971220ca1aff62)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:24.896535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c5fad-136b-4292-925d-3d0503180aed None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:24.898680 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 177/364] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:16:24 2022] GET /identity/v3/users/3f729dc8c47d4e7fb5971220ca1aff62 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:24.899638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c5fad-136b-4292-925d-3d0503180aed None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:24.922300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d4350-ffc9-42c3-be94-dbda0cc3fa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:24.923085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d4350-ffc9-42c3-be94-dbda0cc3fa06 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:24.923374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d4350-ffc9-42c3-be94-dbda0cc3fa06 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:24.923660 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d4350-ffc9-42c3-be94-dbda0cc3fa06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:24.924533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d4350-ffc9-42c3-be94-dbda0cc3fa06 None admin] RBAC: Adding query filter params (group.id=a946f3adcb454b468eaf2a2f877f90ff, role.id=ffad03b6b6d1473dba5d5b7296943f18, scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:24.924851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d4350-ffc9-42c3-be94-dbda0cc3fa06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:24.926873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d4350-ffc9-42c3-be94-dbda0cc3fa06 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:24.932717 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 188/365] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jul 21 22:16:24 2022] GET /identity/v3/role_assignments?group.id=a946f3adcb454b468eaf2a2f877f90ff&scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc&role.id=ffad03b6b6d1473dba5d5b7296943f18 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:24.932903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:24.933933 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e907db-7e65-49a2-92e6-919cc2a0bb43 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:24.934218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e907db-7e65-49a2-92e6-919cc2a0bb43 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:24.934505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e907db-7e65-49a2-92e6-919cc2a0bb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:24.955093 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-05e907db-7e65-49a2-92e6-919cc2a0bb43 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:24.957220 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-05e907db-7e65-49a2-92e6-919cc2a0bb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:25.028831 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c5fad-136b-4292-925d-3d0503180aed None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:25.045380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 189/366] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:25.047833 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e907db-7e65-49a2-92e6-919cc2a0bb43 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:25.079879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f9488-5042-4a48-b377-16cc64f95eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:25.081109 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f9488-5042-4a48-b377-16cc64f95eca None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:25.081572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f9488-5042-4a48-b377-16cc64f95eca None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:25.082085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f9488-5042-4a48-b377-16cc64f95eca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:25.094375 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:25.109699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f9488-5042-4a48-b377-16cc64f95eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-152f9488-5042-4a48-b377-16cc64f95eca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:25.118390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:25.119374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:25.120141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:25.120141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:25.120141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:25.120141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:25.120141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:25.120141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:25.120141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:25.120141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:25.120141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:25.120141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:25.120141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:25.120141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:25.120141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 178/367] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:16:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:25.121405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f9488-5042-4a48-b377-16cc64f95eca None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:25.191268 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e907db-7e65-49a2-92e6-919cc2a0bb43 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:25.222502 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:25.237517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c707641-3eb5-48bc-b06f-632a9288c643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:25.238280 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c707641-3eb5-48bc-b06f-632a9288c643 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:25.238879 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c707641-3eb5-48bc-b06f-632a9288c643 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:25.239235 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c707641-3eb5-48bc-b06f-632a9288c643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:25.240969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c707641-3eb5-48bc-b06f-632a9288c643 None admin] RBAC: Adding query filter params (group.id=a946f3adcb454b468eaf2a2f877f90ff, role.id=3b7272bb6de3425fa18a474080a9c1a2, scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:25.240969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c707641-3eb5-48bc-b06f-632a9288c643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:25.242789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c707641-3eb5-48bc-b06f-632a9288c643 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:25.247511 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f9488-5042-4a48-b377-16cc64f95eca None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:25.251234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 190/368] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jul 21 22:16:25 2022] GET /identity/v3/role_assignments?group.id=a946f3adcb454b468eaf2a2f877f90ff&scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc&role.id=3b7272bb6de3425fa18a474080a9c1a2 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:25.252210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c707641-3eb5-48bc-b06f-632a9288c643 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:25.297923 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64cb50-3aaa-4481-812d-7e8282e46d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:25.299078 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64cb50-3aaa-4481-812d-7e8282e46d6b None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:25.299993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64cb50-3aaa-4481-812d-7e8282e46d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:25.300653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64cb50-3aaa-4481-812d-7e8282e46d6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:25.301856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64cb50-3aaa-4481-812d-7e8282e46d6b None admin] RBAC: Adding query filter params (role.id=6a46f6859932445b83ab7334c94dbe9b, user.id=3f729dc8c47d4e7fb5971220ca1aff62, scope.system=all) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:25.302396 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64cb50-3aaa-4481-812d-7e8282e46d6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:25.304294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64cb50-3aaa-4481-812d-7e8282e46d6b None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:25.320197 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 179/369] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Jul 21 22:16:25 2022] GET /identity/v3/role_assignments?user.id=3f729dc8c47d4e7fb5971220ca1aff62&scope.system=all&role.id=6a46f6859932445b83ab7334c94dbe9b => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:25.321987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64cb50-3aaa-4481-812d-7e8282e46d6b None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:25.384887 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:25.403699 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c707641-3eb5-48bc-b06f-632a9288c643 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:25.453397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398fce5-1908-4a28-a662-e8cf1ad18a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:25.455552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398fce5-1908-4a28-a662-e8cf1ad18a85 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:25.455983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398fce5-1908-4a28-a662-e8cf1ad18a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:25.456541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398fce5-1908-4a28-a662-e8cf1ad18a85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:25.458963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64cb50-3aaa-4481-812d-7e8282e46d6b None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:25.471821 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398fce5-1908-4a28-a662-e8cf1ad18a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3398fce5-1908-4a28-a662-e8cf1ad18a85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:25.483110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:25.484139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:25.484954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:25.484954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:25.484954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:25.484954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:25.484954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:25.484954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:25.484954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:25.484954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:25.484954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:25.484954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:25.484954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:16:25.484954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:25.488134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 191/370] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:16:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:25.494001 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398fce5-1908-4a28-a662-e8cf1ad18a85 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:25.541830 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7f12e-7b42-42ef-aee7-7b28accd2603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:25.542070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7f12e-7b42-42ef-aee7-7b28accd2603 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:25.542322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7f12e-7b42-42ef-aee7-7b28accd2603 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:25.543118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7f12e-7b42-42ef-aee7-7b28accd2603 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:25.543892 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7f12e-7b42-42ef-aee7-7b28accd2603 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:25.544207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7f12e-7b42-42ef-aee7-7b28accd2603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:25.550053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7f12e-7b42-42ef-aee7-7b28accd2603 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:25.564589 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 180/371] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:25.574557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7f12e-7b42-42ef-aee7-7b28accd2603 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:25.577590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:25.622508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398fce5-1908-4a28-a662-e8cf1ad18a85 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:25.664186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d6b43-9459-454e-8e03-8b7e8159862b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:25.666070 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6b43-9459-454e-8e03-8b7e8159862b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:25.666580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6b43-9459-454e-8e03-8b7e8159862b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:25.667062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6b43-9459-454e-8e03-8b7e8159862b None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:25.668060 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d6b43-9459-454e-8e03-8b7e8159862b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:25.668559 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d6b43-9459-454e-8e03-8b7e8159862b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:25.670448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d6b43-9459-454e-8e03-8b7e8159862b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:25.692691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 192/372] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:25.699304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d6b43-9459-454e-8e03-8b7e8159862b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:25.734419 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:25.827163 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d6b43-9459-454e-8e03-8b7e8159862b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:25.867733 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b214b6-c24b-4f4a-b10e-2de025092660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:25.868990 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b214b6-c24b-4f4a-b10e-2de025092660 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:25.869596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b214b6-c24b-4f4a-b10e-2de025092660 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:25.870089 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b214b6-c24b-4f4a-b10e-2de025092660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:25.872802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7f12e-7b42-42ef-aee7-7b28accd2603 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:25.948463 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b214b6-c24b-4f4a-b10e-2de025092660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:25.952028 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b214b6-c24b-4f4a-b10e-2de025092660 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:25.965736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b07cba-959b-4642-87bf-616a9fb14396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:25.966437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b07cba-959b-4642-87bf-616a9fb14396 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:25.966682 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b07cba-959b-4642-87bf-616a9fb14396 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:25.966960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b07cba-959b-4642-87bf-616a9fb14396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:25.968878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:26.065512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 193/373] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:16:26.072297 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b214b6-c24b-4f4a-b10e-2de025092660 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:26.085125 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b07cba-959b-4642-87bf-616a9fb14396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:26.086870 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b07cba-959b-4642-87bf-616a9fb14396 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:26.092516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:26.226448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b214b6-c24b-4f4a-b10e-2de025092660 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:26.245368 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:26.285789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914e48f-c4dd-46bd-97b5-800f47b4e3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:26.286663 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914e48f-c4dd-46bd-97b5-800f47b4e3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:26.286950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914e48f-c4dd-46bd-97b5-800f47b4e3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:26.287230 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914e48f-c4dd-46bd-97b5-800f47b4e3c5 None admin] PATH_INFO: `/v3/projects/cde20a12b28d4325b013339974b4c146` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:26.288465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914e48f-c4dd-46bd-97b5-800f47b4e3c5 None admin] RBAC: Authorizing `identity:get_project(project_id=cde20a12b28d4325b013339974b4c146)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:26.289946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914e48f-c4dd-46bd-97b5-800f47b4e3c5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:26.291662 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 194/374] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:26 2022] GET /identity/v3/projects/cde20a12b28d4325b013339974b4c146 => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:26.301004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914e48f-c4dd-46bd-97b5-800f47b4e3c5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:26.333174 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 181/375] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:26.337226 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b07cba-959b-4642-87bf-616a9fb14396 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:26.454170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914e48f-c4dd-46bd-97b5-800f47b4e3c5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:26.478616 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b07cba-959b-4642-87bf-616a9fb14396 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:26.480674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:26.499838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9886d29-523c-4736-8721-59f896fcf537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:26.500709 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9886d29-523c-4736-8721-59f896fcf537 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:26.501024 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9886d29-523c-4736-8721-59f896fcf537 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:26.501309 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9886d29-523c-4736-8721-59f896fcf537 None admin] PATH_INFO: `/v3/groups/04209841ab1c4bab822fe85c24410f61` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:26.513878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9886d29-523c-4736-8721-59f896fcf537 None admin] RBAC: Authorizing `identity:get_group(group_id=04209841ab1c4bab822fe85c24410f61)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:26.515441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9886d29-523c-4736-8721-59f896fcf537 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:26.517579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 195/376] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jul 21 22:16:26 2022] GET /identity/v3/groups/04209841ab1c4bab822fe85c24410f61 => generated 229 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:26.519155 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131c25f-1c46-4b7a-8209-e3bb3b9fb140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:26.520047 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131c25f-1c46-4b7a-8209-e3bb3b9fb140 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:26.520332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131c25f-1c46-4b7a-8209-e3bb3b9fb140 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:26.520610 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131c25f-1c46-4b7a-8209-e3bb3b9fb140 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:26.521948 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131c25f-1c46-4b7a-8209-e3bb3b9fb140 None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:26.523511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9886d29-523c-4736-8721-59f896fcf537 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:26.523629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131c25f-1c46-4b7a-8209-e3bb3b9fb140 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:26.525628 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 182/377] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:26 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:26.531449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131c25f-1c46-4b7a-8209-e3bb3b9fb140 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:26.601696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:26.644303 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131c25f-1c46-4b7a-8209-e3bb3b9fb140 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:26.681515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948a161-d274-4de0-8af2-8143066b5495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:26.682388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948a161-d274-4de0-8af2-8143066b5495 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:26.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948a161-d274-4de0-8af2-8143066b5495 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:26.683500 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948a161-d274-4de0-8af2-8143066b5495 None admin] PATH_INFO: `/v3/groups/a946f3adcb454b468eaf2a2f877f90ff` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:26.684673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948a161-d274-4de0-8af2-8143066b5495 None admin] RBAC: Authorizing `identity:get_group(group_id=a946f3adcb454b468eaf2a2f877f90ff)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:26.686352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948a161-d274-4de0-8af2-8143066b5495 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:26.688752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 183/378] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jul 21 22:16:26 2022] GET /identity/v3/groups/a946f3adcb454b468eaf2a2f877f90ff => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:26.695170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948a161-d274-4de0-8af2-8143066b5495 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:26.738038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:26.764704 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9886d29-523c-4736-8721-59f896fcf537 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:26.802642 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948a161-d274-4de0-8af2-8143066b5495 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:26.827825 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05109b7-f191-4082-a4e1-f298acca4d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:26.828853 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05109b7-f191-4082-a4e1-f298acca4d3a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:26.829385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05109b7-f191-4082-a4e1-f298acca4d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:26.830088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05109b7-f191-4082-a4e1-f298acca4d3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:26.831129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05109b7-f191-4082-a4e1-f298acca4d3a None admin] RBAC: Adding query filter params (group.id=04209841ab1c4bab822fe85c24410f61, role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=cde20a12b28d4325b013339974b4c146) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:26.831660 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05109b7-f191-4082-a4e1-f298acca4d3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:26.833394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05109b7-f191-4082-a4e1-f298acca4d3a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:26.841038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4fc33-3e81-48e1-b75d-f76994d56885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:26.841038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4fc33-3e81-48e1-b75d-f76994d56885 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:26.841038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4fc33-3e81-48e1-b75d-f76994d56885 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:26.841038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4fc33-3e81-48e1-b75d-f76994d56885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:26.841379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4fc33-3e81-48e1-b75d-f76994d56885 None admin] RBAC: Adding query filter params (group.id=a946f3adcb454b468eaf2a2f877f90ff, role.id=ffad03b6b6d1473dba5d5b7296943f18, scope.project.id=bf617240dd564a84b2b9fde284824719) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:26.841379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4fc33-3e81-48e1-b75d-f76994d56885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:26.842629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4fc33-3e81-48e1-b75d-f76994d56885 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:26.852182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 196/379] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jul 21 22:16:26 2022] GET /identity/v3/role_assignments?group.id=04209841ab1c4bab822fe85c24410f61&scope.project.id=cde20a12b28d4325b013339974b4c146&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 260 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:26.852380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 184/380] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jul 21 22:16:26 2022] GET /identity/v3/role_assignments?group.id=a946f3adcb454b468eaf2a2f877f90ff&scope.project.id=bf617240dd564a84b2b9fde284824719&role.id=ffad03b6b6d1473dba5d5b7296943f18 => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:27.534705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b2659-840c-4a84-b9af-e63ff884459f None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:27.535313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b2659-840c-4a84-b9af-e63ff884459f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:27.535313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b2659-840c-4a84-b9af-e63ff884459f None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:27.536881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 185/381] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:27.542235 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cea82b-1265-4139-85ff-bc3f7c63f52f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:27.543108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cea82b-1265-4139-85ff-bc3f7c63f52f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:27.543276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cea82b-1265-4139-85ff-bc3f7c63f52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:27.556437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e45f4-4d64-4460-8e30-413c6ae1cbf2 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:27.556737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e45f4-4d64-4460-8e30-413c6ae1cbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:27.557568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e45f4-4d64-4460-8e30-413c6ae1cbf2 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:27.559134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 186/382] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:16:27.564057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98566b-d276-4d52-97c5-ee9bf62a7cf2 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:27.564341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98566b-d276-4d52-97c5-ee9bf62a7cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:27.564619 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98566b-d276-4d52-97c5-ee9bf62a7cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:27.578058 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-82cea82b-1265-4139-85ff-bc3f7c63f52f None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:27.579265 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-82cea82b-1265-4139-85ff-bc3f7c63f52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:27.587433 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-cd98566b-d276-4d52-97c5-ee9bf62a7cf2 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:27.588620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-cd98566b-d276-4d52-97c5-ee9bf62a7cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:27.700750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 197/383] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:27.726869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cea82b-1265-4139-85ff-bc3f7c63f52f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:27.735318 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 187/384] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:16:27.769671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98566b-d276-4d52-97c5-ee9bf62a7cf2 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:27.770858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:27.842182 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:27.857497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cea82b-1265-4139-85ff-bc3f7c63f52f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:27.900734 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4912fe-16ed-4859-970f-83e8ef8ec5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:27.902121 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4912fe-16ed-4859-970f-83e8ef8ec5cb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:27.902743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4912fe-16ed-4859-970f-83e8ef8ec5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:27.903291 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4912fe-16ed-4859-970f-83e8ef8ec5cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:27.928332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4912fe-16ed-4859-970f-83e8ef8ec5cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1d4912fe-16ed-4859-970f-83e8ef8ec5cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:27.942408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:27.943337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:27.944142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:27.944142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:27.944142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:27.944142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:27.944142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:27.944142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:27.944142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:27.944142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:27.944142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:27.944142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:27.944142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:27.944142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:27.953557 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 198/385] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:16:27.965632 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98566b-d276-4d52-97c5-ee9bf62a7cf2 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:27.975651 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4912fe-16ed-4859-970f-83e8ef8ec5cb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:28.039802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3a12-ee71-4d4c-a08e-cf2b49f061ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:28.040634 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3a12-ee71-4d4c-a08e-cf2b49f061ad None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:28.040916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3a12-ee71-4d4c-a08e-cf2b49f061ad None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:28.041235 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3a12-ee71-4d4c-a08e-cf2b49f061ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:28.059212 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf3a12-ee71-4d4c-a08e-cf2b49f061ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-9bdf3a12-ee71-4d4c-a08e-cf2b49f061ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:28.072488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:28.073985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:28.074771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:28.074771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:28.074771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:28.074771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:28.074771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:28.074771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:28.074771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:28.074771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:28.074771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:28.074771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:28.074771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:28.074771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:28.074771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 188/386] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:16:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:28.081918 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3a12-ee71-4d4c-a08e-cf2b49f061ad None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:28.152799 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:28.157434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4912fe-16ed-4859-970f-83e8ef8ec5cb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:28.205326 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:28.211026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3a12-ee71-4d4c-a08e-cf2b49f061ad None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:28.237646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6315229-5ebe-4739-b8f5-458f3078a85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:28.238343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6315229-5ebe-4739-b8f5-458f3078a85c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:28.238632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6315229-5ebe-4739-b8f5-458f3078a85c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:28.238916 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6315229-5ebe-4739-b8f5-458f3078a85c None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:28.239681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6315229-5ebe-4739-b8f5-458f3078a85c None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:28.239995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6315229-5ebe-4739-b8f5-458f3078a85c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:28.241421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6315229-5ebe-4739-b8f5-458f3078a85c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:28.246741 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293927c-75f9-431a-b3e6-b60a08b3853a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:28.247415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293927c-75f9-431a-b3e6-b60a08b3853a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:28.247700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293927c-75f9-431a-b3e6-b60a08b3853a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:28.247982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293927c-75f9-431a-b3e6-b60a08b3853a None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:28.248728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293927c-75f9-431a-b3e6-b60a08b3853a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:28.249086 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293927c-75f9-431a-b3e6-b60a08b3853a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:28.250779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293927c-75f9-431a-b3e6-b60a08b3853a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:28.259839 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 189/387] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:28.260918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 199/388] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:28.266011 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293927c-75f9-431a-b3e6-b60a08b3853a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:28.275513 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6315229-5ebe-4739-b8f5-458f3078a85c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:28.391276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293927c-75f9-431a-b3e6-b60a08b3853a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:28.405623 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6315229-5ebe-4739-b8f5-458f3078a85c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:28.434260 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac50df-3bc4-46d9-8982-f0fd87eeeb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:28.435137 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac50df-3bc4-46d9-8982-f0fd87eeeb10 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:28.435576 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac50df-3bc4-46d9-8982-f0fd87eeeb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:28.435855 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac50df-3bc4-46d9-8982-f0fd87eeeb10 None admin] PATH_INFO: `/v3/groups/a946f3adcb454b468eaf2a2f877f90ff` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:28.437573 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac50df-3bc4-46d9-8982-f0fd87eeeb10 None admin] RBAC: Authorizing `identity:get_group(group_id=a946f3adcb454b468eaf2a2f877f90ff)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:28.439002 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac50df-3bc4-46d9-8982-f0fd87eeeb10 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:28.440636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 190/389] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jul 21 22:16:28 2022] GET /identity/v3/groups/a946f3adcb454b468eaf2a2f877f90ff => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:28.441991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cc4cb-85c2-4c14-adbb-7214fbaf88d6 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:28.442279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cc4cb-85c2-4c14-adbb-7214fbaf88d6 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:28.442552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cc4cb-85c2-4c14-adbb-7214fbaf88d6 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:28.443764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 191/390] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:28.449234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789cc4cb-85c2-4c14-adbb-7214fbaf88d6 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:28.450012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32054714-f289-454a-9f2b-925b04aedc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:28.450886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32054714-f289-454a-9f2b-925b04aedc26 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:28.451168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32054714-f289-454a-9f2b-925b04aedc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:28.451444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32054714-f289-454a-9f2b-925b04aedc26 None admin] PATH_INFO: `/v3/groups/a946f3adcb454b468eaf2a2f877f90ff` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:28.453763 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32054714-f289-454a-9f2b-925b04aedc26 None admin] RBAC: Authorizing `identity:get_group(group_id=a946f3adcb454b468eaf2a2f877f90ff)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:28.455225 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32054714-f289-454a-9f2b-925b04aedc26 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:28.457250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 200/391] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jul 21 22:16:28 2022] GET /identity/v3/groups/a946f3adcb454b468eaf2a2f877f90ff => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:28.461619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700d461-ab05-4a9d-84bd-ff170685461d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:28.461907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700d461-ab05-4a9d-84bd-ff170685461d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:28.462175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700d461-ab05-4a9d-84bd-ff170685461d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:28.480689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1700d461-ab05-4a9d-84bd-ff170685461d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:28.481918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1700d461-ab05-4a9d-84bd-ff170685461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:28.482301 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:28.508598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:28.565752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 201/392] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:28.567536 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700d461-ab05-4a9d-84bd-ff170685461d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:28.575071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789cc4cb-85c2-4c14-adbb-7214fbaf88d6 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:28.617948 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3665f4f-a305-45c8-95ec-2925b77d46ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:28.619691 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3665f4f-a305-45c8-95ec-2925b77d46ac None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:28.620274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3665f4f-a305-45c8-95ec-2925b77d46ac None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:28.621308 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3665f4f-a305-45c8-95ec-2925b77d46ac None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:28.623948 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3665f4f-a305-45c8-95ec-2925b77d46ac None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:28.625428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3665f4f-a305-45c8-95ec-2925b77d46ac None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:28.627976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 192/393] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:28 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:28.628759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3665f4f-a305-45c8-95ec-2925b77d46ac None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:28.706524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700d461-ab05-4a9d-84bd-ff170685461d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:28.736988 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:28.749010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3665f4f-a305-45c8-95ec-2925b77d46ac None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:28.749211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb9054-ed4e-4c1c-a44f-14ba748fe3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:28.749945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb9054-ed4e-4c1c-a44f-14ba748fe3ad None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:28.750230 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb9054-ed4e-4c1c-a44f-14ba748fe3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:28.750508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb9054-ed4e-4c1c-a44f-14ba748fe3ad None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:28.751861 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb9054-ed4e-4c1c-a44f-14ba748fe3ad None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:28.754153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb9054-ed4e-4c1c-a44f-14ba748fe3ad None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:28.755874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 202/394] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:28 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:28.761962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb9054-ed4e-4c1c-a44f-14ba748fe3ad None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:28.791734 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:28.796076 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d007e7-443f-4b67-adba-7e236834ec14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:28.797077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d007e7-443f-4b67-adba-7e236834ec14 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:28.797364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d007e7-443f-4b67-adba-7e236834ec14 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:28.797637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d007e7-443f-4b67-adba-7e236834ec14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:28.810609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d007e7-443f-4b67-adba-7e236834ec14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-f4d007e7-443f-4b67-adba-7e236834ec14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:28.820424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:28.821565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:28.822432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:28.822432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:28.822432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:28.822432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:28.822432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:28.822432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:28.822432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:28.822432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:28.822432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:28.822432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:28.822432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:28.822432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:28.825004 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 193/395] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:28.825908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d007e7-443f-4b67-adba-7e236834ec14 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:28.877897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb9054-ed4e-4c1c-a44f-14ba748fe3ad None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:28.918481 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86c905-eca1-4401-b831-43eff38e07b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:28.919365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86c905-eca1-4401-b831-43eff38e07b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:28.919643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86c905-eca1-4401-b831-43eff38e07b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:28.919929 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86c905-eca1-4401-b831-43eff38e07b3 None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc/groups/a946f3adcb454b468eaf2a2f877f90ff/roles/ffad03b6b6d1473dba5d5b7296943f18` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:28.923103 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86c905-eca1-4401-b831-43eff38e07b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4684cfef7d430aad38eb190fb3f5fc, group_id=a946f3adcb454b468eaf2a2f877f90ff, role_id=ffad03b6b6d1473dba5d5b7296943f18)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:28.924706 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86c905-eca1-4401-b831-43eff38e07b3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:28.946602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d007e7-443f-4b67-adba-7e236834ec14 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:28.949252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 203/396] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Jul 21 22:16:28 2022] PUT /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc/groups/a946f3adcb454b468eaf2a2f877f90ff/roles/ffad03b6b6d1473dba5d5b7296943f18 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:28.951300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86c905-eca1-4401-b831-43eff38e07b3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:29.009042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605da55-dbf8-4bb4-9cd5-73f8b1fa8425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:29.014434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605da55-dbf8-4bb4-9cd5-73f8b1fa8425 None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:29.015692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605da55-dbf8-4bb4-9cd5-73f8b1fa8425 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:29.016479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605da55-dbf8-4bb4-9cd5-73f8b1fa8425 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719/groups/a946f3adcb454b468eaf2a2f877f90ff/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:29.022203 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605da55-dbf8-4bb4-9cd5-73f8b1fa8425 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf617240dd564a84b2b9fde284824719, group_id=a946f3adcb454b468eaf2a2f877f90ff, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:29.025279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605da55-dbf8-4bb4-9cd5-73f8b1fa8425 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:29.051713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 194/397] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Jul 21 22:16:28 2022] PUT /identity/v3/projects/bf617240dd564a84b2b9fde284824719/groups/a946f3adcb454b468eaf2a2f877f90ff/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:29.114755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:29.132458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86c905-eca1-4401-b831-43eff38e07b3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:29.140029 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebb23b-7f29-4d8a-a367-e56f30624d30 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:29.140487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebb23b-7f29-4d8a-a367-e56f30624d30 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:29.140872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebb23b-7f29-4d8a-a367-e56f30624d30 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:29.143000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 195/398] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:29.150867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201d023-8ef9-408b-bd46-991c72fb04d7 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:29.150867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201d023-8ef9-408b-bd46-991c72fb04d7 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:29.151301 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201d023-8ef9-408b-bd46-991c72fb04d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:29.174927 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c4654-e36c-4e8a-a43e-82d07f79c5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:29.175944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c4654-e36c-4e8a-a43e-82d07f79c5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:29.176406 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c4654-e36c-4e8a-a43e-82d07f79c5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:29.176856 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c4654-e36c-4e8a-a43e-82d07f79c5b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:29.177892 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c4654-e36c-4e8a-a43e-82d07f79c5b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:29.178405 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c4654-e36c-4e8a-a43e-82d07f79c5b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:29.180057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c4654-e36c-4e8a-a43e-82d07f79c5b1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:29.189896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-5201d023-8ef9-408b-bd46-991c72fb04d7 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:29.191277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-5201d023-8ef9-408b-bd46-991c72fb04d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:29.191532 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 204/399] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:29.194907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:29.199419 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c4654-e36c-4e8a-a43e-82d07f79c5b1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:29.289244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 196/400] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:29.312601 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201d023-8ef9-408b-bd46-991c72fb04d7 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:29.317679 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c4654-e36c-4e8a-a43e-82d07f79c5b1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:29.358852 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4003e5-0164-48ba-acdd-70eea1b209f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:29.359821 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4003e5-0164-48ba-acdd-70eea1b209f2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:29.360162 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4003e5-0164-48ba-acdd-70eea1b209f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:29.360476 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4003e5-0164-48ba-acdd-70eea1b209f2 None admin] PATH_INFO: `/v3/groups/a946f3adcb454b468eaf2a2f877f90ff` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:29.361828 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4003e5-0164-48ba-acdd-70eea1b209f2 None admin] RBAC: Authorizing `identity:get_group(group_id=a946f3adcb454b468eaf2a2f877f90ff)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:29.363289 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4003e5-0164-48ba-acdd-70eea1b209f2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:29.365403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 205/401] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jul 21 22:16:29 2022] GET /identity/v3/groups/a946f3adcb454b468eaf2a2f877f90ff => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:29.371633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4003e5-0164-48ba-acdd-70eea1b209f2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:29.392418 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:29.436390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201d023-8ef9-408b-bd46-991c72fb04d7 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:29.485408 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d6e8a-25e4-439f-a5e5-b7389a1efda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:29.486744 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d6e8a-25e4-439f-a5e5-b7389a1efda2 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:29.487046 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d6e8a-25e4-439f-a5e5-b7389a1efda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:29.487328 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d6e8a-25e4-439f-a5e5-b7389a1efda2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:29.501080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:29.501796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4003e5-0164-48ba-acdd-70eea1b209f2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:29.506849 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d6e8a-25e4-439f-a5e5-b7389a1efda2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-622d6e8a-25e4-439f-a5e5-b7389a1efda2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:29.518207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:29.519096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:29.519881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:29.519881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:29.519881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:29.519881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:29.519881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:29.519881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:29.519881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:29.519881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:29.519881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:29.519881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:29.519881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:29.519881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:29.520869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 197/402] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:16:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:16:29.524976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d9381-51fe-4407-9cfc-7983d2f4ac70 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:29.524976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d9381-51fe-4407-9cfc-7983d2f4ac70 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:29.524976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d9381-51fe-4407-9cfc-7983d2f4ac70 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:29.524976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 198/403] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:29.529849 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d9381-51fe-4407-9cfc-7983d2f4ac70 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:29.547728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b89d82-adc1-4012-8bad-6708b5a2ea8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:29.548608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b89d82-adc1-4012-8bad-6708b5a2ea8b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:29.548893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b89d82-adc1-4012-8bad-6708b5a2ea8b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:29.549332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b89d82-adc1-4012-8bad-6708b5a2ea8b None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:29.550616 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b89d82-adc1-4012-8bad-6708b5a2ea8b None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:29.552046 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b89d82-adc1-4012-8bad-6708b5a2ea8b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:29.554277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 206/404] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:29 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:29.555581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16d387-7446-4fd8-96cf-7818612fb5ab None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:29.555966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16d387-7446-4fd8-96cf-7818612fb5ab None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:29.556248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16d387-7446-4fd8-96cf-7818612fb5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:29.575145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8d16d387-7446-4fd8-96cf-7818612fb5ab None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:29.576582 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8d16d387-7446-4fd8-96cf-7818612fb5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:29.636771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d9381-51fe-4407-9cfc-7983d2f4ac70 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:29.650832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 207/405] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:29.651970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16d387-7446-4fd8-96cf-7818612fb5ab None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:29.679079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:29.695028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494b8e0-5803-434c-853d-b697ed450524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:29.695732 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494b8e0-5803-434c-853d-b697ed450524 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:29.696021 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494b8e0-5803-434c-853d-b697ed450524 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:29.696307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494b8e0-5803-434c-853d-b697ed450524 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:29.697208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494b8e0-5803-434c-853d-b697ed450524 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:29.697413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494b8e0-5803-434c-853d-b697ed450524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:29.699073 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494b8e0-5803-434c-853d-b697ed450524 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:29.708049 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 199/406] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:29.708892 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494b8e0-5803-434c-853d-b697ed450524 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:29.756596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16d387-7446-4fd8-96cf-7818612fb5ab None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:29.791491 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:29.791917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272996d-689a-4469-9256-155ac524d5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:29.793578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272996d-689a-4469-9256-155ac524d5ce None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:29.794170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272996d-689a-4469-9256-155ac524d5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:29.794645 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272996d-689a-4469-9256-155ac524d5ce None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc/groups/a946f3adcb454b468eaf2a2f877f90ff/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:29.797036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272996d-689a-4469-9256-155ac524d5ce None admin] RBAC: Authorizing `identity:create_grant(project_id=7a4684cfef7d430aad38eb190fb3f5fc, group_id=a946f3adcb454b468eaf2a2f877f90ff, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:29.798725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272996d-689a-4469-9256-155ac524d5ce None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:29.812974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494b8e0-5803-434c-853d-b697ed450524 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:29.820631 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 208/407] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Jul 21 22:16:29 2022] PUT /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc/groups/a946f3adcb454b468eaf2a2f877f90ff/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:29.822145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272996d-689a-4469-9256-155ac524d5ce None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:29.851308 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6f74d-027a-43e1-b427-a6faa9f05290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:29.857041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6f74d-027a-43e1-b427-a6faa9f05290 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:29.857041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6f74d-027a-43e1-b427-a6faa9f05290 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:29.857041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6f74d-027a-43e1-b427-a6faa9f05290 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:29.870980 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6f74d-027a-43e1-b427-a6faa9f05290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-18f6f74d-027a-43e1-b427-a6faa9f05290 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:29.879577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:29.880588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:29.881434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:29.881434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:29.881434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:29.881434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:29.881434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:29.881434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:29.881434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:29.881434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:29.881434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:29.881434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:29.881434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:16:29.881434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:29.885349 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 200/408] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:16:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:29.887672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6f74d-027a-43e1-b427-a6faa9f05290 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:30.009584 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:30.032021 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272996d-689a-4469-9256-155ac524d5ce None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:30.053564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6f74d-027a-43e1-b427-a6faa9f05290 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:30.068464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e5d5a-e5b1-48d1-b18e-252aca1781ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:30.070178 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e5d5a-e5b1-48d1-b18e-252aca1781ca None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:30.070506 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e5d5a-e5b1-48d1-b18e-252aca1781ca None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:30.070888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e5d5a-e5b1-48d1-b18e-252aca1781ca None admin] PATH_INFO: `/v3/groups/a946f3adcb454b468eaf2a2f877f90ff` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:30.072429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e5d5a-e5b1-48d1-b18e-252aca1781ca None admin] RBAC: Authorizing `identity:get_group(group_id=a946f3adcb454b468eaf2a2f877f90ff)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:30.074506 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e5d5a-e5b1-48d1-b18e-252aca1781ca None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:30.076344 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 209/409] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jul 21 22:16:29 2022] GET /identity/v3/groups/a946f3adcb454b468eaf2a2f877f90ff => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:30.082722 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e5d5a-e5b1-48d1-b18e-252aca1781ca None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:30.087352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:30.105601 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a60aa6-f289-4027-94d5-53983406626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:30.106430 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a60aa6-f289-4027-94d5-53983406626f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:30.106859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a60aa6-f289-4027-94d5-53983406626f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:30.107264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a60aa6-f289-4027-94d5-53983406626f None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:30.108450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a60aa6-f289-4027-94d5-53983406626f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:30.108954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a60aa6-f289-4027-94d5-53983406626f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:30.112260 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a60aa6-f289-4027-94d5-53983406626f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:30.125223 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 201/410] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:30.131322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a60aa6-f289-4027-94d5-53983406626f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:30.255725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e5d5a-e5b1-48d1-b18e-252aca1781ca None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:30.275582 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a60aa6-f289-4027-94d5-53983406626f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:30.299110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174e29b-0b57-4682-9c1c-517509fea663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:30.300756 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174e29b-0b57-4682-9c1c-517509fea663 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:30.301060 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174e29b-0b57-4682-9c1c-517509fea663 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:30.301336 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174e29b-0b57-4682-9c1c-517509fea663 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:30.302723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174e29b-0b57-4682-9c1c-517509fea663 None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:30.304841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174e29b-0b57-4682-9c1c-517509fea663 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:30.306511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 210/411] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:30 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:30.315065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174e29b-0b57-4682-9c1c-517509fea663 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:30.324094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596aa6f2-4c4c-4f37-9dd2-cba862b5dc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:30.325299 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596aa6f2-4c4c-4f37-9dd2-cba862b5dc90 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:30.325811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596aa6f2-4c4c-4f37-9dd2-cba862b5dc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:30.326288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596aa6f2-4c4c-4f37-9dd2-cba862b5dc90 None admin] PATH_INFO: `/v3/groups/04209841ab1c4bab822fe85c24410f61` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:30.327676 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596aa6f2-4c4c-4f37-9dd2-cba862b5dc90 None admin] RBAC: Authorizing `identity:get_group(group_id=04209841ab1c4bab822fe85c24410f61)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:30.329364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596aa6f2-4c4c-4f37-9dd2-cba862b5dc90 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:30.331530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 202/412] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jul 21 22:16:30 2022] GET /identity/v3/groups/04209841ab1c4bab822fe85c24410f61 => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:30.341884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596aa6f2-4c4c-4f37-9dd2-cba862b5dc90 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:30.345071 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:30.443910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174e29b-0b57-4682-9c1c-517509fea663 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:30.462709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:30.517790 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c2945-aab1-48c8-9c78-db85008c3955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:30.518686 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c2945-aab1-48c8-9c78-db85008c3955 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:30.518972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c2945-aab1-48c8-9c78-db85008c3955 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:30.519250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c2945-aab1-48c8-9c78-db85008c3955 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719/groups/a946f3adcb454b468eaf2a2f877f90ff/roles/ffad03b6b6d1473dba5d5b7296943f18` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:30.529566 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c2945-aab1-48c8-9c78-db85008c3955 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf617240dd564a84b2b9fde284824719, group_id=a946f3adcb454b468eaf2a2f877f90ff, role_id=ffad03b6b6d1473dba5d5b7296943f18)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:30.531035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c2945-aab1-48c8-9c78-db85008c3955 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:30.534173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596aa6f2-4c4c-4f37-9dd2-cba862b5dc90 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:30.554364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 211/413] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Jul 21 22:16:30 2022] PUT /identity/v3/projects/bf617240dd564a84b2b9fde284824719/groups/a946f3adcb454b468eaf2a2f877f90ff/roles/ffad03b6b6d1473dba5d5b7296943f18 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:30.574045 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9069a77-225f-42db-88ec-7b0195f4c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:30.574843 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9069a77-225f-42db-88ec-7b0195f4c621 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:30.575125 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9069a77-225f-42db-88ec-7b0195f4c621 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:30.575400 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9069a77-225f-42db-88ec-7b0195f4c621 None admin] PATH_INFO: `/v3/projects/cde20a12b28d4325b013339974b4c146` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:30.576662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9069a77-225f-42db-88ec-7b0195f4c621 None admin] RBAC: Authorizing `identity:get_project(project_id=cde20a12b28d4325b013339974b4c146)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:30.578197 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9069a77-225f-42db-88ec-7b0195f4c621 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:30.580353 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 203/414] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:30 2022] GET /identity/v3/projects/cde20a12b28d4325b013339974b4c146 => generated 344 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:30.586178 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c2945-aab1-48c8-9c78-db85008c3955 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:30.693880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:30.735923 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c2945-aab1-48c8-9c78-db85008c3955 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:30.774328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231b9f8-d5cc-42a3-9233-48cbebed9407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:30.775262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231b9f8-d5cc-42a3-9233-48cbebed9407 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:30.775590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231b9f8-d5cc-42a3-9233-48cbebed9407 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:30.775868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231b9f8-d5cc-42a3-9233-48cbebed9407 None admin] PATH_INFO: `/v3/projects/cde20a12b28d4325b013339974b4c146/groups/04209841ab1c4bab822fe85c24410f61/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:30.778625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231b9f8-d5cc-42a3-9233-48cbebed9407 None admin] RBAC: Authorizing `identity:create_grant(project_id=cde20a12b28d4325b013339974b4c146, group_id=04209841ab1c4bab822fe85c24410f61, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:30.780070 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231b9f8-d5cc-42a3-9233-48cbebed9407 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:30.799728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 212/415] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Jul 21 22:16:30 2022] PUT /identity/v3/projects/cde20a12b28d4325b013339974b4c146/groups/04209841ab1c4bab822fe85c24410f61/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:31.511670 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1858711-b0e6-42a4-bd5c-b4f9faa6f258 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:31.512212 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1858711-b0e6-42a4-bd5c-b4f9faa6f258 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:31.512212 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1858711-b0e6-42a4-bd5c-b4f9faa6f258 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:31.513870 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 204/416] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:31.518946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a92484-da16-4eaa-9ea1-bbe885f1aba1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:31.519245 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a92484-da16-4eaa-9ea1-bbe885f1aba1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:31.519530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a92484-da16-4eaa-9ea1-bbe885f1aba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:31.535986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb7113-0104-47f9-b64b-d8f354dca0c1 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:31.536485 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-34a92484-da16-4eaa-9ea1-bbe885f1aba1 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:31.536794 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb7113-0104-47f9-b64b-d8f354dca0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:31.537295 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb7113-0104-47f9-b64b-d8f354dca0c1 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:31.537712 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-34a92484-da16-4eaa-9ea1-bbe885f1aba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:31.539287 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 205/417] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:16:31.545043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd7c73-71ad-47fe-bdf5-f0c7485cfbe0 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:31.545335 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd7c73-71ad-47fe-bdf5-f0c7485cfbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:31.545619 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd7c73-71ad-47fe-bdf5-f0c7485cfbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:31.575170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-77fd7c73-71ad-47fe-bdf5-f0c7485cfbe0 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:31.577925 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-77fd7c73-71ad-47fe-bdf5-f0c7485cfbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:31.657003 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 213/418] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:31.669425 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 206/419] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:31.695129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a92484-da16-4eaa-9ea1-bbe885f1aba1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:31.696388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd7c73-71ad-47fe-bdf5-f0c7485cfbe0 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:31.779192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:31.816529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:31.826971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a92484-da16-4eaa-9ea1-bbe885f1aba1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:31.863550 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3525de-af41-439a-8f39-95261550e59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:31.864730 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3525de-af41-439a-8f39-95261550e59f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:31.865307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3525de-af41-439a-8f39-95261550e59f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:31.865778 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3525de-af41-439a-8f39-95261550e59f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:31.876843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3525de-af41-439a-8f39-95261550e59f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-db3525de-af41-439a-8f39-95261550e59f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:31.884873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:31.886292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:31.887062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:31.887062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:31.887062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:31.887062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:31.887062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:31.887062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:31.887062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:31.887062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:31.887062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:31.887062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:31.887062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:31.887062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:31.889720 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 214/420] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:31.895453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3525de-af41-439a-8f39-95261550e59f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:31.909605 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd7c73-71ad-47fe-bdf5-f0c7485cfbe0 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:31.950450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d355ff-c7f4-4890-8ba1-7aaf59391f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:31.951199 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d355ff-c7f4-4890-8ba1-7aaf59391f79 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:31.951478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d355ff-c7f4-4890-8ba1-7aaf59391f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:31.951753 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d355ff-c7f4-4890-8ba1-7aaf59391f79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:31.969888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d355ff-c7f4-4890-8ba1-7aaf59391f79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-94d355ff-c7f4-4890-8ba1-7aaf59391f79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:31.986285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:31.987217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:31.987991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:31.987991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:31.987991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:31.987991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:31.987991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:31.987991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:31.987991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:31.987991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:31.987991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:31.987991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:31.987991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:31.987991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:31.992077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 207/421] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:16:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:31.993170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d355ff-c7f4-4890-8ba1-7aaf59391f79 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:32.006517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3525de-af41-439a-8f39-95261550e59f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:32.043507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:32.080460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31767069-0826-4879-a66d-81b171143d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:32.082685 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31767069-0826-4879-a66d-81b171143d79 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:32.082928 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31767069-0826-4879-a66d-81b171143d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:32.083204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31767069-0826-4879-a66d-81b171143d79 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:32.085812 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31767069-0826-4879-a66d-81b171143d79 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:32.086347 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31767069-0826-4879-a66d-81b171143d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:32.088388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31767069-0826-4879-a66d-81b171143d79 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:32.105201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 215/422] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:32.111243 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31767069-0826-4879-a66d-81b171143d79 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:32.199654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d355ff-c7f4-4890-8ba1-7aaf59391f79 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:32.224328 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:32.242877 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31767069-0826-4879-a66d-81b171143d79 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:32.279752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af42461-f786-4a6d-b85e-98f8fb68b206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:32.280407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af42461-f786-4a6d-b85e-98f8fb68b206 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:32.280690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af42461-f786-4a6d-b85e-98f8fb68b206 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:32.280992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af42461-f786-4a6d-b85e-98f8fb68b206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:32.287405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72711c84-8519-4cec-8949-31e8052c974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:32.288084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72711c84-8519-4cec-8949-31e8052c974b None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:32.288376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72711c84-8519-4cec-8949-31e8052c974b None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:32.288654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72711c84-8519-4cec-8949-31e8052c974b None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:32.289451 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72711c84-8519-4cec-8949-31e8052c974b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:32.289761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72711c84-8519-4cec-8949-31e8052c974b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:32.291263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72711c84-8519-4cec-8949-31e8052c974b None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:32.318997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 208/423] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:32.330028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72711c84-8519-4cec-8949-31e8052c974b None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:32.333353 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:32.368188 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af42461-f786-4a6d-b85e-98f8fb68b206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:32.369688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af42461-f786-4a6d-b85e-98f8fb68b206 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:32.521404 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72711c84-8519-4cec-8949-31e8052c974b None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:32.521915 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 216/424] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:32.522858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404a95-b2c5-41ca-aec5-c452367a4474 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:32.523147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404a95-b2c5-41ca-aec5-c452367a4474 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:32.523431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404a95-b2c5-41ca-aec5-c452367a4474 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:32.525071 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 217/425] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:32.528198 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17404a95-b2c5-41ca-aec5-c452367a4474 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:32.569814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccff20e-479e-4284-a2cc-1fbaefbe1d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:32.570398 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccff20e-479e-4284-a2cc-1fbaefbe1d50 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:32.570686 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccff20e-479e-4284-a2cc-1fbaefbe1d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:32.570969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccff20e-479e-4284-a2cc-1fbaefbe1d50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:32.620988 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:32.635322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:32.656631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccff20e-479e-4284-a2cc-1fbaefbe1d50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:32.658374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccff20e-479e-4284-a2cc-1fbaefbe1d50 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:32.659475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17404a95-b2c5-41ca-aec5-c452367a4474 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:32.701141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b45a1f-6cfc-4135-9b9a-5c0ddd42e3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:32.701898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b45a1f-6cfc-4135-9b9a-5c0ddd42e3ed None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:32.702439 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b45a1f-6cfc-4135-9b9a-5c0ddd42e3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:32.702923 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b45a1f-6cfc-4135-9b9a-5c0ddd42e3ed None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:32.704307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b45a1f-6cfc-4135-9b9a-5c0ddd42e3ed None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:32.705959 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b45a1f-6cfc-4135-9b9a-5c0ddd42e3ed None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:32.712602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 218/426] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:32 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:32.714685 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26040be-029d-4e48-af79-435f90e9368b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:32.715185 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26040be-029d-4e48-af79-435f90e9368b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:32.715660 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26040be-029d-4e48-af79-435f90e9368b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:32.732053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f26040be-029d-4e48-af79-435f90e9368b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:32.733533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f26040be-029d-4e48-af79-435f90e9368b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:32.797034 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 209/427] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:32.798254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccff20e-479e-4284-a2cc-1fbaefbe1d50 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:32.821024 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 219/428] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:32.821024 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26040be-029d-4e48-af79-435f90e9368b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:32.895380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:32.920527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:32.937617 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccff20e-479e-4284-a2cc-1fbaefbe1d50 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:32.942001 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26040be-029d-4e48-af79-435f90e9368b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:32.974747 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47c7b7-10bc-4820-babe-6f47b73268f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:32.975966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47c7b7-10bc-4820-babe-6f47b73268f7 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:32.976446 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47c7b7-10bc-4820-babe-6f47b73268f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:32.976915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47c7b7-10bc-4820-babe-6f47b73268f7 None admin] PATH_INFO: `/v3/groups/a946f3adcb454b468eaf2a2f877f90ff` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:32.978476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47c7b7-10bc-4820-babe-6f47b73268f7 None admin] RBAC: Authorizing `identity:get_group(group_id=a946f3adcb454b468eaf2a2f877f90ff)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:32.980665 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47c7b7-10bc-4820-babe-6f47b73268f7 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:32.987249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6d5ca-4551-441c-b8d5-613b90d92126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:32.987501 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6d5ca-4551-441c-b8d5-613b90d92126 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:32.987690 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 210/429] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jul 21 22:16:32 2022] GET /identity/v3/groups/a946f3adcb454b468eaf2a2f877f90ff => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:32.987811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6d5ca-4551-441c-b8d5-613b90d92126 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:32.988014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6d5ca-4551-441c-b8d5-613b90d92126 None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:32.989024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47c7b7-10bc-4820-babe-6f47b73268f7 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:32.989281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6d5ca-4551-441c-b8d5-613b90d92126 None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:32.990714 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6d5ca-4551-441c-b8d5-613b90d92126 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:32.993022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 220/430] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:32 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:32.997636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6d5ca-4551-441c-b8d5-613b90d92126 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:33.106151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6d5ca-4551-441c-b8d5-613b90d92126 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:33.109553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47c7b7-10bc-4820-babe-6f47b73268f7 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:33.141810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89376d-a1d0-44d8-bd48-ffedb598c558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:33.142463 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89376d-a1d0-44d8-bd48-ffedb598c558 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:33.142743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89376d-a1d0-44d8-bd48-ffedb598c558 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:33.143015 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89376d-a1d0-44d8-bd48-ffedb598c558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:33.143839 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89376d-a1d0-44d8-bd48-ffedb598c558 None admin] RBAC: Adding query filter params (group.id=a946f3adcb454b468eaf2a2f877f90ff, role.id=3b7272bb6de3425fa18a474080a9c1a2, scope.project.id=bf617240dd564a84b2b9fde284824719) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:33.144145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89376d-a1d0-44d8-bd48-ffedb598c558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:33.144692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e76d7b-24d8-4f12-a5c0-2230fc5a0ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:33.145523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e76d7b-24d8-4f12-a5c0-2230fc5a0ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:33.145618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89376d-a1d0-44d8-bd48-ffedb598c558 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:33.145814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e76d7b-24d8-4f12-a5c0-2230fc5a0ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:33.146096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e76d7b-24d8-4f12-a5c0-2230fc5a0ba3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:33.161444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 221/431] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jul 21 22:16:32 2022] GET /identity/v3/role_assignments?group.id=a946f3adcb454b468eaf2a2f877f90ff&scope.project.id=bf617240dd564a84b2b9fde284824719&role.id=3b7272bb6de3425fa18a474080a9c1a2 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:33.161444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89376d-a1d0-44d8-bd48-ffedb598c558 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:33.164017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:33.167553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e76d7b-24d8-4f12-a5c0-2230fc5a0ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-b5e76d7b-24d8-4f12-a5c0-2230fc5a0ba3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:33.176075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:33.177094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:33.177876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:33.177876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:33.177876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:33.177876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:33.177876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:33.177876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:33.177876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:33.177876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:33.177876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:33.177876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:33.177876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 22:16:33.177876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:33.177876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 211/432] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:33.179107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f12bc2-c85b-431c-bf0c-f9649d9fb122 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:33.179107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f12bc2-c85b-431c-bf0c-f9649d9fb122 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:33.179362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f12bc2-c85b-431c-bf0c-f9649d9fb122 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:33.180913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 212/433] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:33.183251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f12bc2-c85b-431c-bf0c-f9649d9fb122 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:33.185700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:33.302645 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89376d-a1d0-44d8-bd48-ffedb598c558 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:33.308251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f12bc2-c85b-431c-bf0c-f9649d9fb122 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:33.345817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95bdae-9fd1-4ac6-84fe-f1906a7717b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:33.347105 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95bdae-9fd1-4ac6-84fe-f1906a7717b7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:33.347393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95bdae-9fd1-4ac6-84fe-f1906a7717b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:33.348100 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95bdae-9fd1-4ac6-84fe-f1906a7717b7 None admin] PATH_INFO: `/v3/groups/a946f3adcb454b468eaf2a2f877f90ff` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:33.348849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95bdae-9fd1-4ac6-84fe-f1906a7717b7 None admin] RBAC: Authorizing `identity:get_group(group_id=a946f3adcb454b468eaf2a2f877f90ff)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:33.349144 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397c7d2-8bf8-4b0f-8f36-988afdfda4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:33.349811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397c7d2-8bf8-4b0f-8f36-988afdfda4cd None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:33.350093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397c7d2-8bf8-4b0f-8f36-988afdfda4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:33.350329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95bdae-9fd1-4ac6-84fe-f1906a7717b7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:33.350446 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397c7d2-8bf8-4b0f-8f36-988afdfda4cd None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:33.351091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397c7d2-8bf8-4b0f-8f36-988afdfda4cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:33.351395 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397c7d2-8bf8-4b0f-8f36-988afdfda4cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:33.351954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 222/434] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jul 21 22:16:33 2022] GET /identity/v3/groups/a946f3adcb454b468eaf2a2f877f90ff => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:33.352745 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397c7d2-8bf8-4b0f-8f36-988afdfda4cd None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:33.354131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f31df-9a25-41fc-9881-7476c156d7a3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:33.354477 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f31df-9a25-41fc-9881-7476c156d7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:33.354767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f31df-9a25-41fc-9881-7476c156d7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:33.361747 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 213/435] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:16:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:33.362883 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff7bb1-9017-4e13-9be4-d51e56178243 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:33.363274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff7bb1-9017-4e13-9be4-d51e56178243 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:33.363458 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff7bb1-9017-4e13-9be4-d51e56178243 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:33.364637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 214/436] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:33.365365 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff7bb1-9017-4e13-9be4-d51e56178243 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:33.372636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-472f31df-9a25-41fc-9881-7476c156d7a3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:33.373884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-472f31df-9a25-41fc-9881-7476c156d7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:33.431563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:33.445842 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 223/437] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:33.447231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a5773-80a4-4a23-8075-886b80da2e8f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:33.447524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a5773-80a4-4a23-8075-886b80da2e8f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:33.447796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a5773-80a4-4a23-8075-886b80da2e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:33.469245 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-121a5773-80a4-4a23-8075-886b80da2e8f None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:33.470446 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-121a5773-80a4-4a23-8075-886b80da2e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:33.472247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff7bb1-9017-4e13-9be4-d51e56178243 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:33.473369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:33.505706 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4745d41-7b4e-4631-af44-c7a844e1c921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:33.506360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4745d41-7b4e-4631-af44-c7a844e1c921 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:33.506648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4745d41-7b4e-4631-af44-c7a844e1c921 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:33.506930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4745d41-7b4e-4631-af44-c7a844e1c921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:33.507764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4745d41-7b4e-4631-af44-c7a844e1c921 None admin] RBAC: Adding query filter params (group.id=a946f3adcb454b468eaf2a2f877f90ff, role.id=ffad03b6b6d1473dba5d5b7296943f18, scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:33.508080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4745d41-7b4e-4631-af44-c7a844e1c921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:33.509544 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4745d41-7b4e-4631-af44-c7a844e1c921 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:33.515972 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 215/438] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jul 21 22:16:33 2022] GET /identity/v3/role_assignments?group.id=a946f3adcb454b468eaf2a2f877f90ff&scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc&role.id=ffad03b6b6d1473dba5d5b7296943f18 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:33.516831 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4745d41-7b4e-4631-af44-c7a844e1c921 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:33.544402 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 224/439] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:33.545542 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a5773-80a4-4a23-8075-886b80da2e8f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:33.649695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4745d41-7b4e-4631-af44-c7a844e1c921 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:33.650689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a5773-80a4-4a23-8075-886b80da2e8f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:33.686204 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:33.694467 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff27e88-8d5a-4dba-ae89-c2d973b1dbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:33.695279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff27e88-8d5a-4dba-ae89-c2d973b1dbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:33.695563 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff27e88-8d5a-4dba-ae89-c2d973b1dbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:33.695835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff27e88-8d5a-4dba-ae89-c2d973b1dbd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:33.696596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68c3f2-0443-43ee-9918-4b8e7811090f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:33.697282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68c3f2-0443-43ee-9918-4b8e7811090f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:33.697575 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68c3f2-0443-43ee-9918-4b8e7811090f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:33.697857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68c3f2-0443-43ee-9918-4b8e7811090f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:33.704105 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:33.707484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff27e88-8d5a-4dba-ae89-c2d973b1dbd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-6ff27e88-8d5a-4dba-ae89-c2d973b1dbd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:33.717904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:33.718803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:33.721694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:33.721694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:33.721694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:33.721694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:33.721694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:33.721694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:33.721694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:33.721694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:33.721694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:33.721694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:33.721694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:33.721694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:33.721694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 225/440] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:16:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:33.721694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff27e88-8d5a-4dba-ae89-c2d973b1dbd1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:33.774441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68c3f2-0443-43ee-9918-4b8e7811090f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:33.776199 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68c3f2-0443-43ee-9918-4b8e7811090f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:33.820387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff27e88-8d5a-4dba-ae89-c2d973b1dbd1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:33.853555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529f5c0-6a03-4056-bc06-0214d415840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:33.854366 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529f5c0-6a03-4056-bc06-0214d415840f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:33.854657 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529f5c0-6a03-4056-bc06-0214d415840f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:33.854953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529f5c0-6a03-4056-bc06-0214d415840f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:33.864756 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529f5c0-6a03-4056-bc06-0214d415840f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-4529f5c0-6a03-4056-bc06-0214d415840f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:33.872437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:33.873546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:33.874602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:33.874602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:33.874602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:33.874602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:33.874602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:33.874602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:33.874602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:33.874602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:33.874602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:33.874602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:33.874602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:16:33.874602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:33.875186 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 216/441] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:33.875629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68c3f2-0443-43ee-9918-4b8e7811090f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:33.878623 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 226/442] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:16:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:33.879689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529f5c0-6a03-4056-bc06-0214d415840f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:33.903251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:33.938483 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:33.974996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68c3f2-0443-43ee-9918-4b8e7811090f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:33.979851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529f5c0-6a03-4056-bc06-0214d415840f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:34.008434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a17bf-1676-407b-81d3-47d813ff2c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:34.009131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a17bf-1676-407b-81d3-47d813ff2c23 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:34.009420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a17bf-1676-407b-81d3-47d813ff2c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:34.009697 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a17bf-1676-407b-81d3-47d813ff2c23 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:34.010438 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a17bf-1676-407b-81d3-47d813ff2c23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:34.011304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a17bf-1676-407b-81d3-47d813ff2c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:34.012412 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63717935-9ae8-4d2a-8096-0adf59f1918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:34.012679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a17bf-1676-407b-81d3-47d813ff2c23 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:34.013097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717935-9ae8-4d2a-8096-0adf59f1918a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:34.013379 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717935-9ae8-4d2a-8096-0adf59f1918a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:34.013652 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717935-9ae8-4d2a-8096-0adf59f1918a None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:34.014388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717935-9ae8-4d2a-8096-0adf59f1918a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:34.014689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717935-9ae8-4d2a-8096-0adf59f1918a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:34.016044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717935-9ae8-4d2a-8096-0adf59f1918a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:34.020584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 217/443] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:34.021415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a17bf-1676-407b-81d3-47d813ff2c23 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:34.024509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 227/444] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:34.026269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63717935-9ae8-4d2a-8096-0adf59f1918a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:34.113755 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:34.125537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a17bf-1676-407b-81d3-47d813ff2c23 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:34.134678 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63717935-9ae8-4d2a-8096-0adf59f1918a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:34.157595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:34.161898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c3bb0-4d20-44ce-9f3a-8aa3a993474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:34.162751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c3bb0-4d20-44ce-9f3a-8aa3a993474f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:34.163089 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c3bb0-4d20-44ce-9f3a-8aa3a993474f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:34.163368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c3bb0-4d20-44ce-9f3a-8aa3a993474f None admin] PATH_INFO: `/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:34.164556 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c3bb0-4d20-44ce-9f3a-8aa3a993474f None admin] RBAC: Authorizing `identity:get_project(project_id=7a4684cfef7d430aad38eb190fb3f5fc)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:34.166009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c3bb0-4d20-44ce-9f3a-8aa3a993474f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:34.167714 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 218/445] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:34 2022] GET /identity/v3/projects/7a4684cfef7d430aad38eb190fb3f5fc => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:34.168467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c3bb0-4d20-44ce-9f3a-8aa3a993474f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:34.169306 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60043c71-7d8d-4791-a5cb-ad3507863394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:34.169955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60043c71-7d8d-4791-a5cb-ad3507863394 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:34.170240 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60043c71-7d8d-4791-a5cb-ad3507863394 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:34.170518 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60043c71-7d8d-4791-a5cb-ad3507863394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:34.237522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60043c71-7d8d-4791-a5cb-ad3507863394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:34.238963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60043c71-7d8d-4791-a5cb-ad3507863394 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:34.267273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c3bb0-4d20-44ce-9f3a-8aa3a993474f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:34.300228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684fac3-8cbe-41dd-a3b6-308bf6d48019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:34.300854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684fac3-8cbe-41dd-a3b6-308bf6d48019 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:34.301165 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684fac3-8cbe-41dd-a3b6-308bf6d48019 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:34.301443 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684fac3-8cbe-41dd-a3b6-308bf6d48019 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:34.325655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:34.335134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 228/446] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:16:34.336022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60043c71-7d8d-4791-a5cb-ad3507863394 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:34.358854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:34.369518 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684fac3-8cbe-41dd-a3b6-308bf6d48019 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:34.371446 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684fac3-8cbe-41dd-a3b6-308bf6d48019 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:34.432175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60043c71-7d8d-4791-a5cb-ad3507863394 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:34.465206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 219/447] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:34.465591 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e300c-b3ea-49ad-99a6-7f00c3110078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:34.466017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684fac3-8cbe-41dd-a3b6-308bf6d48019 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:34.466440 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e300c-b3ea-49ad-99a6-7f00c3110078 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:34.466725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e300c-b3ea-49ad-99a6-7f00c3110078 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:34.467003 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e300c-b3ea-49ad-99a6-7f00c3110078 None admin] PATH_INFO: `/v3/groups/a946f3adcb454b468eaf2a2f877f90ff` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:34.468177 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e300c-b3ea-49ad-99a6-7f00c3110078 None admin] RBAC: Authorizing `identity:get_group(group_id=a946f3adcb454b468eaf2a2f877f90ff)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:34.469640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e300c-b3ea-49ad-99a6-7f00c3110078 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:34.472966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 229/448] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jul 21 22:16:34 2022] GET /identity/v3/groups/a946f3adcb454b468eaf2a2f877f90ff => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:34.472966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e300c-b3ea-49ad-99a6-7f00c3110078 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:34.525887 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:34.561298 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:34.569838 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684fac3-8cbe-41dd-a3b6-308bf6d48019 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:34.571228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e300c-b3ea-49ad-99a6-7f00c3110078 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:34.603631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf7fcb-4ca1-42f9-a76a-a2c64d9d7063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:34.605007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf7fcb-4ca1-42f9-a76a-a2c64d9d7063 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:34.605292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf7fcb-4ca1-42f9-a76a-a2c64d9d7063 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:34.605488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c479c2-f151-4a84-b025-a4137a1e5cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:34.605589 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf7fcb-4ca1-42f9-a76a-a2c64d9d7063 None admin] PATH_INFO: `/v3/projects/bf617240dd564a84b2b9fde284824719` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:34.606345 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c479c2-f151-4a84-b025-a4137a1e5cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:34.606625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c479c2-f151-4a84-b025-a4137a1e5cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:34.606720 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf7fcb-4ca1-42f9-a76a-a2c64d9d7063 None admin] RBAC: Authorizing `identity:get_project(project_id=bf617240dd564a84b2b9fde284824719)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:34.606904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c479c2-f151-4a84-b025-a4137a1e5cc3 None admin] PATH_INFO: `/v3/projects/cde20a12b28d4325b013339974b4c146` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:34.608075 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c479c2-f151-4a84-b025-a4137a1e5cc3 None admin] RBAC: Authorizing `identity:get_project(project_id=cde20a12b28d4325b013339974b4c146)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:34.608159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf7fcb-4ca1-42f9-a76a-a2c64d9d7063 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:34.609549 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c479c2-f151-4a84-b025-a4137a1e5cc3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:34.609837 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 220/449] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:34 2022] GET /identity/v3/projects/bf617240dd564a84b2b9fde284824719 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:34.610592 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf7fcb-4ca1-42f9-a76a-a2c64d9d7063 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:34.611348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 230/450] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:16:34 2022] GET /identity/v3/projects/cde20a12b28d4325b013339974b4c146 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:34.615376 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c479c2-f151-4a84-b025-a4137a1e5cc3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:34.712590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf7fcb-4ca1-42f9-a76a-a2c64d9d7063 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:34.716747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c479c2-f151-4a84-b025-a4137a1e5cc3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:34.735503 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:34.746944 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec67e23-0874-44b6-b46f-5d3d66e42f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:34.747596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec67e23-0874-44b6-b46f-5d3d66e42f71 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:34.747877 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec67e23-0874-44b6-b46f-5d3d66e42f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:34.748152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec67e23-0874-44b6-b46f-5d3d66e42f71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:34.749032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec67e23-0874-44b6-b46f-5d3d66e42f71 None admin] RBAC: Adding query filter params (group.id=a946f3adcb454b468eaf2a2f877f90ff, role.id=3b7272bb6de3425fa18a474080a9c1a2, scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:34.749343 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec67e23-0874-44b6-b46f-5d3d66e42f71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:34.750777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec67e23-0874-44b6-b46f-5d3d66e42f71 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:34.754455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86e91e-5189-4730-9b56-4753bfbcdc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:34.755305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86e91e-5189-4730-9b56-4753bfbcdc39 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:34.755582 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86e91e-5189-4730-9b56-4753bfbcdc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:34.755854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86e91e-5189-4730-9b56-4753bfbcdc39 None admin] PATH_INFO: `/v3/groups/a946f3adcb454b468eaf2a2f877f90ff` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:34.756622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 221/451] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jul 21 22:16:34 2022] GET /identity/v3/role_assignments?group.id=a946f3adcb454b468eaf2a2f877f90ff&scope.project.id=7a4684cfef7d430aad38eb190fb3f5fc&role.id=3b7272bb6de3425fa18a474080a9c1a2 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:34.757035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86e91e-5189-4730-9b56-4753bfbcdc39 None admin] RBAC: Authorizing `identity:get_group(group_id=a946f3adcb454b468eaf2a2f877f90ff)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:34.757329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec67e23-0874-44b6-b46f-5d3d66e42f71 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:34.758439 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86e91e-5189-4730-9b56-4753bfbcdc39 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:34.760190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 231/452] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jul 21 22:16:34 2022] GET /identity/v3/groups/a946f3adcb454b468eaf2a2f877f90ff => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:34.766133 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86e91e-5189-4730-9b56-4753bfbcdc39 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:34.796135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:34.871175 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec67e23-0874-44b6-b46f-5d3d66e42f71 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:34.878696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86e91e-5189-4730-9b56-4753bfbcdc39 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:34.909465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c6ffb-489a-47fb-b9cd-99b84b3e6c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:34.910346 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c6ffb-489a-47fb-b9cd-99b84b3e6c83 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:34.910612 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c6ffb-489a-47fb-b9cd-99b84b3e6c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:34.910889 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c6ffb-489a-47fb-b9cd-99b84b3e6c83 None admin] PATH_INFO: `/v3/groups/04209841ab1c4bab822fe85c24410f61` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:34.912079 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c6ffb-489a-47fb-b9cd-99b84b3e6c83 None admin] RBAC: Authorizing `identity:get_group(group_id=04209841ab1c4bab822fe85c24410f61)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:34.913572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c6ffb-489a-47fb-b9cd-99b84b3e6c83 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:34.915280 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 222/453] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jul 21 22:16:34 2022] GET /identity/v3/groups/04209841ab1c4bab822fe85c24410f61 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:34.918015 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1b2ed-0bc7-4486-a43b-c2233cda0218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:34.918671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1b2ed-0bc7-4486-a43b-c2233cda0218 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:34.918960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1b2ed-0bc7-4486-a43b-c2233cda0218 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:34.919236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1b2ed-0bc7-4486-a43b-c2233cda0218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:34.920070 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1b2ed-0bc7-4486-a43b-c2233cda0218 None admin] RBAC: Adding query filter params (group.id=a946f3adcb454b468eaf2a2f877f90ff, role.id=ffad03b6b6d1473dba5d5b7296943f18, scope.project.id=bf617240dd564a84b2b9fde284824719) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:34.920385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1b2ed-0bc7-4486-a43b-c2233cda0218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:34.921667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c6ffb-489a-47fb-b9cd-99b84b3e6c83 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:34.923005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1b2ed-0bc7-4486-a43b-c2233cda0218 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:34.929802 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 232/454] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jul 21 22:16:34 2022] GET /identity/v3/role_assignments?group.id=a946f3adcb454b468eaf2a2f877f90ff&scope.project.id=bf617240dd564a84b2b9fde284824719&role.id=ffad03b6b6d1473dba5d5b7296943f18 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:34.985140 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:35.037181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c6ffb-489a-47fb-b9cd-99b84b3e6c83 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:35.084492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ae4df-57fb-47c9-8054-095c8a1d1330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:35.085043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ae4df-57fb-47c9-8054-095c8a1d1330 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:35.085320 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ae4df-57fb-47c9-8054-095c8a1d1330 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:35.087006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ae4df-57fb-47c9-8054-095c8a1d1330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:35.087006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ae4df-57fb-47c9-8054-095c8a1d1330 None admin] RBAC: Adding query filter params (group.id=04209841ab1c4bab822fe85c24410f61, role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=cde20a12b28d4325b013339974b4c146) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:35.087006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ae4df-57fb-47c9-8054-095c8a1d1330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:35.088155 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ae4df-57fb-47c9-8054-095c8a1d1330 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:35.095523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 223/455] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jul 21 22:16:34 2022] GET /identity/v3/role_assignments?group.id=04209841ab1c4bab822fe85c24410f61&scope.project.id=cde20a12b28d4325b013339974b4c146&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:37.744127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abdc84-268b-48c4-bf07-cd83790bcd2b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:37.745705 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abdc84-268b-48c4-bf07-cd83790bcd2b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:37.746204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abdc84-268b-48c4-bf07-cd83790bcd2b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:37.748041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 233/456] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:37.753688 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1e96f-3392-4bbf-9669-0934aedc267b None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:37.754536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1e96f-3392-4bbf-9669-0934aedc267b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:37.755040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1e96f-3392-4bbf-9669-0934aedc267b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:37.778148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-fbb1e96f-3392-4bbf-9669-0934aedc267b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:37.779683 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-fbb1e96f-3392-4bbf-9669-0934aedc267b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:37.866770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 224/457] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:37.915803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abdc84-268b-48c4-bf07-cd83790bcd2b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:38.044140 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:38.054852 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abdc84-268b-48c4-bf07-cd83790bcd2b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:38.114732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31f53e-9255-4b31-bb7b-8ddcdc5e569a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:38.115532 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31f53e-9255-4b31-bb7b-8ddcdc5e569a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:38.115818 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31f53e-9255-4b31-bb7b-8ddcdc5e569a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:38.116098 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31f53e-9255-4b31-bb7b-8ddcdc5e569a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:38.132645 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31f53e-9255-4b31-bb7b-8ddcdc5e569a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:38.134142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31f53e-9255-4b31-bb7b-8ddcdc5e569a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:38.156695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3e31f53e-9255-4b31-bb7b-8ddcdc5e569a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:38.156695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:38.156695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:38.156695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:38.156695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:38.156695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:38.156695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:38.156695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:38.156695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:38.156695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:38.156695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:38.156695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:38.156695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:38.156695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:38.156695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:38.157665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:38.158483 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:38.158483 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:38.158483 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:38.158483 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:38.160837 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 234/458] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:38.166615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1e96f-3392-4bbf-9669-0934aedc267b None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:38.178796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bfbaa-a6b8-4c03-b96c-0f7260666e70 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:38.179077 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bfbaa-a6b8-4c03-b96c-0f7260666e70 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:38.179523 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bfbaa-a6b8-4c03-b96c-0f7260666e70 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:38.182303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 235/459] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:38.190291 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b24a-fd94-4217-92cc-2cb4986455d3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:38.190780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b24a-fd94-4217-92cc-2cb4986455d3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:38.191239 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b24a-fd94-4217-92cc-2cb4986455d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:38.237303 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:38.237985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b411b24a-fd94-4217-92cc-2cb4986455d3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:38.239194 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b411b24a-fd94-4217-92cc-2cb4986455d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:38.279371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1e96f-3392-4bbf-9669-0934aedc267b None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:38.319690 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00862184-9966-4f01-bed5-b6c7c269a7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:38.320608 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00862184-9966-4f01-bed5-b6c7c269a7da None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:38.321266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00862184-9966-4f01-bed5-b6c7c269a7da None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:38.322296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00862184-9966-4f01-bed5-b6c7c269a7da None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:38.323733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00862184-9966-4f01-bed5-b6c7c269a7da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:38.328891 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00862184-9966-4f01-bed5-b6c7c269a7da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:38.330483 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00862184-9966-4f01-bed5-b6c7c269a7da None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:38.352006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 225/460] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:38.363024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00862184-9966-4f01-bed5-b6c7c269a7da None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:38.377972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 236/461] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:38.377972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4dbd2-bc81-4ffd-83c6-e7b56ec8ea4a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:38.377972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4dbd2-bc81-4ffd-83c6-e7b56ec8ea4a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:38.377972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4dbd2-bc81-4ffd-83c6-e7b56ec8ea4a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:38.377972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 237/462] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:38.383185 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d420ee-851d-4ee8-a1e1-c8bd1993edad None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:38.383471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d420ee-851d-4ee8-a1e1-c8bd1993edad None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:38.383747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d420ee-851d-4ee8-a1e1-c8bd1993edad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:38.412861 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-55d420ee-851d-4ee8-a1e1-c8bd1993edad None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:38.414176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-55d420ee-851d-4ee8-a1e1-c8bd1993edad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:38.484718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 238/463] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:38.486031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d420ee-851d-4ee8-a1e1-c8bd1993edad None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:38.488575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:38.492986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00862184-9966-4f01-bed5-b6c7c269a7da None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:38.504789 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:38.533726 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7160c5-7af4-4264-8cca-1906ebe6d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:38.534401 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7160c5-7af4-4264-8cca-1906ebe6d6fb None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:38.534682 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7160c5-7af4-4264-8cca-1906ebe6d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:38.534956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7160c5-7af4-4264-8cca-1906ebe6d6fb None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:38.535655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7160c5-7af4-4264-8cca-1906ebe6d6fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:38.537102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7160c5-7af4-4264-8cca-1906ebe6d6fb None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:38.569024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 226/464] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:16:38 2022] POST /identity/v3/users => generated 246 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:16:38.570166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7160c5-7af4-4264-8cca-1906ebe6d6fb None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:38.675991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d420ee-851d-4ee8-a1e1-c8bd1993edad None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:38.724833 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185302b-6a83-41e5-b1a1-71609c93acbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:38.725698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185302b-6a83-41e5-b1a1-71609c93acbe None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:38.725978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185302b-6a83-41e5-b1a1-71609c93acbe None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:38.726254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185302b-6a83-41e5-b1a1-71609c93acbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:38.737335 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7160c5-7af4-4264-8cca-1906ebe6d6fb None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:38.750313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185302b-6a83-41e5-b1a1-71609c93acbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:38.752555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185302b-6a83-41e5-b1a1-71609c93acbe None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:38.773633 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decae67a-9ac4-456f-b8f1-86163293164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:38.775064 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decae67a-9ac4-456f-b8f1-86163293164a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:38.775486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decae67a-9ac4-456f-b8f1-86163293164a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:38.775899 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decae67a-9ac4-456f-b8f1-86163293164a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:38.776737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-f185302b-6a83-41e5-b1a1-71609c93acbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:38.776737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:38.776737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:38.776737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:38.776737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:38.776737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:38.776737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:38.776737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:38.776737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:38.776737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:38.776737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:38.776737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:38.776737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:38.776737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:38.776737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:38.777726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:38.778937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:38.778937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:38.778937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:38.778937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:38.778937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 239/465] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:38.784558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834d09b-2c70-4852-80a3-21fbfebe1ae1 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:38.784558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834d09b-2c70-4852-80a3-21fbfebe1ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:38.784558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834d09b-2c70-4852-80a3-21fbfebe1ae1 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:38.784558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 240/466] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:38.787385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834d09b-2c70-4852-80a3-21fbfebe1ae1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:38.799764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decae67a-9ac4-456f-b8f1-86163293164a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:38.801874 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decae67a-9ac4-456f-b8f1-86163293164a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:38.824006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-decae67a-9ac4-456f-b8f1-86163293164a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:38.824006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:38.824006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:38.824006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:38.824006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:38.824006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:38.824006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:38.824006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:38.824006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:38.824006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:38.824006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:38.824006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:38.824006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:38.824006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:38.824006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:38.825019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:38.826043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:38.826043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:38.826043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:38.826043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:38.827900 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 227/467] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:38.833909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36ebbd-ed86-456b-a0f9-d4fe7a3d340c None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:38.834389 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36ebbd-ed86-456b-a0f9-d4fe7a3d340c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:38.834818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36ebbd-ed86-456b-a0f9-d4fe7a3d340c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:38.858239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-3f36ebbd-ed86-456b-a0f9-d4fe7a3d340c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:38.860237 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-3f36ebbd-ed86-456b-a0f9-d4fe7a3d340c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:38.862302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:38.878256 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:38.925770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834d09b-2c70-4852-80a3-21fbfebe1ae1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:38.938760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 228/468] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:38.939155 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36ebbd-ed86-456b-a0f9-d4fe7a3d340c None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:38.972343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b969b-19a4-44d0-8d50-ec27ef5fbc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:38.974221 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b969b-19a4-44d0-8d50-ec27ef5fbc79 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:38.974734 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b969b-19a4-44d0-8d50-ec27ef5fbc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:38.975211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b969b-19a4-44d0-8d50-ec27ef5fbc79 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:38.976224 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b969b-19a4-44d0-8d50-ec27ef5fbc79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:38.976734 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b969b-19a4-44d0-8d50-ec27ef5fbc79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:38.978766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b969b-19a4-44d0-8d50-ec27ef5fbc79 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:38.992704 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 241/469] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:38.998427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b969b-19a4-44d0-8d50-ec27ef5fbc79 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:39.060530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36ebbd-ed86-456b-a0f9-d4fe7a3d340c None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:39.112762 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49ecbb-0fcd-40ce-8e7b-3c249e6c5d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:39.113991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49ecbb-0fcd-40ce-8e7b-3c249e6c5d32 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:39.114424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49ecbb-0fcd-40ce-8e7b-3c249e6c5d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:39.115224 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49ecbb-0fcd-40ce-8e7b-3c249e6c5d32 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:39.116369 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49ecbb-0fcd-40ce-8e7b-3c249e6c5d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:39.116824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49ecbb-0fcd-40ce-8e7b-3c249e6c5d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:39.118074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b969b-19a4-44d0-8d50-ec27ef5fbc79 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:39.118529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49ecbb-0fcd-40ce-8e7b-3c249e6c5d32 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:39.134040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:39.140962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 229/470] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:39.140962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49ecbb-0fcd-40ce-8e7b-3c249e6c5d32 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:39.154315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:39.162601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bde64-1bef-4d78-b057-62f5798110e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:39.163405 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bde64-1bef-4d78-b057-62f5798110e4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:39.163685 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bde64-1bef-4d78-b057-62f5798110e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:39.163958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bde64-1bef-4d78-b057-62f5798110e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:39.176674 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bde64-1bef-4d78-b057-62f5798110e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:39.178362 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bde64-1bef-4d78-b057-62f5798110e4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:39.197471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-bd2bde64-1bef-4d78-b057-62f5798110e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:39.197471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:39.197471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:39.197471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:39.197471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:39.197471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:39.197471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:39.197471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:39.197471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:39.197471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:39.197471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:39.197471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:39.197471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:39.197471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:39.197471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:39.198387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:39.199211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:39.199211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:39.199211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:39.199211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:39.199211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 242/471] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:39.199955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bde64-1bef-4d78-b057-62f5798110e4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:39.263526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49ecbb-0fcd-40ce-8e7b-3c249e6c5d32 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:39.298045 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f71152-b5c7-44ac-b292-7d02f29260b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:39.298711 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f71152-b5c7-44ac-b292-7d02f29260b2 None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:39.298995 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f71152-b5c7-44ac-b292-7d02f29260b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:39.299277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f71152-b5c7-44ac-b292-7d02f29260b2 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:39.299975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f71152-b5c7-44ac-b292-7d02f29260b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:39.301446 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f71152-b5c7-44ac-b292-7d02f29260b2 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:39.321837 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 230/472] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:16:39 2022] POST /identity/v3/users => generated 248 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:16:39.322627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f71152-b5c7-44ac-b292-7d02f29260b2 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:39.336215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bde64-1bef-4d78-b057-62f5798110e4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:39.383392 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f28e4-4d11-4630-a628-401a871e9628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:39.384451 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f28e4-4d11-4630-a628-401a871e9628 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:39.384880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f28e4-4d11-4630-a628-401a871e9628 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:39.385629 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f28e4-4d11-4630-a628-401a871e9628 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:39.386989 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f28e4-4d11-4630-a628-401a871e9628 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:39.388663 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f28e4-4d11-4630-a628-401a871e9628 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:39.408514 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:39.425169 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 243/473] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:16:39 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:16:39.429015 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224ede1-7b92-423d-a1d6-396e0a1f9e2d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:39.429831 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224ede1-7b92-423d-a1d6-396e0a1f9e2d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:39.431181 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224ede1-7b92-423d-a1d6-396e0a1f9e2d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:39.438242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 244/474] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:39 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:39.447628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af4a4d-1744-4f12-a2da-60e14dbd8ab8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:39.447628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af4a4d-1744-4f12-a2da-60e14dbd8ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:39.447628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af4a4d-1744-4f12-a2da-60e14dbd8ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:39.473402 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-65af4a4d-1744-4f12-a2da-60e14dbd8ab8 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:39.474775 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-65af4a4d-1744-4f12-a2da-60e14dbd8ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:39.495978 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f71152-b5c7-44ac-b292-7d02f29260b2 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:39.518685 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:39.553743 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170a2e5-349e-4f8f-a958-d3fd3715ec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:39.554430 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a2e5-349e-4f8f-a958-d3fd3715ec8d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:39.554764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a2e5-349e-4f8f-a958-d3fd3715ec8d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:39.555044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a2e5-349e-4f8f-a958-d3fd3715ec8d None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:39.557058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170a2e5-349e-4f8f-a958-d3fd3715ec8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:39.557453 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170a2e5-349e-4f8f-a958-d3fd3715ec8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:39.558871 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170a2e5-349e-4f8f-a958-d3fd3715ec8d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:39.572878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 231/475] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:39.578498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170a2e5-349e-4f8f-a958-d3fd3715ec8d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:39.603653 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 245/476] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:16:39.633364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af4a4d-1744-4f12-a2da-60e14dbd8ab8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:39.709639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170a2e5-349e-4f8f-a958-d3fd3715ec8d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:39.741072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:39.756443 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9ab26-b8bd-411e-a41a-b27dd9c45c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:39.757417 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9ab26-b8bd-411e-a41a-b27dd9c45c85 None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:39.757703 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9ab26-b8bd-411e-a41a-b27dd9c45c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:39.758198 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9ab26-b8bd-411e-a41a-b27dd9c45c85 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:39.759264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9ab26-b8bd-411e-a41a-b27dd9c45c85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:39.761227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9ab26-b8bd-411e-a41a-b27dd9c45c85 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:39.765394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af4a4d-1744-4f12-a2da-60e14dbd8ab8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:39.790943 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 232/477] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:16:39 2022] POST /identity/v3/users => generated 249 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:16:39.814954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a5922-d6f2-4873-9185-4854837dcf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:39.815718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a5922-d6f2-4873-9185-4854837dcf7b None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:39.816004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a5922-d6f2-4873-9185-4854837dcf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:39.816306 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a5922-d6f2-4873-9185-4854837dcf7b None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:39.817185 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a5922-d6f2-4873-9185-4854837dcf7b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:39.818696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a5922-d6f2-4873-9185-4854837dcf7b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:39.828470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.sql.core [None req-513a5922-d6f2-4873-9185-4854837dcf7b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 22:16:39.828470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 22:16:39.828470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [parameters: {'id': '5058e6d248bc4e12a2286693c3d8f74a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 22:16:39.828470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80106) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 22:16:39.846767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-513a5922-d6f2-4873-9185-4854837dcf7b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 22:16:39.846767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:39.846767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 22:16:39.846767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 22:16:39.846767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 22:16:39.846767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 22:16:39.846767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 22:16:39.846767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 22:16:39.846767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 22:16:39.846767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application conn.query(q) Jul 21 22:16:39.846767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 22:16:39.846767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 22:16:39.846767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 22:16:39.846767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result.read() Jul 21 22:16:39.846767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 22:16:39.848791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application next(self.gen) Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application yield resource Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application next(self.gen) Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise self.value Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application session.commit() Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 22:16:39.851110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.session.flush() Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application compat.raise_( Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 22:16:39.853201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 22:16:39.855275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application conn.query(q) Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result.read() Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 22:16:39.857170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [parameters: {'id': '5058e6d248bc4e12a2286693c3d8f74a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:39.861115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 22:16:39.862043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:39.862845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 246/478] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Jul 21 22:16:39 2022] POST /identity/v3/roles => generated 144 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:16:39.862918 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9ab26-b8bd-411e-a41a-b27dd9c45c85 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:39.979843 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9ab26-b8bd-411e-a41a-b27dd9c45c85 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:40.015897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be8549-9a29-4d42-823f-872f3be5e752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:40.016714 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be8549-9a29-4d42-823f-872f3be5e752 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:40.017031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be8549-9a29-4d42-823f-872f3be5e752 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:40.017306 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be8549-9a29-4d42-823f-872f3be5e752 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:40.028527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be8549-9a29-4d42-823f-872f3be5e752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-09be8549-9a29-4d42-823f-872f3be5e752 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:40.036958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:40.037826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:40.039027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:40.039027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:40.039027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:40.039027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:40.039027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:40.039027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:40.039027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:40.039027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:40.039027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:40.039027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:40.039027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 22:16:40.039027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:40.039027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 233/479] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:16:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:40.044546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a5922-d6f2-4873-9185-4854837dcf7b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:40.066306 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:40.152776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a5922-d6f2-4873-9185-4854837dcf7b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:40.187552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7340dd-843b-403a-a009-489f73eb3821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:40.188224 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7340dd-843b-403a-a009-489f73eb3821 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:40.188511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7340dd-843b-403a-a009-489f73eb3821 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:40.188799 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7340dd-843b-403a-a009-489f73eb3821 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:40.189595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7340dd-843b-403a-a009-489f73eb3821 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:40.189907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7340dd-843b-403a-a009-489f73eb3821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:40.191292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7340dd-843b-403a-a009-489f73eb3821 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:40.200715 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 247/480] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:40.889590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b3141-ac7e-44f1-b2d9-0835178db6db None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:40.890137 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b3141-ac7e-44f1-b2d9-0835178db6db None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:40.890137 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b3141-ac7e-44f1-b2d9-0835178db6db None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:40.891760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 234/481] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:40.897035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcefa42-f162-4cdd-8403-3840de188565 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:40.897452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcefa42-f162-4cdd-8403-3840de188565 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:40.897637 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcefa42-f162-4cdd-8403-3840de188565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:40.914440 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1dcefa42-f162-4cdd-8403-3840de188565 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:40.915608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1dcefa42-f162-4cdd-8403-3840de188565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:41.001452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 248/482] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:41.047289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b3141-ac7e-44f1-b2d9-0835178db6db None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:41.105130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:41.194627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b3141-ac7e-44f1-b2d9-0835178db6db None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:41.245587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33502cae-148c-400d-b6fc-40b6037c4f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:41.246408 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33502cae-148c-400d-b6fc-40b6037c4f7b None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:41.246690 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33502cae-148c-400d-b6fc-40b6037c4f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:41.246964 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33502cae-148c-400d-b6fc-40b6037c4f7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:41.261711 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33502cae-148c-400d-b6fc-40b6037c4f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-33502cae-148c-400d-b6fc-40b6037c4f7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:41.269495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:41.270374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:41.271145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:41.271145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:41.271145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:41.271145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:41.271145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:41.271145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:41.271145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:41.271145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:41.271145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:41.271145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:41.271145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:41.271145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:41.271145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 235/483] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:41.277521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcefa42-f162-4cdd-8403-3840de188565 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:41.297273 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:41.433164 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcefa42-f162-4cdd-8403-3840de188565 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:41.477811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8ff3d-6d44-499c-a46b-335047ffd91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:41.478393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8ff3d-6d44-499c-a46b-335047ffd91c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:41.478675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8ff3d-6d44-499c-a46b-335047ffd91c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:41.478947 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8ff3d-6d44-499c-a46b-335047ffd91c None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:41.480227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8ff3d-6d44-499c-a46b-335047ffd91c None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:41.480527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8ff3d-6d44-499c-a46b-335047ffd91c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:41.481906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8ff3d-6d44-499c-a46b-335047ffd91c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:41.496006 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 249/484] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:16:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:41.501413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33502cae-148c-400d-b6fc-40b6037c4f7b None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:41.654663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:41.659259 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33502cae-148c-400d-b6fc-40b6037c4f7b None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:41.708147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d81b4-a19c-46f9-9486-0d11652248da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:41.708953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d81b4-a19c-46f9-9486-0d11652248da None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:41.709257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d81b4-a19c-46f9-9486-0d11652248da None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:41.709526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d81b4-a19c-46f9-9486-0d11652248da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:41.726854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d81b4-a19c-46f9-9486-0d11652248da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:41.728369 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d81b4-a19c-46f9-9486-0d11652248da None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:41.751917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-603d81b4-a19c-46f9-9486-0d11652248da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:41.751917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:41.751917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:41.751917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:41.751917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:41.751917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:41.751917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:41.751917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:41.751917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:41.751917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:41.751917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:41.751917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:41.751917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:41.751917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:41.751917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:41.753954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:41.755994 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:41.755994 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:41.755994 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:41.755994 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:41.760962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 236/485] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:41.763422 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8ff3d-6d44-499c-a46b-335047ffd91c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:41.874864 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:41.906424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8ff3d-6d44-499c-a46b-335047ffd91c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:41.940865 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66435f-acfa-495d-a6fb-c997f3eff6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:41.941547 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66435f-acfa-495d-a6fb-c997f3eff6be None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:41.941827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66435f-acfa-495d-a6fb-c997f3eff6be None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:41.942106 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66435f-acfa-495d-a6fb-c997f3eff6be None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:41.942825 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66435f-acfa-495d-a6fb-c997f3eff6be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:41.943127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66435f-acfa-495d-a6fb-c997f3eff6be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:41.944500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66435f-acfa-495d-a6fb-c997f3eff6be None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:41.956710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 250/486] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:41.962164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d81b4-a19c-46f9-9486-0d11652248da None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:42.123684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d81b4-a19c-46f9-9486-0d11652248da None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:42.129861 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6503e8c-29b0-4cff-9777-d64469b5ec9f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:42.130145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6503e8c-29b0-4cff-9777-d64469b5ec9f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:42.130424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6503e8c-29b0-4cff-9777-d64469b5ec9f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:42.132028 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 251/487] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:42.137348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e814b75-b776-462f-a7d4-49daf285d745 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:42.137631 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e814b75-b776-462f-a7d4-49daf285d745 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:42.137908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e814b75-b776-462f-a7d4-49daf285d745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:42.156333 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9e814b75-b776-462f-a7d4-49daf285d745 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:42.157546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9e814b75-b776-462f-a7d4-49daf285d745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:42.163259 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2b876-67ab-4ea2-8382-e34a34c337f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:42.164281 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2b876-67ab-4ea2-8382-e34a34c337f3 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:42.164740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2b876-67ab-4ea2-8382-e34a34c337f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:42.165498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2b876-67ab-4ea2-8382-e34a34c337f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:42.177038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2b876-67ab-4ea2-8382-e34a34c337f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:42.178950 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2b876-67ab-4ea2-8382-e34a34c337f3 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-cda2b876-67ab-4ea2-8382-e34a34c337f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:16:42.199954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:42.200917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:42.201852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:42.201852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:42.201852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:16:42.201852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:16:42.201852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:16:42.201852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:16:42.201852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:16:42.201852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:16:42.201852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:16:42.201852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:42.201852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 237/488] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jul 21 22:16:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:42.202968 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d742285-63c6-43f6-afe5-036299a24f45 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:42.203290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d742285-63c6-43f6-afe5-036299a24f45 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:42.203482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d742285-63c6-43f6-afe5-036299a24f45 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:42.205479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 238/489] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:42.206621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d742285-63c6-43f6-afe5-036299a24f45 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:42.226545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:42.240520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 252/490] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:42.242455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ee942-f21c-49a7-ab15-21faaf2d2f1f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:42.242750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ee942-f21c-49a7-ab15-21faaf2d2f1f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:42.243460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ee942-f21c-49a7-ab15-21faaf2d2f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:42.267739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2e4ee942-f21c-49a7-ab15-21faaf2d2f1f None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:42.268963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2e4ee942-f21c-49a7-ab15-21faaf2d2f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:42.339481 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:42.346418 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d742285-63c6-43f6-afe5-036299a24f45 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:42.357212 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 253/491] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:42.358109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ee942-f21c-49a7-ab15-21faaf2d2f1f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:42.405926 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d4ef2-fc8e-4c63-9166-c615100d7e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:42.406777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d4ef2-fc8e-4c63-9166-c615100d7e9e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:42.407173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d4ef2-fc8e-4c63-9166-c615100d7e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:42.407547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d4ef2-fc8e-4c63-9166-c615100d7e9e None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:42.408920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d4ef2-fc8e-4c63-9166-c615100d7e9e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:42.409359 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d4ef2-fc8e-4c63-9166-c615100d7e9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:42.411267 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d4ef2-fc8e-4c63-9166-c615100d7e9e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:42.460762 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 239/492] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jul 21 22:16:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:42.461891 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d4ef2-fc8e-4c63-9166-c615100d7e9e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:42.469600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ee942-f21c-49a7-ab15-21faaf2d2f1f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:42.504587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e75e19-d63d-4adf-9da1-7ab63705394c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:42.505584 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e75e19-d63d-4adf-9da1-7ab63705394c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:42.505973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e75e19-d63d-4adf-9da1-7ab63705394c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:42.506354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e75e19-d63d-4adf-9da1-7ab63705394c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:42.524307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e75e19-d63d-4adf-9da1-7ab63705394c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-79e75e19-d63d-4adf-9da1-7ab63705394c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:42.535218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:42.536138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:42.536907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:42.536907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:42.536907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:42.536907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:42.536907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:42.536907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:42.536907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:42.536907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:42.536907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:42.536907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:42.536907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:42.536907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:42.540948 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 254/493] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:42.540948 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e75e19-d63d-4adf-9da1-7ab63705394c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:42.550878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:42.585652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d4ef2-fc8e-4c63-9166-c615100d7e9e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:42.610062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:42.623252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee0f58-45c9-46d9-b3c5-e53591d5a64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:42.624243 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee0f58-45c9-46d9-b3c5-e53591d5a64a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:42.624593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee0f58-45c9-46d9-b3c5-e53591d5a64a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:42.624964 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee0f58-45c9-46d9-b3c5-e53591d5a64a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:42.636889 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee0f58-45c9-46d9-b3c5-e53591d5a64a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-5bee0f58-45c9-46d9-b3c5-e53591d5a64a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:42.646957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:42.648024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:42.649028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:42.649028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:42.649028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:42.649028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:42.649028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:42.649028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:42.649028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:42.649028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:42.649028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:42.649028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:42.649028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:42.649028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:42.649732 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 240/494] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:42.649884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee0f58-45c9-46d9-b3c5-e53591d5a64a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:42.684485 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e75e19-d63d-4adf-9da1-7ab63705394c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:42.720620 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4349846-46a1-4c67-88be-5f9a37b14eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:42.721180 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4349846-46a1-4c67-88be-5f9a37b14eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:42.721471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4349846-46a1-4c67-88be-5f9a37b14eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:42.721755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4349846-46a1-4c67-88be-5f9a37b14eb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:42.777013 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee0f58-45c9-46d9-b3c5-e53591d5a64a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:42.802433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4349846-46a1-4c67-88be-5f9a37b14eb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:42.803994 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4349846-46a1-4c67-88be-5f9a37b14eb2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:42.807800 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:42.814631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aaeaae-6866-4768-ae03-89b3742a5be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:42.815531 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaeaae-6866-4768-ae03-89b3742a5be1 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:42.815971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaeaae-6866-4768-ae03-89b3742a5be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:42.816246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaeaae-6866-4768-ae03-89b3742a5be1 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:42.817019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aaeaae-6866-4768-ae03-89b3742a5be1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:42.817327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aaeaae-6866-4768-ae03-89b3742a5be1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:42.818705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aaeaae-6866-4768-ae03-89b3742a5be1 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:42.826974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 241/495] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:16:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:42.827756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aaeaae-6866-4768-ae03-89b3742a5be1 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:42.855289 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:42.907143 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 255/496] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:42.908448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808c4b4-b427-4354-959f-4616238836db None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:42.908744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808c4b4-b427-4354-959f-4616238836db None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:42.909060 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808c4b4-b427-4354-959f-4616238836db None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:42.913083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 256/497] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:42.913083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab553ea-4017-45d8-b827-a802ed1f4a7a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:42.913083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab553ea-4017-45d8-b827-a802ed1f4a7a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:42.913083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab553ea-4017-45d8-b827-a802ed1f4a7a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:42.917211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 257/498] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:42.917211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab553ea-4017-45d8-b827-a802ed1f4a7a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:42.932225 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aaeaae-6866-4768-ae03-89b3742a5be1 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:42.965166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbf180-76bf-41e4-8c2c-65e50adbd9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:42.965834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbf180-76bf-41e4-8c2c-65e50adbd9eb None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:42.966116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbf180-76bf-41e4-8c2c-65e50adbd9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:42.966393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbf180-76bf-41e4-8c2c-65e50adbd9eb None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:42.967152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbf180-76bf-41e4-8c2c-65e50adbd9eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:42.967449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbf180-76bf-41e4-8c2c-65e50adbd9eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:42.968814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbf180-76bf-41e4-8c2c-65e50adbd9eb None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:42.976545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 242/499] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:16:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:42.977341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbf180-76bf-41e4-8c2c-65e50adbd9eb None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:43.013417 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab553ea-4017-45d8-b827-a802ed1f4a7a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:43.030240 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:43.046871 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa445b-454d-436f-9444-e3f2698ec94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:43.047644 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa445b-454d-436f-9444-e3f2698ec94f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:43.047922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa445b-454d-436f-9444-e3f2698ec94f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:43.048192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa445b-454d-436f-9444-e3f2698ec94f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:43.058503 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa445b-454d-436f-9444-e3f2698ec94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:43.059958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa445b-454d-436f-9444-e3f2698ec94f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:43.076091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbf180-76bf-41e4-8c2c-65e50adbd9eb None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:43.078511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-0faa445b-454d-436f-9444-e3f2698ec94f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:43.078511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:43.078511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:43.078511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:43.078511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:43.078511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:43.078511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:43.078511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:43.078511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:43.078511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:43.078511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:43.078511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:43.078511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:43.078511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:43.078511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:43.079497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:43.080518 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:43.080518 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:43.080518 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:43.080518 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:43.080518 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 258/500] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:43.080866 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3787a-3779-435e-ae35-cbc4fb9313b3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:43.081176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3787a-3779-435e-ae35-cbc4fb9313b3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:43.081452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3787a-3779-435e-ae35-cbc4fb9313b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:43.086162 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:43.097808 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-84a3787a-3779-435e-ae35-cbc4fb9313b3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:43.098973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-84a3787a-3779-435e-ae35-cbc4fb9313b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:43.112522 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d602b-c94e-4b9e-bf50-e76cd3bd5e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:43.113348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d602b-c94e-4b9e-bf50-e76cd3bd5e69 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:43.113636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d602b-c94e-4b9e-bf50-e76cd3bd5e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:43.113915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d602b-c94e-4b9e-bf50-e76cd3bd5e69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:43.125268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d602b-c94e-4b9e-bf50-e76cd3bd5e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:43.126775 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d602b-c94e-4b9e-bf50-e76cd3bd5e69 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:43.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-d45d602b-c94e-4b9e-bf50-e76cd3bd5e69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:43.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:43.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:43.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:43.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:43.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:43.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:43.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:43.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:43.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:43.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:43.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:43.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:43.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:43.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:43.145128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:43.150639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:43.150639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:43.150639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:43.150639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:43.150639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 243/501] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:43.150639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568a261-48a5-4baf-84a8-cc97875efbee None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:43.150639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568a261-48a5-4baf-84a8-cc97875efbee None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:43.150639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568a261-48a5-4baf-84a8-cc97875efbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:43.164416 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-0568a261-48a5-4baf-84a8-cc97875efbee None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:43.165551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0568a261-48a5-4baf-84a8-cc97875efbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:43.168111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 259/502] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:43.168950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3787a-3779-435e-ae35-cbc4fb9313b3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:43.231828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 244/503] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:43.232656 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568a261-48a5-4baf-84a8-cc97875efbee None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:43.265591 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:43.278434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3787a-3779-435e-ae35-cbc4fb9313b3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:43.306746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:43.312407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b976c6-d290-4c66-b3a0-49612b21deb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:43.313234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b976c6-d290-4c66-b3a0-49612b21deb0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:43.313513 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b976c6-d290-4c66-b3a0-49612b21deb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:43.313786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b976c6-d290-4c66-b3a0-49612b21deb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:43.324327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b976c6-d290-4c66-b3a0-49612b21deb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:43.325816 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b976c6-d290-4c66-b3a0-49612b21deb0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:43.330306 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568a261-48a5-4baf-84a8-cc97875efbee None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:43.342953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-94b976c6-d290-4c66-b3a0-49612b21deb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:43.342953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:43.342953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:43.342953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:43.342953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:43.342953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:43.342953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:43.342953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:43.342953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:43.342953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:43.342953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:43.342953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:43.342953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:43.342953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:43.342953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:43.343939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:43.345056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:43.345056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:43.345056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:43.345056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:43.345056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 260/504] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:43.345056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b976c6-d290-4c66-b3a0-49612b21deb0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:43.364812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310c167-dc4b-4814-bd82-2009ad156be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:43.365498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310c167-dc4b-4814-bd82-2009ad156be0 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:43.365785 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310c167-dc4b-4814-bd82-2009ad156be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:43.366067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310c167-dc4b-4814-bd82-2009ad156be0 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:43.366792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310c167-dc4b-4814-bd82-2009ad156be0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:43.367099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310c167-dc4b-4814-bd82-2009ad156be0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:43.368476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310c167-dc4b-4814-bd82-2009ad156be0 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:43.380316 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 245/505] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:43.385090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310c167-dc4b-4814-bd82-2009ad156be0 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:43.443827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b976c6-d290-4c66-b3a0-49612b21deb0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:43.476000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:43.476627 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df4a88-6a19-48cf-bbe6-0a12f3c4edb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:43.477310 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df4a88-6a19-48cf-bbe6-0a12f3c4edb9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:43.477599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df4a88-6a19-48cf-bbe6-0a12f3c4edb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:43.477957 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df4a88-6a19-48cf-bbe6-0a12f3c4edb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:43.478741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df4a88-6a19-48cf-bbe6-0a12f3c4edb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:43.479051 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df4a88-6a19-48cf-bbe6-0a12f3c4edb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:43.480435 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df4a88-6a19-48cf-bbe6-0a12f3c4edb9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:43.482472 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310c167-dc4b-4814-bd82-2009ad156be0 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:43.492266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 261/506] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:43.493000 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df4a88-6a19-48cf-bbe6-0a12f3c4edb9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:43.520338 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cee75-aec4-4f39-a6e7-9ea829fa9361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:43.521159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cee75-aec4-4f39-a6e7-9ea829fa9361 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:43.521443 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cee75-aec4-4f39-a6e7-9ea829fa9361 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:43.521717 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cee75-aec4-4f39-a6e7-9ea829fa9361 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:43.531876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cee75-aec4-4f39-a6e7-9ea829fa9361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:43.537747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-a36cee75-aec4-4f39-a6e7-9ea829fa9361 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:43.539863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:43.540736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:43.546840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:43.546840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:43.546840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:43.546840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:43.546840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:43.546840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:43.546840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:43.546840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:43.546840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:43.546840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:43.546840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:43.546840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:43.546840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 246/507] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:43.546840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cee75-aec4-4f39-a6e7-9ea829fa9361 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:43.599272 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df4a88-6a19-48cf-bbe6-0a12f3c4edb9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:43.632803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef773b61-c071-4485-bbfd-ed0f1b265f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:43.633615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef773b61-c071-4485-bbfd-ed0f1b265f2f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:43.633897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef773b61-c071-4485-bbfd-ed0f1b265f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:43.634167 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef773b61-c071-4485-bbfd-ed0f1b265f2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:43.640233 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cee75-aec4-4f39-a6e7-9ea829fa9361 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:43.645306 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef773b61-c071-4485-bbfd-ed0f1b265f2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:43.646748 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef773b61-c071-4485-bbfd-ed0f1b265f2f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:43.663504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ef773b61-c071-4485-bbfd-ed0f1b265f2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:43.663504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:43.663504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:43.663504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:43.663504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:43.663504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:43.663504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:43.663504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:43.663504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:43.663504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:43.663504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:43.663504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:43.663504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:43.663504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:43.663504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:43.664515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:43.665650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:43.665650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:43.665650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:43.665650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:43.665650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 262/508] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:43.665650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef773b61-c071-4485-bbfd-ed0f1b265f2f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:43.676941 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b4f6f-06cb-4e8d-ad1c-c8e9c45fa57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:43.677618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b4f6f-06cb-4e8d-ad1c-c8e9c45fa57a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:43.677906 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b4f6f-06cb-4e8d-ad1c-c8e9c45fa57a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:43.678185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b4f6f-06cb-4e8d-ad1c-c8e9c45fa57a None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:43.678909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b4f6f-06cb-4e8d-ad1c-c8e9c45fa57a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:43.679222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b4f6f-06cb-4e8d-ad1c-c8e9c45fa57a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:43.680601 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b4f6f-06cb-4e8d-ad1c-c8e9c45fa57a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:43.692640 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 247/509] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:43.693450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b4f6f-06cb-4e8d-ad1c-c8e9c45fa57a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:43.711072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:43.762200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:43.768079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef773b61-c071-4485-bbfd-ed0f1b265f2f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:43.792400 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b4f6f-06cb-4e8d-ad1c-c8e9c45fa57a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:43.801294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69516e8-f518-4bbd-a2c2-34aa417a0ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:43.802081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69516e8-f518-4bbd-a2c2-34aa417a0ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:43.802369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69516e8-f518-4bbd-a2c2-34aa417a0ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:43.802651 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69516e8-f518-4bbd-a2c2-34aa417a0ed1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:43.810393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69516e8-f518-4bbd-a2c2-34aa417a0ed1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:43.811973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69516e8-f518-4bbd-a2c2-34aa417a0ed1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:43.825782 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034e62b-db41-4f30-b6ff-35d4300a7d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:43.826604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034e62b-db41-4f30-b6ff-35d4300a7d39 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:43.826894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034e62b-db41-4f30-b6ff-35d4300a7d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:43.827176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034e62b-db41-4f30-b6ff-35d4300a7d39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a69516e8-f518-4bbd-a2c2-34aa417a0ed1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:16:43.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:43.828878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:43.829848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:43.829848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:43.829848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:16:43.829848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:16:43.829848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:16:43.829848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:16:43.829848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:16:43.829848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:16:43.829848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 22:16:43.829848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:43.829848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 263/510] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:43.830599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69516e8-f518-4bbd-a2c2-34aa417a0ed1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:43.837312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034e62b-db41-4f30-b6ff-35d4300a7d39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:43.838754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034e62b-db41-4f30-b6ff-35d4300a7d39 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:43.852885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-6034e62b-db41-4f30-b6ff-35d4300a7d39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:43.852885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:43.852885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:43.852885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:43.852885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:43.852885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:43.852885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:43.852885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:43.852885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:43.852885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:43.852885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:43.852885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:43.852885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:16:43.852885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:16:43.852885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:43.853725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:43.855095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:16:43.855095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:16:43.855095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:16:43.855095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:16:43.855095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:16:43.855095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:16:43.855095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:43.855095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:43.857144 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 248/511] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:43.858307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034e62b-db41-4f30-b6ff-35d4300a7d39 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:43.930324 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69516e8-f518-4bbd-a2c2-34aa417a0ed1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:43.935847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:43.960092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034e62b-db41-4f30-b6ff-35d4300a7d39 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:43.964831 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1cf4a-29d3-4415-911f-69c530777058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:43.965470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1cf4a-29d3-4415-911f-69c530777058 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:43.965758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1cf4a-29d3-4415-911f-69c530777058 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:43.966041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1cf4a-29d3-4415-911f-69c530777058 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:43.966784 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1cf4a-29d3-4415-911f-69c530777058 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:43.967096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1cf4a-29d3-4415-911f-69c530777058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:43.968474 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1cf4a-29d3-4415-911f-69c530777058 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:43.976410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 264/512] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:16:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:43.977411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1cf4a-29d3-4415-911f-69c530777058 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:43.993784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ed309-7dc7-46ee-87d5-f883c8d12fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:43.994445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ed309-7dc7-46ee-87d5-f883c8d12fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:43.995223 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ed309-7dc7-46ee-87d5-f883c8d12fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:43.995499 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ed309-7dc7-46ee-87d5-f883c8d12fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:43.996150 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:43.996263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ed309-7dc7-46ee-87d5-f883c8d12fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:43.996504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ed309-7dc7-46ee-87d5-f883c8d12fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:43.998166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ed309-7dc7-46ee-87d5-f883c8d12fb1 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:44.009359 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 249/513] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:44.010149 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ed309-7dc7-46ee-87d5-f883c8d12fb1 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:44.078726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1cf4a-29d3-4415-911f-69c530777058 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:44.109475 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ed309-7dc7-46ee-87d5-f883c8d12fb1 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:44.111095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073a400-feb9-4a01-8a3d-40656eb0d2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:44.111887 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073a400-feb9-4a01-8a3d-40656eb0d2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:44.112166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073a400-feb9-4a01-8a3d-40656eb0d2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:44.112440 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073a400-feb9-4a01-8a3d-40656eb0d2d6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:44.119603 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073a400-feb9-4a01-8a3d-40656eb0d2d6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:44.121582 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073a400-feb9-4a01-8a3d-40656eb0d2d6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-b073a400-feb9-4a01-8a3d-40656eb0d2d6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:16:44.135343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:44.136752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:44.137664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:44.137664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:44.137664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:16:44.137664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:16:44.137664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:16:44.137664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:16:44.137664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:16:44.137664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:16:44.137664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:16:44.137664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:44.137664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 265/514] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:44.138230 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073a400-feb9-4a01-8a3d-40656eb0d2d6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:44.147160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665b6c2-e95f-464e-abc1-fd01de47e931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:44.147833 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665b6c2-e95f-464e-abc1-fd01de47e931 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:44.148116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665b6c2-e95f-464e-abc1-fd01de47e931 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:44.148395 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665b6c2-e95f-464e-abc1-fd01de47e931 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:44.149270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665b6c2-e95f-464e-abc1-fd01de47e931 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:44.149582 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665b6c2-e95f-464e-abc1-fd01de47e931 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:44.151115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665b6c2-e95f-464e-abc1-fd01de47e931 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:44.154120 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:44.169174 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 250/515] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jul 21 22:16:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:44.169974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665b6c2-e95f-464e-abc1-fd01de47e931 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:44.214341 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:44.236128 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073a400-feb9-4a01-8a3d-40656eb0d2d6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:44.267314 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665b6c2-e95f-464e-abc1-fd01de47e931 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:44.269769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efa84c-d7df-4edd-8d94-068bb89620cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:44.270434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efa84c-d7df-4edd-8d94-068bb89620cc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:44.270716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efa84c-d7df-4edd-8d94-068bb89620cc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:44.270995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efa84c-d7df-4edd-8d94-068bb89620cc None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:44.271778 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efa84c-d7df-4edd-8d94-068bb89620cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:44.272092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efa84c-d7df-4edd-8d94-068bb89620cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:44.273602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efa84c-d7df-4edd-8d94-068bb89620cc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:44.290819 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 266/516] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:16:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:44.292070 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efa84c-d7df-4edd-8d94-068bb89620cc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:44.301200 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b1a92-5b49-4fec-8bd8-b1228ec0f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:44.301991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b1a92-5b49-4fec-8bd8-b1228ec0f54e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:44.302275 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b1a92-5b49-4fec-8bd8-b1228ec0f54e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:44.302552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b1a92-5b49-4fec-8bd8-b1228ec0f54e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:44.312996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b1a92-5b49-4fec-8bd8-b1228ec0f54e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:44.314426 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b1a92-5b49-4fec-8bd8-b1228ec0f54e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:44.331602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-ed5b1a92-5b49-4fec-8bd8-b1228ec0f54e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:44.331602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:44.331602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:44.331602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:44.331602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:44.331602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:44.331602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:44.331602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:44.331602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:44.331602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:44.331602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:44.331602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:44.331602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:44.331602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:44.331602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:44.332450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:44.333305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:44.333305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:44.333305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:44.333305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:44.333305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 251/517] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:44.333618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b1a92-5b49-4fec-8bd8-b1228ec0f54e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:44.379841 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:44.394289 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efa84c-d7df-4edd-8d94-068bb89620cc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:44.427302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c8bbe-2c56-4b2c-94f1-9e8a9ee5e9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:44.427975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c8bbe-2c56-4b2c-94f1-9e8a9ee5e9c5 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:44.428261 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c8bbe-2c56-4b2c-94f1-9e8a9ee5e9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:44.428541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c8bbe-2c56-4b2c-94f1-9e8a9ee5e9c5 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:44.429276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c8bbe-2c56-4b2c-94f1-9e8a9ee5e9c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:44.430726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c8bbe-2c56-4b2c-94f1-9e8a9ee5e9c5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:44.431175 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b1a92-5b49-4fec-8bd8-b1228ec0f54e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:44.439714 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:44.452371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 267/518] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:16:44 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:16:44.453184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c8bbe-2c56-4b2c-94f1-9e8a9ee5e9c5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:44.465804 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4bcbb-5cb0-4d3f-8c0d-cf0eed3b8811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:44.466508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4bcbb-5cb0-4d3f-8c0d-cf0eed3b8811 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:44.466793 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4bcbb-5cb0-4d3f-8c0d-cf0eed3b8811 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:44.467071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4bcbb-5cb0-4d3f-8c0d-cf0eed3b8811 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:44.467934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4bcbb-5cb0-4d3f-8c0d-cf0eed3b8811 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:44.468270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4bcbb-5cb0-4d3f-8c0d-cf0eed3b8811 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:44.469783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4bcbb-5cb0-4d3f-8c0d-cf0eed3b8811 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:44.496813 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 252/519] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jul 21 22:16:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:44.497752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4bcbb-5cb0-4d3f-8c0d-cf0eed3b8811 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:44.586218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c8bbe-2c56-4b2c-94f1-9e8a9ee5e9c5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:44.604468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4bcbb-5cb0-4d3f-8c0d-cf0eed3b8811 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:44.609223 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:44.625790 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e55f98-e0ee-406a-86ce-e13c6e64dc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:44.626450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e55f98-e0ee-406a-86ce-e13c6e64dc2d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:44.626735 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e55f98-e0ee-406a-86ce-e13c6e64dc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:44.627012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e55f98-e0ee-406a-86ce-e13c6e64dc2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:44.650137 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ae4ca-0cb7-4b0a-a4fc-ef0c0584d207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:44.650800 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ae4ca-0cb7-4b0a-a4fc-ef0c0584d207 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:44.651731 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ae4ca-0cb7-4b0a-a4fc-ef0c0584d207 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:44.652015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ae4ca-0cb7-4b0a-a4fc-ef0c0584d207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:44.652857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ae4ca-0cb7-4b0a-a4fc-ef0c0584d207 None admin] RBAC: Adding query filter params (role.id=21cd8dfe95a341df92f26899aaae6604, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=2c04dc3ee4484afaab388cbb306974af) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:44.653488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ae4ca-0cb7-4b0a-a4fc-ef0c0584d207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:44.654967 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ae4ca-0cb7-4b0a-a4fc-ef0c0584d207 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:44.661965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 253/520] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:44 2022] GET /identity/v3/role_assignments?user.id=2c04dc3ee4484afaab388cbb306974af&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=21cd8dfe95a341df92f26899aaae6604 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:44.663068 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ae4ca-0cb7-4b0a-a4fc-ef0c0584d207 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:44.700913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:44.710757 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e55f98-e0ee-406a-86ce-e13c6e64dc2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:44.712651 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e55f98-e0ee-406a-86ce-e13c6e64dc2d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:44.801278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ae4ca-0cb7-4b0a-a4fc-ef0c0584d207 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:44.844277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 268/521] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:44.846003 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e55f98-e0ee-406a-86ce-e13c6e64dc2d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:44.852223 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeffd16-3225-4bd5-b60b-b65c4ca352c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:44.852920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeffd16-3225-4bd5-b60b-b65c4ca352c2 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:44.853833 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeffd16-3225-4bd5-b60b-b65c4ca352c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:44.853833 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeffd16-3225-4bd5-b60b-b65c4ca352c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:44.855110 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeffd16-3225-4bd5-b60b-b65c4ca352c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:44.855426 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeffd16-3225-4bd5-b60b-b65c4ca352c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:44.856950 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeffd16-3225-4bd5-b60b-b65c4ca352c2 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:44.870976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 254/522] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:44.871810 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeffd16-3225-4bd5-b60b-b65c4ca352c2 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:44.904585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:44.962248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:44.973364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e55f98-e0ee-406a-86ce-e13c6e64dc2d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:44.994132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeffd16-3225-4bd5-b60b-b65c4ca352c2 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:45.012191 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b884c4-e3b0-49c0-976a-c00c2939b5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:45.013380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b884c4-e3b0-49c0-976a-c00c2939b5cb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:45.013810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b884c4-e3b0-49c0-976a-c00c2939b5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:45.014228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b884c4-e3b0-49c0-976a-c00c2939b5cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:45.038313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05550a21-25e2-4214-9c37-b068723ab390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:45.039532 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05550a21-25e2-4214-9c37-b068723ab390 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:45.039866 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05550a21-25e2-4214-9c37-b068723ab390 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:45.040152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05550a21-25e2-4214-9c37-b068723ab390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:45.055379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05550a21-25e2-4214-9c37-b068723ab390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:45.057065 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05550a21-25e2-4214-9c37-b068723ab390 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:45.080420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-05550a21-25e2-4214-9c37-b068723ab390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:45.080420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:45.080420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:45.080420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:45.080420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:45.080420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:45.080420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:45.080420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:45.080420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:45.080420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:45.080420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:45.080420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:45.080420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:45.080420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:45.080420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:45.081368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:45.082231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:45.082231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:45.082231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:45.082231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:45.085055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 255/523] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:45.086009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05550a21-25e2-4214-9c37-b068723ab390 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:45.106567 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b884c4-e3b0-49c0-976a-c00c2939b5cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:45.109134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b884c4-e3b0-49c0-976a-c00c2939b5cb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:45.195703 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:45.220383 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05550a21-25e2-4214-9c37-b068723ab390 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:45.230026 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:45.242481 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 269/524] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:45.243165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b884c4-e3b0-49c0-976a-c00c2939b5cb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:45.262861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17ba96-b516-4c93-a18e-c826c2a84aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:45.264035 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17ba96-b516-4c93-a18e-c826c2a84aab None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:45.264503 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17ba96-b516-4c93-a18e-c826c2a84aab None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:45.264988 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17ba96-b516-4c93-a18e-c826c2a84aab None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:45.277582 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17ba96-b516-4c93-a18e-c826c2a84aab None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:45.280774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17ba96-b516-4c93-a18e-c826c2a84aab None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-8c17ba96-b516-4c93-a18e-c826c2a84aab None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:16:45.299618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:45.300528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:45.301479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:45.301479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:45.301479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:16:45.301479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:16:45.301479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:16:45.301479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:16:45.301479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:16:45.301479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:16:45.301479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 22:16:45.301479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:45.305060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 256/525] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:45.306101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17ba96-b516-4c93-a18e-c826c2a84aab None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:45.355385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b884c4-e3b0-49c0-976a-c00c2939b5cb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:45.390656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00accaa7-4c7e-410d-aebc-498917a5e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:45.391326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00accaa7-4c7e-410d-aebc-498917a5e40a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:45.391600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00accaa7-4c7e-410d-aebc-498917a5e40a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:45.391977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00accaa7-4c7e-410d-aebc-498917a5e40a None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:45.392592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00accaa7-4c7e-410d-aebc-498917a5e40a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:45.392901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00accaa7-4c7e-410d-aebc-498917a5e40a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:45.394350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00accaa7-4c7e-410d-aebc-498917a5e40a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:45.412061 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 270/526] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:45.413247 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00accaa7-4c7e-410d-aebc-498917a5e40a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:45.440498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17ba96-b516-4c93-a18e-c826c2a84aab None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:45.481953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:45.484437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a6228-ea0f-4bc0-b58f-fd5763fe48c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:45.485831 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a6228-ea0f-4bc0-b58f-fd5763fe48c5 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:45.486625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a6228-ea0f-4bc0-b58f-fd5763fe48c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:45.487397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a6228-ea0f-4bc0-b58f-fd5763fe48c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:45.500770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:45.504238 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a6228-ea0f-4bc0-b58f-fd5763fe48c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:45.506890 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a6228-ea0f-4bc0-b58f-fd5763fe48c5 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:45.529965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-ff7a6228-ea0f-4bc0-b58f-fd5763fe48c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:45.529965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:45.529965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:45.529965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:45.529965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:45.529965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:45.529965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:45.529965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:45.529965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:45.529965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:45.529965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:45.529965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:45.529965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:45.529965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:45.529965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:45.530851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:45.531695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:45.531695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:45.531695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:45.531695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:45.531695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 257/527] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:45.531966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a6228-ea0f-4bc0-b58f-fd5763fe48c5 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:45.533578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00accaa7-4c7e-410d-aebc-498917a5e40a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:45.583639 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8efec1-ed19-4643-8947-5871019486c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:45.583841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8efec1-ed19-4643-8947-5871019486c7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:45.584068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8efec1-ed19-4643-8947-5871019486c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:45.585165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8efec1-ed19-4643-8947-5871019486c7 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:45.585362 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8efec1-ed19-4643-8947-5871019486c7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:45.585651 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8efec1-ed19-4643-8947-5871019486c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:45.587098 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8efec1-ed19-4643-8947-5871019486c7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:45.627434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 271/528] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Jul 21 22:16:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:45.628326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8efec1-ed19-4643-8947-5871019486c7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:45.655125 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a6228-ea0f-4bc0-b58f-fd5763fe48c5 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:45.693338 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb0901-701d-46ed-8045-da58baa495e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:45.694139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0901-701d-46ed-8045-da58baa495e7 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:45.694425 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0901-701d-46ed-8045-da58baa495e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:45.694705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0901-701d-46ed-8045-da58baa495e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:45.707881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0901-701d-46ed-8045-da58baa495e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:45.710140 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0901-701d-46ed-8045-da58baa495e7 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:45.729102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-effb0901-701d-46ed-8045-da58baa495e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:45.729102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:45.729102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:45.729102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:45.729102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:45.729102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:45.729102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:45.729102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:45.729102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:45.729102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:45.729102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:45.729102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:45.729102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:16:45.729102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:16:45.729102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:45.730115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:45.731157 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:16:45.731157 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:16:45.731157 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:16:45.731157 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:16:45.731157 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:16:45.731157 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:16:45.731157 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:45.731157 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:45.733027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 258/529] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:45.733929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb0901-701d-46ed-8045-da58baa495e7 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:45.759192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8efec1-ed19-4643-8947-5871019486c7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:45.774024 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:45.797787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09995fe-ec69-474a-b7e9-e8721f40badd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:45.798497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09995fe-ec69-474a-b7e9-e8721f40badd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:45.798789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09995fe-ec69-474a-b7e9-e8721f40badd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:45.799068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09995fe-ec69-474a-b7e9-e8721f40badd None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:45.799850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09995fe-ec69-474a-b7e9-e8721f40badd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:45.800196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09995fe-ec69-474a-b7e9-e8721f40badd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:45.801631 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09995fe-ec69-474a-b7e9-e8721f40badd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:45.806332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:45.815184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 272/530] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:45.820341 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09995fe-ec69-474a-b7e9-e8721f40badd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:45.872425 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb0901-701d-46ed-8045-da58baa495e7 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:45.915740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ece5d8-dd06-4ec6-8f3b-f2e7f3a78e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:45.917215 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ece5d8-dd06-4ec6-8f3b-f2e7f3a78e6e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:45.918091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ece5d8-dd06-4ec6-8f3b-f2e7f3a78e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:45.918577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ece5d8-dd06-4ec6-8f3b-f2e7f3a78e6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:45.930448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09995fe-ec69-474a-b7e9-e8721f40badd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:45.971525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ca3fe-6d44-40dc-a908-9c4a93bdd27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:45.973226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ca3fe-6d44-40dc-a908-9c4a93bdd27d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:45.973662 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ca3fe-6d44-40dc-a908-9c4a93bdd27d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:45.974349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ca3fe-6d44-40dc-a908-9c4a93bdd27d None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:45.975741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ca3fe-6d44-40dc-a908-9c4a93bdd27d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:45.976199 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ca3fe-6d44-40dc-a908-9c4a93bdd27d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:45.978326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ca3fe-6d44-40dc-a908-9c4a93bdd27d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:45.995072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 273/531] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:16:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:45.996102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ca3fe-6d44-40dc-a908-9c4a93bdd27d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:46.004491 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ece5d8-dd06-4ec6-8f3b-f2e7f3a78e6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:46.006151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ece5d8-dd06-4ec6-8f3b-f2e7f3a78e6e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:46.036190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:46.067427 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:46.129736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 259/532] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:46.131018 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ece5d8-dd06-4ec6-8f3b-f2e7f3a78e6e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:46.132835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ca3fe-6d44-40dc-a908-9c4a93bdd27d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:46.177673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798f47d-ba27-4b13-ad02-6182b8fc880e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:46.179981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798f47d-ba27-4b13-ad02-6182b8fc880e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:46.181185 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798f47d-ba27-4b13-ad02-6182b8fc880e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:46.183514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798f47d-ba27-4b13-ad02-6182b8fc880e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:46.193019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798f47d-ba27-4b13-ad02-6182b8fc880e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:46.194745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798f47d-ba27-4b13-ad02-6182b8fc880e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:46.215127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-e798f47d-ba27-4b13-ad02-6182b8fc880e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:46.215127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:46.215127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:46.215127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:46.215127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:46.215127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:46.215127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:46.215127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:46.215127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:46.215127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:46.215127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:46.215127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:46.215127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:16:46.215127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:16:46.215127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:46.216037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:46.217337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:16:46.217337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:16:46.217337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:16:46.217337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:16:46.217337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:16:46.217337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:16:46.217337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:46.217337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:46.221556 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 274/533] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:46.222569 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798f47d-ba27-4b13-ad02-6182b8fc880e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:46.252654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ece5d8-dd06-4ec6-8f3b-f2e7f3a78e6e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:46.297024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b83dbc-b798-4a6b-8590-dbd72220e4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:46.297692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b83dbc-b798-4a6b-8590-dbd72220e4ae None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:46.298450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b83dbc-b798-4a6b-8590-dbd72220e4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:46.298734 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b83dbc-b798-4a6b-8590-dbd72220e4ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:46.299846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b83dbc-b798-4a6b-8590-dbd72220e4ae None admin] RBAC: Adding query filter params (role.id=21cd8dfe95a341df92f26899aaae6604, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=aefb0fe4d09b451a861510508bb9cf1e) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:46.300169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b83dbc-b798-4a6b-8590-dbd72220e4ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:46.301826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b83dbc-b798-4a6b-8590-dbd72220e4ae None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:46.314941 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 260/534] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:46 2022] GET /identity/v3/role_assignments?user.id=aefb0fe4d09b451a861510508bb9cf1e&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=21cd8dfe95a341df92f26899aaae6604 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:46.314941 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b83dbc-b798-4a6b-8590-dbd72220e4ae None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:46.347371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:46.357902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:46.387948 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798f47d-ba27-4b13-ad02-6182b8fc880e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:46.458406 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b83dbc-b798-4a6b-8590-dbd72220e4ae None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:46.461134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d86eec-ea08-419b-bb20-0924a1e5f0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:46.462385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86eec-ea08-419b-bb20-0924a1e5f0cd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:46.462869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86eec-ea08-419b-bb20-0924a1e5f0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:46.463882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86eec-ea08-419b-bb20-0924a1e5f0cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:46.494294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d86eec-ea08-419b-bb20-0924a1e5f0cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:46.496534 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d86eec-ea08-419b-bb20-0924a1e5f0cd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:46.497598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e8e24-c935-40c3-a0c8-553eb3cccb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:46.498278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e8e24-c935-40c3-a0c8-553eb3cccb78 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:46.498765 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e8e24-c935-40c3-a0c8-553eb3cccb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:46.499050 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e8e24-c935-40c3-a0c8-553eb3cccb78 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:46.499855 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e8e24-c935-40c3-a0c8-553eb3cccb78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:46.500167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e8e24-c935-40c3-a0c8-553eb3cccb78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:46.501627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e8e24-c935-40c3-a0c8-553eb3cccb78 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:46.521884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 261/535] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:16:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:46.527472 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e8e24-c935-40c3-a0c8-553eb3cccb78 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:46.533684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-74d86eec-ea08-419b-bb20-0924a1e5f0cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:46.533684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:46.533684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:46.533684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:46.533684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:46.533684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:46.533684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:46.533684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:46.533684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:46.533684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:46.533684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:46.533684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:46.533684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:46.533684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:46.533684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:46.534766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:46.536045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:46.536045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:46.536045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:46.536045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:46.536045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 275/536] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:46.543883 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d86eec-ea08-419b-bb20-0924a1e5f0cd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:46.617444 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:46.644021 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e8e24-c935-40c3-a0c8-553eb3cccb78 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:46.687995 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d01ee8-3b9d-47b5-bb7c-03e0586dec72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:46.689344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d01ee8-3b9d-47b5-bb7c-03e0586dec72 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:46.689787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d01ee8-3b9d-47b5-bb7c-03e0586dec72 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:46.690480 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d01ee8-3b9d-47b5-bb7c-03e0586dec72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:46.691647 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d01ee8-3b9d-47b5-bb7c-03e0586dec72 None admin] RBAC: Adding query filter params (role.id=21cd8dfe95a341df92f26899aaae6604, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=de7ad1ebf93b4e1db64e3ccf72fa54b5) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:46.692113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d01ee8-3b9d-47b5-bb7c-03e0586dec72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:46.694296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d01ee8-3b9d-47b5-bb7c-03e0586dec72 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:46.695277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d86eec-ea08-419b-bb20-0924a1e5f0cd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:46.702009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 262/537] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:46 2022] GET /identity/v3/role_assignments?user.id=de7ad1ebf93b4e1db64e3ccf72fa54b5&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=21cd8dfe95a341df92f26899aaae6604 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:46.704085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25de0e4-d893-44f1-8805-533094c3c291 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:46.704544 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25de0e4-d893-44f1-8805-533094c3c291 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:46.705399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25de0e4-d893-44f1-8805-533094c3c291 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:46.707348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 263/538] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:46.719483 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5770ee-867d-4cb9-99bf-e21448329de8 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:46.719770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5770ee-867d-4cb9-99bf-e21448329de8 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:46.720058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5770ee-867d-4cb9-99bf-e21448329de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:46.754310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-6c5770ee-867d-4cb9-99bf-e21448329de8 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:46.755549 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6c5770ee-867d-4cb9-99bf-e21448329de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:46.770719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221284bc-e22e-45e8-9a0c-55a70db60e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:46.771461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221284bc-e22e-45e8-9a0c-55a70db60e3b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:46.771748 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221284bc-e22e-45e8-9a0c-55a70db60e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:46.772033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221284bc-e22e-45e8-9a0c-55a70db60e3b None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:46.775212 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221284bc-e22e-45e8-9a0c-55a70db60e3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:46.775673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221284bc-e22e-45e8-9a0c-55a70db60e3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:46.778319 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221284bc-e22e-45e8-9a0c-55a70db60e3b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:46.807589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 276/539] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:46.813837 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221284bc-e22e-45e8-9a0c-55a70db60e3b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:46.819631 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:46.879157 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 264/540] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:46.881579 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59498c54-ab32-4cae-aea1-574c51599de2 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:46.882044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59498c54-ab32-4cae-aea1-574c51599de2 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:46.882485 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59498c54-ab32-4cae-aea1-574c51599de2 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:46.883939 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 265/541] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:46.896875 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74627a10-d8c0-4ca3-9577-38aac93b8f51 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:46.897409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74627a10-d8c0-4ca3-9577-38aac93b8f51 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:46.897854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74627a10-d8c0-4ca3-9577-38aac93b8f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:46.916888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-74627a10-d8c0-4ca3-9577-38aac93b8f51 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:46.918316 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-74627a10-d8c0-4ca3-9577-38aac93b8f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:46.983644 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221284bc-e22e-45e8-9a0c-55a70db60e3b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:46.988913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:47.004947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 266/542] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:16:47.004947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74627a10-d8c0-4ca3-9577-38aac93b8f51 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:47.048238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e91c0-7b04-4d57-b618-b319809a9022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:47.049315 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e91c0-7b04-4d57-b618-b319809a9022 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:47.049745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e91c0-7b04-4d57-b618-b319809a9022 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:47.050197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e91c0-7b04-4d57-b618-b319809a9022 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:47.059755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e91c0-7b04-4d57-b618-b319809a9022 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:47.065140 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e91c0-7b04-4d57-b618-b319809a9022 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:47.086448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3f6e91c0-7b04-4d57-b618-b319809a9022 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:47.086448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:47.086448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:47.086448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:47.086448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:47.086448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:47.086448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:47.086448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:47.086448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:47.086448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:47.086448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:47.086448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:47.086448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:16:47.086448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:16:47.086448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:47.087342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:47.088168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:16:47.088168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:16:47.088168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:16:47.088168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:16:47.088168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:16:47.088168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:16:47.088168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:47.088168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:47.095784 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 277/543] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:47.095784 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e91c0-7b04-4d57-b618-b319809a9022 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:47.138009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74627a10-d8c0-4ca3-9577-38aac93b8f51 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:47.181630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3912923-a567-43e8-95f4-4aff960ccf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:47.182471 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3912923-a567-43e8-95f4-4aff960ccf8c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:47.182753 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3912923-a567-43e8-95f4-4aff960ccf8c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:47.183028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3912923-a567-43e8-95f4-4aff960ccf8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:47.184969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:47.194554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3912923-a567-43e8-95f4-4aff960ccf8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-b3912923-a567-43e8-95f4-4aff960ccf8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:47.202311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:47.203208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:47.204649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:47.204649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:47.204649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:47.204649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:47.204649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:47.204649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:47.204649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:47.204649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:47.204649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:47.204649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:47.204649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:47.204649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:47.204649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 267/544] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:47.204649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3912923-a567-43e8-95f4-4aff960ccf8c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:47.241917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e91c0-7b04-4d57-b618-b319809a9022 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:47.269568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:47.292614 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3e7ce-fd61-4db3-ade4-daddfec0d16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:47.294005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3e7ce-fd61-4db3-ade4-daddfec0d16b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:47.294483 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3e7ce-fd61-4db3-ade4-daddfec0d16b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:47.295126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3e7ce-fd61-4db3-ade4-daddfec0d16b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:47.309633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3e7ce-fd61-4db3-ade4-daddfec0d16b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:47.314008 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3912923-a567-43e8-95f4-4aff960ccf8c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-53b3e7ce-fd61-4db3-ade4-daddfec0d16b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:47.319937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:47.320811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:47.321648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:47.321648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:47.321648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:47.321648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:47.321648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:47.321648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:47.321648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:47.321648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:47.321648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:47.321648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:47.321648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:47.321648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:47.325455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 278/545] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:47.326352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3e7ce-fd61-4db3-ade4-daddfec0d16b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:47.362976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aad77c-7c1a-4a98-920e-6bc21cca65f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:47.363973 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aad77c-7c1a-4a98-920e-6bc21cca65f5 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:47.364629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aad77c-7c1a-4a98-920e-6bc21cca65f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:47.365981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aad77c-7c1a-4a98-920e-6bc21cca65f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:47.366964 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aad77c-7c1a-4a98-920e-6bc21cca65f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:47.367456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aad77c-7c1a-4a98-920e-6bc21cca65f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:47.369119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aad77c-7c1a-4a98-920e-6bc21cca65f5 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:47.391013 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 268/546] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:16:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:47.391013 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aad77c-7c1a-4a98-920e-6bc21cca65f5 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:47.443965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3e7ce-fd61-4db3-ade4-daddfec0d16b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:47.469440 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:47.483238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e325af-4aa3-487e-953b-ac7fa1951595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:47.483908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e325af-4aa3-487e-953b-ac7fa1951595 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:47.484190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e325af-4aa3-487e-953b-ac7fa1951595 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:47.484464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e325af-4aa3-487e-953b-ac7fa1951595 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:47.485256 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e325af-4aa3-487e-953b-ac7fa1951595 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:47.485560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e325af-4aa3-487e-953b-ac7fa1951595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:47.486985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e325af-4aa3-487e-953b-ac7fa1951595 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:47.500291 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 279/547] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:16:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:47.501194 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e325af-4aa3-487e-953b-ac7fa1951595 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:47.521526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aad77c-7c1a-4a98-920e-6bc21cca65f5 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:47.551256 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:47.570933 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbdc5d-fd77-4cee-896e-179ee6d8785e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:47.571607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbdc5d-fd77-4cee-896e-179ee6d8785e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:47.571891 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbdc5d-fd77-4cee-896e-179ee6d8785e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:47.572169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbdc5d-fd77-4cee-896e-179ee6d8785e None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:47.573477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbdc5d-fd77-4cee-896e-179ee6d8785e None admin] RBAC: Adding query filter params (name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:47.573785 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbdc5d-fd77-4cee-896e-179ee6d8785e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:47.575151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbdc5d-fd77-4cee-896e-179ee6d8785e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:47.583632 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 269/548] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:16:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:47.584223 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbdc5d-fd77-4cee-896e-179ee6d8785e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:47.629934 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e325af-4aa3-487e-953b-ac7fa1951595 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:47.676626 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d3e03-fe18-44bc-a1ca-4cbccfcda255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:47.678173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d3e03-fe18-44bc-a1ca-4cbccfcda255 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:47.678835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d3e03-fe18-44bc-a1ca-4cbccfcda255 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:47.679422 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d3e03-fe18-44bc-a1ca-4cbccfcda255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:47.680723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d3e03-fe18-44bc-a1ca-4cbccfcda255 None admin] RBAC: Adding query filter params (role.id=21cd8dfe95a341df92f26899aaae6604, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=23aaef489c0948fe8bc10acb8e76c84a) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:47.681351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d3e03-fe18-44bc-a1ca-4cbccfcda255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:47.683045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d3e03-fe18-44bc-a1ca-4cbccfcda255 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:47.697063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbdc5d-fd77-4cee-896e-179ee6d8785e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:47.697460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 280/549] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:47 2022] GET /identity/v3/role_assignments?user.id=23aaef489c0948fe8bc10acb8e76c84a&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=21cd8dfe95a341df92f26899aaae6604 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:47.698697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d3e03-fe18-44bc-a1ca-4cbccfcda255 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:47.738322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91d4a7-84ab-4ec6-b04d-ca06d371c9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:47.739252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91d4a7-84ab-4ec6-b04d-ca06d371c9ce None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:47.739542 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91d4a7-84ab-4ec6-b04d-ca06d371c9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:47.739820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91d4a7-84ab-4ec6-b04d-ca06d371c9ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:47.755427 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91d4a7-84ab-4ec6-b04d-ca06d371c9ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:47.762277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91d4a7-84ab-4ec6-b04d-ca06d371c9ce None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:47.805413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-cc91d4a7-84ab-4ec6-b04d-ca06d371c9ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:47.805413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:47.805413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:47.805413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:47.805413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:47.805413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:47.805413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:47.805413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:47.805413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:47.805413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:47.805413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:47.805413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:47.805413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:47.805413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:47.805413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:47.807057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:47.808237 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:47.808237 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:47.808237 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:47.808237 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:47.811551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:47.816248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 270/550] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:47.824271 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91d4a7-84ab-4ec6-b04d-ca06d371c9ce None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:47.870830 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:47.918259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d3e03-fe18-44bc-a1ca-4cbccfcda255 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:47.961530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91d4a7-84ab-4ec6-b04d-ca06d371c9ce None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:47.970772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6847e9-874f-42ce-bede-41ab17a8840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:47.971577 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6847e9-874f-42ce-bede-41ab17a8840f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:47.971861 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6847e9-874f-42ce-bede-41ab17a8840f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:47.972137 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6847e9-874f-42ce-bede-41ab17a8840f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:47.994103 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6847e9-874f-42ce-bede-41ab17a8840f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:47.996189 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6847e9-874f-42ce-bede-41ab17a8840f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:47.998373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab71d1-a719-42b3-b940-0935f504666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:47.999096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab71d1-a719-42b3-b940-0935f504666d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:47.999392 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab71d1-a719-42b3-b940-0935f504666d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:47.999674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab71d1-a719-42b3-b940-0935f504666d None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:48.000403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab71d1-a719-42b3-b940-0935f504666d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:48.000713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab71d1-a719-42b3-b940-0935f504666d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:48.002135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab71d1-a719-42b3-b940-0935f504666d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:48.015835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 271/551] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:48.021488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab71d1-a719-42b3-b940-0935f504666d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:48.033667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1c6847e9-874f-42ce-bede-41ab17a8840f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:48.033667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:48.033667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:48.033667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:48.033667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:48.033667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:48.033667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:48.033667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:48.033667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:48.033667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:48.033667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:48.033667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:48.033667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:48.033667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:48.033667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:48.034521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:48.035543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:48.035543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:48.035543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:48.035543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:48.035543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 281/552] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:48.040311 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6847e9-874f-42ce-bede-41ab17a8840f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:48.145492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:48.153145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab71d1-a719-42b3-b940-0935f504666d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:48.190143 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf1693-a176-46a1-ad38-8569512223b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:48.190998 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf1693-a176-46a1-ad38-8569512223b6 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:48.191288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf1693-a176-46a1-ad38-8569512223b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:48.191568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf1693-a176-46a1-ad38-8569512223b6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:48.192170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6847e9-874f-42ce-bede-41ab17a8840f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:48.193704 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:48.199408 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf1693-a176-46a1-ad38-8569512223b6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:48.201057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf1693-a176-46a1-ad38-8569512223b6 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-02bf1693-a176-46a1-ad38-8569512223b6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:16:48.217265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:48.219415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:48.221107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:48.221107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:48.221107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:16:48.221107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:16:48.221107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:16:48.221107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:16:48.221107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:16:48.221107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:16:48.221107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:16:48.221107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:48.221107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 272/553] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:16:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:16:48.227280 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf1693-a176-46a1-ad38-8569512223b6 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:48.258216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf01200-6bc6-4456-ad9d-057cc0d330f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:48.258889 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf01200-6bc6-4456-ad9d-057cc0d330f2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:48.259176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf01200-6bc6-4456-ad9d-057cc0d330f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:48.259451 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf01200-6bc6-4456-ad9d-057cc0d330f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:48.260212 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf01200-6bc6-4456-ad9d-057cc0d330f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:48.260526 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf01200-6bc6-4456-ad9d-057cc0d330f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:48.261928 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf01200-6bc6-4456-ad9d-057cc0d330f2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:48.288350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 282/554] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:48.293886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf01200-6bc6-4456-ad9d-057cc0d330f2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:48.335496 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf1693-a176-46a1-ad38-8569512223b6 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:48.371840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016398ae-6ecf-4491-b6a5-f8d3a59d7925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:48.372535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016398ae-6ecf-4491-b6a5-f8d3a59d7925 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:48.372849 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016398ae-6ecf-4491-b6a5-f8d3a59d7925 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:48.373164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016398ae-6ecf-4491-b6a5-f8d3a59d7925 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:48.374010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016398ae-6ecf-4491-b6a5-f8d3a59d7925 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:48.374322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016398ae-6ecf-4491-b6a5-f8d3a59d7925 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:48.375768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016398ae-6ecf-4491-b6a5-f8d3a59d7925 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:48.395070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 273/555] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jul 21 22:16:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:48.401560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016398ae-6ecf-4491-b6a5-f8d3a59d7925 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:48.417053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:48.493621 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf01200-6bc6-4456-ad9d-057cc0d330f2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:48.511683 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016398ae-6ecf-4491-b6a5-f8d3a59d7925 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:48.547650 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f358a4-b3b0-4324-92fb-68a97d33d220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:48.548653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f358a4-b3b0-4324-92fb-68a97d33d220 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:48.549184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f358a4-b3b0-4324-92fb-68a97d33d220 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:48.549689 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f358a4-b3b0-4324-92fb-68a97d33d220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:48.562801 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45d5bc-e3f5-434e-ab69-a594bfd8cec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:48.563534 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45d5bc-e3f5-434e-ab69-a594bfd8cec1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:48.563820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45d5bc-e3f5-434e-ab69-a594bfd8cec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:48.564166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45d5bc-e3f5-434e-ab69-a594bfd8cec1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:48.577665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45d5bc-e3f5-434e-ab69-a594bfd8cec1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:48.578974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45d5bc-e3f5-434e-ab69-a594bfd8cec1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-eb45d5bc-e3f5-434e-ab69-a594bfd8cec1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:16:48.601977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:48.603057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:48.604870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:48.604870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:48.604870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:16:48.604870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:16:48.604870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:16:48.604870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:16:48.604870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:16:48.604870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:16:48.604870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:16:48.604870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:48.604870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 283/556] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jul 21 22:16:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:16:48.604870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6329a3-62e7-407d-8b88-034612729581 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:48.609596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6329a3-62e7-407d-8b88-034612729581 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:48.609915 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6329a3-62e7-407d-8b88-034612729581 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:48.611654 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 284/557] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:48.612627 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6329a3-62e7-407d-8b88-034612729581 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:48.629454 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f358a4-b3b0-4324-92fb-68a97d33d220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:48.631331 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f358a4-b3b0-4324-92fb-68a97d33d220 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:48.638367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:48.646044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:48.726369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6329a3-62e7-407d-8b88-034612729581 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:48.737673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 274/558] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:48.739385 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734d2a8-da9b-4f74-a7ff-c3b65d163fc9 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:48.739900 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734d2a8-da9b-4f74-a7ff-c3b65d163fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:48.740383 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734d2a8-da9b-4f74-a7ff-c3b65d163fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:48.757696 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-f734d2a8-da9b-4f74-a7ff-c3b65d163fc9 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:48.759185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f734d2a8-da9b-4f74-a7ff-c3b65d163fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:48.762907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c94268-bdec-46ff-b1eb-faa0f69b056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:48.763747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c94268-bdec-46ff-b1eb-faa0f69b056f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:48.764259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c94268-bdec-46ff-b1eb-faa0f69b056f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:48.764707 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c94268-bdec-46ff-b1eb-faa0f69b056f None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:48.765715 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c94268-bdec-46ff-b1eb-faa0f69b056f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:48.766166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c94268-bdec-46ff-b1eb-faa0f69b056f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:48.767842 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c94268-bdec-46ff-b1eb-faa0f69b056f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:48.792492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 285/559] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jul 21 22:16:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:48.793929 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c94268-bdec-46ff-b1eb-faa0f69b056f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:48.832374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 275/560] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:48.833356 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734d2a8-da9b-4f74-a7ff-c3b65d163fc9 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:48.884080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:48.888466 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:48.909886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c94268-bdec-46ff-b1eb-faa0f69b056f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:48.943022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734d2a8-da9b-4f74-a7ff-c3b65d163fc9 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:48.944552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beff766-965e-4bd9-8ec3-475f6d346cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:48.945366 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beff766-965e-4bd9-8ec3-475f6d346cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:48.945654 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beff766-965e-4bd9-8ec3-475f6d346cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:48.945934 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beff766-965e-4bd9-8ec3-475f6d346cb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:48.956641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beff766-965e-4bd9-8ec3-475f6d346cb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:48.958102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beff766-965e-4bd9-8ec3-475f6d346cb9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:48.976233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-5beff766-965e-4bd9-8ec3-475f6d346cb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:48.976233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:48.976233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:48.976233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:48.976233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:48.976233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:48.976233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:48.976233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:48.976233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:48.976233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:48.976233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:48.976233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:48.976233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:48.976233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:48.976233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:48.977136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:48.978016 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:48.978016 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:48.978016 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:48.978016 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:48.978016 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 286/561] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:48.978813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a49815-2aa4-4056-9cad-924ec818f35d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:48.979008 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a49815-2aa4-4056-9cad-924ec818f35d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:48.979279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a49815-2aa4-4056-9cad-924ec818f35d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:48.980531 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 287/562] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:48.984673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a49815-2aa4-4056-9cad-924ec818f35d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:48.987521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61e415-0ac3-482a-ab2c-7b036ef60e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:48.988317 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61e415-0ac3-482a-ab2c-7b036ef60e24 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:48.988601 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61e415-0ac3-482a-ab2c-7b036ef60e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:48.988879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61e415-0ac3-482a-ab2c-7b036ef60e24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:48.999488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61e415-0ac3-482a-ab2c-7b036ef60e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:49.000993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61e415-0ac3-482a-ab2c-7b036ef60e24 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:49.019445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-7a61e415-0ac3-482a-ab2c-7b036ef60e24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:49.019445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:49.019445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:49.019445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:49.019445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:49.019445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:49.019445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:49.019445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:49.019445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:49.019445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:49.019445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:49.019445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:49.019445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:49.019445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:49.019445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:49.020729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:49.021649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:49.021649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:49.021649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:49.021649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:49.025058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 276/563] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:49.025979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61e415-0ac3-482a-ab2c-7b036ef60e24 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:49.098588 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a49815-2aa4-4056-9cad-924ec818f35d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:49.123523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:49.129695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:49.132100 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61e415-0ac3-482a-ab2c-7b036ef60e24 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:49.135796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d19ce0-9af9-4b50-b696-500e7243df64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:49.136595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d19ce0-9af9-4b50-b696-500e7243df64 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:49.136883 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d19ce0-9af9-4b50-b696-500e7243df64 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:49.137185 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d19ce0-9af9-4b50-b696-500e7243df64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:49.148463 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d19ce0-9af9-4b50-b696-500e7243df64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-44d19ce0-9af9-4b50-b696-500e7243df64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:49.156486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:49.157423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:49.158277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:49.158277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:49.158277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:49.158277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:49.158277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:49.158277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:49.158277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:49.158277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:49.158277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:49.158277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:49.158277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:49.158277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:49.158277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 288/564] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:49.159471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151476bc-a033-4146-acf3-41b44b850676 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:49.159471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151476bc-a033-4146-acf3-41b44b850676 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:49.159471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151476bc-a033-4146-acf3-41b44b850676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:49.176403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-151476bc-a033-4146-acf3-41b44b850676 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:49.176671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf7c78-6244-48df-9e8c-2c28414b1dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:49.177290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf7c78-6244-48df-9e8c-2c28414b1dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:49.177575 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf7c78-6244-48df-9e8c-2c28414b1dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:49.177732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-151476bc-a033-4146-acf3-41b44b850676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:49.177884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf7c78-6244-48df-9e8c-2c28414b1dc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:49.178574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf7c78-6244-48df-9e8c-2c28414b1dc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:49.178882 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf7c78-6244-48df-9e8c-2c28414b1dc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:49.180241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf7c78-6244-48df-9e8c-2c28414b1dc6 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:49.196276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 277/565] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:49.196276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf7c78-6244-48df-9e8c-2c28414b1dc6 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:49.256945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 289/566] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:49.258291 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151476bc-a033-4146-acf3-41b44b850676 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:49.306266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf7c78-6244-48df-9e8c-2c28414b1dc6 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:49.343117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0395986-628a-4885-8fa7-91a8270daa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:49.343783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0395986-628a-4885-8fa7-91a8270daa95 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:49.344069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0395986-628a-4885-8fa7-91a8270daa95 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:49.344345 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0395986-628a-4885-8fa7-91a8270daa95 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:49.345093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0395986-628a-4885-8fa7-91a8270daa95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:49.345401 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0395986-628a-4885-8fa7-91a8270daa95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:49.346763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0395986-628a-4885-8fa7-91a8270daa95 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:49.364107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 278/567] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:49.364107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0395986-628a-4885-8fa7-91a8270daa95 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:49.374975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151476bc-a033-4146-acf3-41b44b850676 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:49.380080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:49.398104 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:49.410714 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c7bf6-f6b2-4797-85f5-b0efeae0d644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:49.411385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c7bf6-f6b2-4797-85f5-b0efeae0d644 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:49.411673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c7bf6-f6b2-4797-85f5-b0efeae0d644 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:49.411945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c7bf6-f6b2-4797-85f5-b0efeae0d644 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:49.412689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c7bf6-f6b2-4797-85f5-b0efeae0d644 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:49.413021 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c7bf6-f6b2-4797-85f5-b0efeae0d644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:49.414396 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c7bf6-f6b2-4797-85f5-b0efeae0d644 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:49.423090 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 290/568] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:16:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:49.428220 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c7bf6-f6b2-4797-85f5-b0efeae0d644 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:49.476769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0395986-628a-4885-8fa7-91a8270daa95 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:49.512381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c9b08-1365-46ec-a226-dfa19002ad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:49.513311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c9b08-1365-46ec-a226-dfa19002ad34 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:49.513505 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c9b08-1365-46ec-a226-dfa19002ad34 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:49.513781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c9b08-1365-46ec-a226-dfa19002ad34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:49.521116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c9b08-1365-46ec-a226-dfa19002ad34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:49.522591 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c9b08-1365-46ec-a226-dfa19002ad34 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:49.536293 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c7bf6-f6b2-4797-85f5-b0efeae0d644 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:49.537723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-351c9b08-1365-46ec-a226-dfa19002ad34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:49.537723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:49.537723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:49.537723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:49.537723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:49.537723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:49.537723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:49.537723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:49.537723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:49.537723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:49.537723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:49.537723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:49.537723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:16:49.537723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:16:49.537723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:49.538781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:49.539674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:16:49.539674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:16:49.539674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:16:49.539674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:16:49.539674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:16:49.539674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:16:49.539674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:49.539674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:49.539674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 279/569] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:49.539674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c9b08-1365-46ec-a226-dfa19002ad34 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:49.578317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e89974-7bca-48a4-b4bc-c29c09d01b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:49.579118 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e89974-7bca-48a4-b4bc-c29c09d01b2c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:49.579329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e89974-7bca-48a4-b4bc-c29c09d01b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:49.579610 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e89974-7bca-48a4-b4bc-c29c09d01b2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:49.591602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e89974-7bca-48a4-b4bc-c29c09d01b2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-53e89974-7bca-48a4-b4bc-c29c09d01b2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:49.599976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:49.600888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:49.601773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:49.601773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:49.601773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:49.601773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:49.601773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:49.601773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:49.601773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:49.601773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:49.601773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:49.601773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:49.601773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:49.601773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:49.601773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 291/570] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:49.602447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e89974-7bca-48a4-b4bc-c29c09d01b2c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:49.620567 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:49.649241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c9b08-1365-46ec-a226-dfa19002ad34 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:49.653801 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:49.684894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c2af1-983c-4082-97f4-6eccde08099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:49.685738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c2af1-983c-4082-97f4-6eccde08099d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:49.686028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c2af1-983c-4082-97f4-6eccde08099d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:49.686728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c2af1-983c-4082-97f4-6eccde08099d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:49.695305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c2af1-983c-4082-97f4-6eccde08099d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:49.697264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c2af1-983c-4082-97f4-6eccde08099d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:49.711436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e89974-7bca-48a4-b4bc-c29c09d01b2c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:49.716536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-948c2af1-983c-4082-97f4-6eccde08099d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:49.716536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:49.716536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:49.716536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:49.716536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:49.716536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:49.716536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:49.716536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:49.716536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:49.716536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:49.716536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:49.716536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:49.716536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:16:49.716536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:16:49.716536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:49.717504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:49.718402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:16:49.718402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:16:49.718402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:16:49.718402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:16:49.718402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:16:49.718402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:16:49.718402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:49.718402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:49.719507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 280/571] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:49.720328 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c2af1-983c-4082-97f4-6eccde08099d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:49.749895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7355501-a07e-4948-8bb4-6cecde154c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:49.750756 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7355501-a07e-4948-8bb4-6cecde154c00 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:49.750987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7355501-a07e-4948-8bb4-6cecde154c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:49.751255 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7355501-a07e-4948-8bb4-6cecde154c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:49.762746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7355501-a07e-4948-8bb4-6cecde154c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:49.764143 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7355501-a07e-4948-8bb4-6cecde154c00 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:49.783811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-b7355501-a07e-4948-8bb4-6cecde154c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:49.783811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:49.783811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:49.783811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:49.783811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:49.783811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:49.783811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:49.783811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:49.783811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:49.783811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:49.783811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:49.783811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:49.783811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:49.783811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:49.783811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:49.784882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:49.785924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:49.785924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:49.785924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:49.785924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:49.785924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 292/572] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:49.786206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7355501-a07e-4948-8bb4-6cecde154c00 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:49.829486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c2af1-983c-4082-97f4-6eccde08099d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:49.865562 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a74b9e-e11e-4c73-bca8-6a5453c7d7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:49.866365 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a74b9e-e11e-4c73-bca8-6a5453c7d7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:49.866654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a74b9e-e11e-4c73-bca8-6a5453c7d7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:49.866934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a74b9e-e11e-4c73-bca8-6a5453c7d7b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:49.867716 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a74b9e-e11e-4c73-bca8-6a5453c7d7b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:49.868029 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a74b9e-e11e-4c73-bca8-6a5453c7d7b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:49.869559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a74b9e-e11e-4c73-bca8-6a5453c7d7b3 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:49.871302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:49.888500 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 281/573] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:49.888500 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a74b9e-e11e-4c73-bca8-6a5453c7d7b3 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:49.892888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:49.899786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7355501-a07e-4948-8bb4-6cecde154c00 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:49.935897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aaa24a-6beb-4065-88b5-608d7c3d6399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:49.936860 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaa24a-6beb-4065-88b5-608d7c3d6399 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:49.937273 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaa24a-6beb-4065-88b5-608d7c3d6399 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:49.937998 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaa24a-6beb-4065-88b5-608d7c3d6399 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:49.938874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aaa24a-6beb-4065-88b5-608d7c3d6399 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:49.939292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aaa24a-6beb-4065-88b5-608d7c3d6399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:49.940758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aaa24a-6beb-4065-88b5-608d7c3d6399 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:49.949905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 293/574] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:16:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:49.950770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aaa24a-6beb-4065-88b5-608d7c3d6399 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:50.000105 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a74b9e-e11e-4c73-bca8-6a5453c7d7b3 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:50.034753 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9003250-cf8e-4592-840c-b609160dd559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:50.035420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9003250-cf8e-4592-840c-b609160dd559 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:50.035735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9003250-cf8e-4592-840c-b609160dd559 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:50.036013 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9003250-cf8e-4592-840c-b609160dd559 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:50.036798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9003250-cf8e-4592-840c-b609160dd559 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:50.037136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9003250-cf8e-4592-840c-b609160dd559 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:50.038554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9003250-cf8e-4592-840c-b609160dd559 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:50.055072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 282/575] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:50.055072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9003250-cf8e-4592-840c-b609160dd559 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:50.071060 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aaa24a-6beb-4065-88b5-608d7c3d6399 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:50.107359 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc954c-a75c-4805-9f80-5a8229b4ee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:50.107956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc954c-a75c-4805-9f80-5a8229b4ee96 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:50.108225 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc954c-a75c-4805-9f80-5a8229b4ee96 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:50.108504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc954c-a75c-4805-9f80-5a8229b4ee96 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:50.109322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc954c-a75c-4805-9f80-5a8229b4ee96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:50.109634 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc954c-a75c-4805-9f80-5a8229b4ee96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:50.111016 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc954c-a75c-4805-9f80-5a8229b4ee96 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:50.112160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:50.124077 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 294/576] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:50.126387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc954c-a75c-4805-9f80-5a8229b4ee96 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:50.146609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:50.160106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9003250-cf8e-4592-840c-b609160dd559 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:50.193325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da971f-4bf9-405b-b5bb-d537d276c13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:50.193977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da971f-4bf9-405b-b5bb-d537d276c13d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:50.194259 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da971f-4bf9-405b-b5bb-d537d276c13d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:50.194533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da971f-4bf9-405b-b5bb-d537d276c13d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:50.195357 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da971f-4bf9-405b-b5bb-d537d276c13d None admin] RBAC: Adding query filter params (role.id=21cd8dfe95a341df92f26899aaae6604, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=16a38d4a306748aa8f2e72ceb7f629e2) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:50.195662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da971f-4bf9-405b-b5bb-d537d276c13d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:50.197176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da971f-4bf9-405b-b5bb-d537d276c13d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:50.202929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 283/577] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:50 2022] GET /identity/v3/role_assignments?user.id=16a38d4a306748aa8f2e72ceb7f629e2&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=21cd8dfe95a341df92f26899aaae6604 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:50.203677 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da971f-4bf9-405b-b5bb-d537d276c13d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:50.232873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc954c-a75c-4805-9f80-5a8229b4ee96 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:50.270429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d0908-0390-4243-a9c5-15d2265f9fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:50.271246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d0908-0390-4243-a9c5-15d2265f9fbe None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:50.271529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d0908-0390-4243-a9c5-15d2265f9fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:50.271809 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d0908-0390-4243-a9c5-15d2265f9fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:50.283096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d0908-0390-4243-a9c5-15d2265f9fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:50.284619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d0908-0390-4243-a9c5-15d2265f9fbe None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:50.303832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-160d0908-0390-4243-a9c5-15d2265f9fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:50.303832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:50.303832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:50.303832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:50.303832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:50.303832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:50.303832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:50.303832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:50.303832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:50.303832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:50.303832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:50.303832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:50.303832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:50.303832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:50.303832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:50.305007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:50.305903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:50.305903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:50.305903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:50.305903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:50.310660 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 295/578] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:50.311508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d0908-0390-4243-a9c5-15d2265f9fbe None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:50.330916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da971f-4bf9-405b-b5bb-d537d276c13d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:50.349671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:50.377084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbaee3-f3de-4bdb-a3de-4f60774e01f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:50.377084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbaee3-f3de-4bdb-a3de-4f60774e01f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:50.377084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbaee3-f3de-4bdb-a3de-4f60774e01f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:50.377084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbaee3-f3de-4bdb-a3de-4f60774e01f0 None admin] PATH_INFO: `/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/2c04dc3ee4484afaab388cbb306974af/roles/21cd8dfe95a341df92f26899aaae6604` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:50.386240 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:50.390969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbaee3-f3de-4bdb-a3de-4f60774e01f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e77f9cc1c14e35b1d3e1874f107494, user_id=2c04dc3ee4484afaab388cbb306974af, role_id=21cd8dfe95a341df92f26899aaae6604)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:50.392403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbaee3-f3de-4bdb-a3de-4f60774e01f0 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:50.406523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 284/579] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:16:50 2022] PUT /identity/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/2c04dc3ee4484afaab388cbb306974af/roles/21cd8dfe95a341df92f26899aaae6604 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:50.407870 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7a72c-f535-43de-ab27-29a7d6fb6ef4 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:50.408157 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7a72c-f535-43de-ab27-29a7d6fb6ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:50.408434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7a72c-f535-43de-ab27-29a7d6fb6ef4 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:50.414170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 285/580] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:50.415160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7a72c-f535-43de-ab27-29a7d6fb6ef4 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:50.434236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d0908-0390-4243-a9c5-15d2265f9fbe None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:50.483761 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb077d-31a5-4ff0-b381-cb1b04ad4301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:50.485500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb077d-31a5-4ff0-b381-cb1b04ad4301 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:50.486285 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb077d-31a5-4ff0-b381-cb1b04ad4301 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:50.486776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb077d-31a5-4ff0-b381-cb1b04ad4301 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:50.498425 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb077d-31a5-4ff0-b381-cb1b04ad4301 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:50.501142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb077d-31a5-4ff0-b381-cb1b04ad4301 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-6feb077d-31a5-4ff0-b381-cb1b04ad4301 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:16:50.519732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:50.520740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:50.521776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:50.521776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:50.521776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:16:50.521776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:16:50.521776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:16:50.521776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:16:50.521776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:16:50.521776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:16:50.521776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 22:16:50.521776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:50.522290 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 296/581] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:50.523712 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ec4eb-e5b9-46ce-b277-585373b12784 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:50.524063 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ec4eb-e5b9-46ce-b277-585373b12784 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:50.524407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ec4eb-e5b9-46ce-b277-585373b12784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:50.540879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7a72c-f535-43de-ab27-29a7d6fb6ef4 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:50.550129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-242ec4eb-e5b9-46ce-b277-585373b12784 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:50.552228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-242ec4eb-e5b9-46ce-b277-585373b12784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:50.582699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00921b72-151b-435f-b76a-7a1cc633492f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:50.583714 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00921b72-151b-435f-b76a-7a1cc633492f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:50.584177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00921b72-151b-435f-b76a-7a1cc633492f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:50.584632 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00921b72-151b-435f-b76a-7a1cc633492f None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:50.585663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00921b72-151b-435f-b76a-7a1cc633492f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:50.586217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00921b72-151b-435f-b76a-7a1cc633492f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:50.587766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00921b72-151b-435f-b76a-7a1cc633492f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:50.602043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 286/582] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:50.603157 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00921b72-151b-435f-b76a-7a1cc633492f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:50.646770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:50.647903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 297/583] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:50.648918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ec4eb-e5b9-46ce-b277-585373b12784 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:50.735410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:50.747859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00921b72-151b-435f-b76a-7a1cc633492f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:50.784682 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28711f-7d03-4cb7-8eb3-bdd26bf496c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:50.785404 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28711f-7d03-4cb7-8eb3-bdd26bf496c3 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:50.785683 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28711f-7d03-4cb7-8eb3-bdd26bf496c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:50.786009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28711f-7d03-4cb7-8eb3-bdd26bf496c3 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:50.786118 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ec4eb-e5b9-46ce-b277-585373b12784 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:50.786851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28711f-7d03-4cb7-8eb3-bdd26bf496c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:50.787203 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28711f-7d03-4cb7-8eb3-bdd26bf496c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:50.788839 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28711f-7d03-4cb7-8eb3-bdd26bf496c3 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:50.807962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 287/584] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jul 21 22:16:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:50.808799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28711f-7d03-4cb7-8eb3-bdd26bf496c3 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:50.826847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263ae70-9194-40f5-ae58-09091770616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:50.828022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263ae70-9194-40f5-ae58-09091770616c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:50.828563 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263ae70-9194-40f5-ae58-09091770616c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:50.828851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263ae70-9194-40f5-ae58-09091770616c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:50.837977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263ae70-9194-40f5-ae58-09091770616c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:50.840214 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263ae70-9194-40f5-ae58-09091770616c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3263ae70-9194-40f5-ae58-09091770616c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:16:50.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:50.859583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:50.861096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:50.861096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:50.861096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:16:50.861096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:16:50.861096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:16:50.861096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:16:50.861096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:16:50.861096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:16:50.861096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:16:50.861096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:50.861096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 298/585] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:50.861096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263ae70-9194-40f5-ae58-09091770616c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:50.909117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:50.928189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28711f-7d03-4cb7-8eb3-bdd26bf496c3 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:50.966437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d59dff-a3d3-410e-802e-112b8fccb6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:50.967723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d59dff-a3d3-410e-802e-112b8fccb6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:50.968297 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d59dff-a3d3-410e-802e-112b8fccb6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:50.968765 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d59dff-a3d3-410e-802e-112b8fccb6d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:50.980667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d59dff-a3d3-410e-802e-112b8fccb6d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:50.985307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263ae70-9194-40f5-ae58-09091770616c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-88d59dff-a3d3-410e-802e-112b8fccb6d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:50.989572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:50.990465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:50.991282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:50.991282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:50.991282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:50.991282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:50.991282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:50.991282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:50.991282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:50.991282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:50.991282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:50.991282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:50.991282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:50.991282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:50.993942 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 288/586] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:50.994972 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d59dff-a3d3-410e-802e-112b8fccb6d1 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:51.014734 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:51.032861 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032797df-3e96-4840-aef0-12fd3f5a7daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:51.033938 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032797df-3e96-4840-aef0-12fd3f5a7daa None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:51.034221 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032797df-3e96-4840-aef0-12fd3f5a7daa None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:51.034509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032797df-3e96-4840-aef0-12fd3f5a7daa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:51.046781 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032797df-3e96-4840-aef0-12fd3f5a7daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:51.048393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032797df-3e96-4840-aef0-12fd3f5a7daa None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:51.075096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-032797df-3e96-4840-aef0-12fd3f5a7daa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:51.075096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:51.075096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:51.075096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:51.075096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:51.075096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:51.075096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:51.075096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:51.075096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:51.075096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:51.075096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:51.075096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:51.075096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:51.075096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:51.075096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:51.075951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:51.076828 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:51.076828 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:51.076828 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:51.076828 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:51.079257 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 299/587] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:51.080329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032797df-3e96-4840-aef0-12fd3f5a7daa None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:51.116600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d59dff-a3d3-410e-802e-112b8fccb6d1 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:51.153817 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43ab83-f9b3-4399-8613-50a4393dd86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:51.154872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43ab83-f9b3-4399-8613-50a4393dd86a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:51.155374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43ab83-f9b3-4399-8613-50a4393dd86a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:51.155902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43ab83-f9b3-4399-8613-50a4393dd86a None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:51.156946 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43ab83-f9b3-4399-8613-50a4393dd86a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:51.157466 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43ab83-f9b3-4399-8613-50a4393dd86a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:51.159069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43ab83-f9b3-4399-8613-50a4393dd86a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:51.177873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 289/588] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jul 21 22:16:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:51.179024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43ab83-f9b3-4399-8613-50a4393dd86a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:51.182807 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:51.212194 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032797df-3e96-4840-aef0-12fd3f5a7daa None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:51.256475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187105c7-d699-4d87-99ae-f68f0eb078c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:51.257174 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187105c7-d699-4d87-99ae-f68f0eb078c6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:51.257462 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187105c7-d699-4d87-99ae-f68f0eb078c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:51.257743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187105c7-d699-4d87-99ae-f68f0eb078c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:51.258495 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187105c7-d699-4d87-99ae-f68f0eb078c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:51.258806 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187105c7-d699-4d87-99ae-f68f0eb078c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:51.261183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187105c7-d699-4d87-99ae-f68f0eb078c6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:51.272066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 300/589] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:16:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:51.272994 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187105c7-d699-4d87-99ae-f68f0eb078c6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:51.289307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43ab83-f9b3-4399-8613-50a4393dd86a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:51.310750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:51.332087 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6a673-ace8-4e61-8326-66a945ec0e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:51.332754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a673-ace8-4e61-8326-66a945ec0e50 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:51.333065 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a673-ace8-4e61-8326-66a945ec0e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:51.333633 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a673-ace8-4e61-8326-66a945ec0e50 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:51.334371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6a673-ace8-4e61-8326-66a945ec0e50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:51.334678 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6a673-ace8-4e61-8326-66a945ec0e50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:51.336052 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6a673-ace8-4e61-8326-66a945ec0e50 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:51.351754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 290/590] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:51.352632 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6a673-ace8-4e61-8326-66a945ec0e50 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:51.397556 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187105c7-d699-4d87-99ae-f68f0eb078c6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:51.428679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:51.445933 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862cb1b-4e5a-4c20-ae9c-619fe1325879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:51.447509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862cb1b-4e5a-4c20-ae9c-619fe1325879 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:51.448622 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862cb1b-4e5a-4c20-ae9c-619fe1325879 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:51.449524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862cb1b-4e5a-4c20-ae9c-619fe1325879 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:51.464344 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862cb1b-4e5a-4c20-ae9c-619fe1325879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:51.467100 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862cb1b-4e5a-4c20-ae9c-619fe1325879 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:51.473034 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6a673-ace8-4e61-8326-66a945ec0e50 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:51.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-0862cb1b-4e5a-4c20-ae9c-619fe1325879 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:51.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:51.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:51.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:51.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:51.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:51.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:51.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:51.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:51.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:51.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:51.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:51.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:51.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:51.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:51.491304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:51.492238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:51.492238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:51.492238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:51.492238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:51.500028 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 301/591] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:51.500028 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862cb1b-4e5a-4c20-ae9c-619fe1325879 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:51.522002 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb57e96-a064-4eeb-bc23-00bfb5e84f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:51.523229 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb57e96-a064-4eeb-bc23-00bfb5e84f1a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:51.523719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb57e96-a064-4eeb-bc23-00bfb5e84f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:51.524215 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb57e96-a064-4eeb-bc23-00bfb5e84f1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:51.537445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb57e96-a064-4eeb-bc23-00bfb5e84f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:51.539255 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb57e96-a064-4eeb-bc23-00bfb5e84f1a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:51.558960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-2fb57e96-a064-4eeb-bc23-00bfb5e84f1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:51.558960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:51.558960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:51.558960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:51.558960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:51.558960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:51.558960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:51.558960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:51.558960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:51.558960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:51.558960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:51.558960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:51.558960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:51.558960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:51.558960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:51.559876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:51.560746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:51.560746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:51.560746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:51.560746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:51.563172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 291/592] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:51.564231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb57e96-a064-4eeb-bc23-00bfb5e84f1a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:51.592067 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:51.608394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862cb1b-4e5a-4c20-ae9c-619fe1325879 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:51.643373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6954db-f5ff-48ec-a970-abe51424857e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:51.644222 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6954db-f5ff-48ec-a970-abe51424857e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:51.644501 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6954db-f5ff-48ec-a970-abe51424857e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:51.644772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6954db-f5ff-48ec-a970-abe51424857e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:51.651876 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6954db-f5ff-48ec-a970-abe51424857e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:51.653612 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6954db-f5ff-48ec-a970-abe51424857e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:51.668153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ea6954db-f5ff-48ec-a970-abe51424857e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:51.668153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:51.668153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:51.668153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:51.668153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:51.668153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:51.668153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:51.668153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:51.668153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:51.668153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:51.668153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:51.668153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:51.668153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:16:51.668153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:16:51.668153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:51.669351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:51.670266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:16:51.670266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:16:51.670266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:16:51.670266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:16:51.670266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:16:51.670266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:16:51.670266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:51.670266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:51.670266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 302/593] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:51.670741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6954db-f5ff-48ec-a970-abe51424857e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:51.686156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb57e96-a064-4eeb-bc23-00bfb5e84f1a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:51.704205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:51.726369 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d00525-5888-45d7-ab78-c03bfd986a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:51.727465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00525-5888-45d7-ab78-c03bfd986a30 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:51.728081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00525-5888-45d7-ab78-c03bfd986a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:51.728583 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00525-5888-45d7-ab78-c03bfd986a30 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:51.730108 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d00525-5888-45d7-ab78-c03bfd986a30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:51.730624 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d00525-5888-45d7-ab78-c03bfd986a30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:51.732348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d00525-5888-45d7-ab78-c03bfd986a30 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:51.750278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 292/594] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:51.751428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d00525-5888-45d7-ab78-c03bfd986a30 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:51.773310 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6954db-f5ff-48ec-a970-abe51424857e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:51.809391 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f3481-e16d-4b7b-8162-beef4aacfe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:51.810144 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f3481-e16d-4b7b-8162-beef4aacfe9b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:51.810334 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f3481-e16d-4b7b-8162-beef4aacfe9b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:51.810594 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f3481-e16d-4b7b-8162-beef4aacfe9b None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:51.811309 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f3481-e16d-4b7b-8162-beef4aacfe9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:51.811673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f3481-e16d-4b7b-8162-beef4aacfe9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:51.813278 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f3481-e16d-4b7b-8162-beef4aacfe9b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:51.830948 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 303/595] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:51.831806 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f3481-e16d-4b7b-8162-beef4aacfe9b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:51.842409 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:51.863002 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d00525-5888-45d7-ab78-c03bfd986a30 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:51.899297 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c8999-d103-49c0-8a39-febd98d4ed13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:51.900445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8999-d103-49c0-8a39-febd98d4ed13 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:51.901510 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8999-d103-49c0-8a39-febd98d4ed13 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:51.902010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8999-d103-49c0-8a39-febd98d4ed13 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:51.903388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c8999-d103-49c0-8a39-febd98d4ed13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:51.903902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c8999-d103-49c0-8a39-febd98d4ed13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:51.905664 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c8999-d103-49c0-8a39-febd98d4ed13 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:51.918443 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 293/596] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:51.919549 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c8999-d103-49c0-8a39-febd98d4ed13 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:51.939229 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f3481-e16d-4b7b-8162-beef4aacfe9b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:51.956985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:51.976150 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb0609-362d-4919-8afb-a56c1be2a7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:51.977116 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb0609-362d-4919-8afb-a56c1be2a7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:51.977321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb0609-362d-4919-8afb-a56c1be2a7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:51.977596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb0609-362d-4919-8afb-a56c1be2a7e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:51.984719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb0609-362d-4919-8afb-a56c1be2a7e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:51.986246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb0609-362d-4919-8afb-a56c1be2a7e2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:52.000718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a4bb0609-362d-4919-8afb-a56c1be2a7e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:52.000718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:52.000718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:52.000718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:52.000718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:52.000718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:52.000718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:52.000718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:52.000718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:52.000718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:52.000718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:52.000718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:52.000718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:16:52.000718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:16:52.000718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:52.001636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:52.002504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:16:52.002504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:16:52.002504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:16:52.002504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:16:52.002504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:16:52.002504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:16:52.002504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:52.002504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:52.006644 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 304/597] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:52.007460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb0609-362d-4919-8afb-a56c1be2a7e2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:52.035485 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c8999-d103-49c0-8a39-febd98d4ed13 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:52.076323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:52.080146 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4fd1d-db6e-4a1a-900b-426854b7be0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:52.081324 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4fd1d-db6e-4a1a-900b-426854b7be0e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:52.081841 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4fd1d-db6e-4a1a-900b-426854b7be0e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:52.082777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4fd1d-db6e-4a1a-900b-426854b7be0e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:52.092281 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4fd1d-db6e-4a1a-900b-426854b7be0e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:52.093876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4fd1d-db6e-4a1a-900b-426854b7be0e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-77c4fd1d-db6e-4a1a-900b-426854b7be0e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:16:52.109568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:52.110581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:52.111779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:52.111779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:52.111779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:16:52.111779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:16:52.111779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:16:52.111779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:16:52.111779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:16:52.111779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:16:52.111779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 22:16:52.111779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:52.115840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 294/598] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:52.116890 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4fd1d-db6e-4a1a-900b-426854b7be0e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:52.118664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb0609-362d-4919-8afb-a56c1be2a7e2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:52.155245 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef192828-fa84-4097-b310-fabd92f52576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:52.156476 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef192828-fa84-4097-b310-fabd92f52576 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:52.156953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef192828-fa84-4097-b310-fabd92f52576 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:52.157470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef192828-fa84-4097-b310-fabd92f52576 None admin] PATH_INFO: `/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/aefb0fe4d09b451a861510508bb9cf1e/roles/21cd8dfe95a341df92f26899aaae6604` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:52.172912 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef192828-fa84-4097-b310-fabd92f52576 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e77f9cc1c14e35b1d3e1874f107494, user_id=aefb0fe4d09b451a861510508bb9cf1e, role_id=21cd8dfe95a341df92f26899aaae6604)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:52.174785 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef192828-fa84-4097-b310-fabd92f52576 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:52.194129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 305/599] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:16:52 2022] PUT /identity/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/aefb0fe4d09b451a861510508bb9cf1e/roles/21cd8dfe95a341df92f26899aaae6604 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:52.195904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef192828-fa84-4097-b310-fabd92f52576 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:52.259943 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:52.271186 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4fd1d-db6e-4a1a-900b-426854b7be0e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:52.330061 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681ffdd-f41c-49b7-9cde-b4f9d7f648f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:52.331123 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681ffdd-f41c-49b7-9cde-b4f9d7f648f0 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:52.331789 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681ffdd-f41c-49b7-9cde-b4f9d7f648f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:52.332265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681ffdd-f41c-49b7-9cde-b4f9d7f648f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:52.333896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681ffdd-f41c-49b7-9cde-b4f9d7f648f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:52.334698 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681ffdd-f41c-49b7-9cde-b4f9d7f648f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:52.336553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681ffdd-f41c-49b7-9cde-b4f9d7f648f0 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:52.351756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 295/600] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:52.356695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0cf3c-b0c0-42cd-ae01-351c03e3760f None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:52.356695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0cf3c-b0c0-42cd-ae01-351c03e3760f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:52.356695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0cf3c-b0c0-42cd-ae01-351c03e3760f None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:52.356695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 296/601] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:52.358160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0cf3c-b0c0-42cd-ae01-351c03e3760f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:52.379369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef192828-fa84-4097-b310-fabd92f52576 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:52.399362 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:52.426128 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4eb4b-2b57-45ae-84ac-fc3ed77e658e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:52.427258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4eb4b-2b57-45ae-84ac-fc3ed77e658e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:52.427809 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4eb4b-2b57-45ae-84ac-fc3ed77e658e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:52.428286 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4eb4b-2b57-45ae-84ac-fc3ed77e658e None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:52.429333 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4eb4b-2b57-45ae-84ac-fc3ed77e658e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:52.429841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4eb4b-2b57-45ae-84ac-fc3ed77e658e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:52.431604 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4eb4b-2b57-45ae-84ac-fc3ed77e658e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:52.452188 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 306/602] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Jul 21 22:16:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:52.453855 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fb4fa-c806-498b-aeaf-c3a6c1ff6d3c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:52.454320 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fb4fa-c806-498b-aeaf-c3a6c1ff6d3c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:52.454888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fb4fa-c806-498b-aeaf-c3a6c1ff6d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:52.472007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0cf3c-b0c0-42cd-ae01-351c03e3760f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:52.473027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c00fb4fa-c806-498b-aeaf-c3a6c1ff6d3c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:52.474606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c00fb4fa-c806-498b-aeaf-c3a6c1ff6d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:52.507971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9962978-8e07-436f-8062-d52186cd4f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:52.508767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9962978-8e07-436f-8062-d52186cd4f52 None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:52.509167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9962978-8e07-436f-8062-d52186cd4f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:52.509567 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9962978-8e07-436f-8062-d52186cd4f52 None admin] PATH_INFO: `/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/de7ad1ebf93b4e1db64e3ccf72fa54b5/roles/21cd8dfe95a341df92f26899aaae6604` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:52.524786 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9962978-8e07-436f-8062-d52186cd4f52 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e77f9cc1c14e35b1d3e1874f107494, user_id=de7ad1ebf93b4e1db64e3ccf72fa54b5, role_id=21cd8dfe95a341df92f26899aaae6604)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:52.526892 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9962978-8e07-436f-8062-d52186cd4f52 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:52.548968 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 297/603] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:16:52 2022] PUT /identity/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/de7ad1ebf93b4e1db64e3ccf72fa54b5/roles/21cd8dfe95a341df92f26899aaae6604 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:52.548968 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9962978-8e07-436f-8062-d52186cd4f52 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:52.557319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:52.565216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 307/604] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:52.566620 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa65709-aa5e-44a8-ad51-fc1d25c7b776 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:52.566912 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa65709-aa5e-44a8-ad51-fc1d25c7b776 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:52.567195 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa65709-aa5e-44a8-ad51-fc1d25c7b776 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:52.569085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 308/605] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:52.576132 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a020e-9550-493f-9fbf-7735106cc3f3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:52.576443 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a020e-9550-493f-9fbf-7735106cc3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:52.576697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a020e-9550-493f-9fbf-7735106cc3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:52.606912 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8e9a020e-9550-493f-9fbf-7735106cc3f3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:52.609073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8e9a020e-9550-493f-9fbf-7735106cc3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:52.687978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 309/606] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:16:52.688855 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a020e-9550-493f-9fbf-7735106cc3f3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:52.692362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9962978-8e07-436f-8062-d52186cd4f52 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:52.725789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:52.732001 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697d3cf-7423-4fd1-8ce0-ba72f68a323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:52.733109 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697d3cf-7423-4fd1-8ce0-ba72f68a323a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:52.733561 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697d3cf-7423-4fd1-8ce0-ba72f68a323a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:52.734005 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697d3cf-7423-4fd1-8ce0-ba72f68a323a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:52.745735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697d3cf-7423-4fd1-8ce0-ba72f68a323a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:52.747414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697d3cf-7423-4fd1-8ce0-ba72f68a323a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:52.766655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-c697d3cf-7423-4fd1-8ce0-ba72f68a323a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:52.766655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:52.766655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:52.766655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:52.766655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:52.766655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:52.766655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:52.766655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:52.766655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:52.766655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:52.766655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:52.766655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:52.766655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:52.766655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:52.766655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:52.767768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:52.768872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:52.768872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:52.768872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:52.768872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:52.770487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 298/607] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:52.771418 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697d3cf-7423-4fd1-8ce0-ba72f68a323a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:52.802484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a020e-9550-493f-9fbf-7735106cc3f3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:52.835517 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:52.840533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a21b6-bb61-434b-bae0-b04906ba94e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:52.842108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a21b6-bb61-434b-bae0-b04906ba94e8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:52.842569 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a21b6-bb61-434b-bae0-b04906ba94e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:52.842867 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a21b6-bb61-434b-bae0-b04906ba94e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:52.854339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a21b6-bb61-434b-bae0-b04906ba94e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a79a21b6-bb61-434b-bae0-b04906ba94e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:52.862580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:52.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:52.864767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:52.864767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:52.864767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:52.864767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:52.864767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:52.864767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:52.864767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:52.864767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:52.864767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:52.864767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:52.864767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:52.864767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:52.866347 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 310/608] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:52.868968 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a21b6-bb61-434b-bae0-b04906ba94e8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:52.891045 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697d3cf-7423-4fd1-8ce0-ba72f68a323a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:52.934903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1e893-6a89-4c1b-8893-985a811d9aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:52.936207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1e893-6a89-4c1b-8893-985a811d9aaf None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:52.936757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1e893-6a89-4c1b-8893-985a811d9aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:52.937071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1e893-6a89-4c1b-8893-985a811d9aaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:52.951200 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1e893-6a89-4c1b-8893-985a811d9aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-f7e1e893-6a89-4c1b-8893-985a811d9aaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:52.962117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:52.963783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:52.964916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:52.964916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:52.964916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:52.964916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:52.964916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:52.964916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:52.964916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:52.964916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:52.964916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:52.964916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:52.964916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:52.964916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:52.964916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 299/609] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:52.964916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1e893-6a89-4c1b-8893-985a811d9aaf None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:52.971765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:52.980223 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a21b6-bb61-434b-bae0-b04906ba94e8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:53.018569 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17501-b534-46a6-a8f9-40a6f3e64505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:53.019636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17501-b534-46a6-a8f9-40a6f3e64505 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:53.020005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17501-b534-46a6-a8f9-40a6f3e64505 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:53.020362 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17501-b534-46a6-a8f9-40a6f3e64505 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:53.021217 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b17501-b534-46a6-a8f9-40a6f3e64505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:53.021598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b17501-b534-46a6-a8f9-40a6f3e64505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:53.023079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b17501-b534-46a6-a8f9-40a6f3e64505 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:53.040976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 311/610] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:53.040976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17501-b534-46a6-a8f9-40a6f3e64505 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:53.113070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1e893-6a89-4c1b-8893-985a811d9aaf None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:53.140625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:53.158986 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17501-b534-46a6-a8f9-40a6f3e64505 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:53.165020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a090c-3012-4fad-9470-fd8165f90d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:53.165932 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a090c-3012-4fad-9470-fd8165f90d7a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:53.166440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a090c-3012-4fad-9470-fd8165f90d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:53.167404 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a090c-3012-4fad-9470-fd8165f90d7a None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:53.168364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a090c-3012-4fad-9470-fd8165f90d7a None admin] RBAC: Adding query filter params (name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:53.169282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a090c-3012-4fad-9470-fd8165f90d7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:53.171244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a090c-3012-4fad-9470-fd8165f90d7a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:53.189207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 300/611] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:16:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:53.189207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a090c-3012-4fad-9470-fd8165f90d7a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:53.207412 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086612e-3ac6-49ea-8e71-3b3134257385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:53.208688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086612e-3ac6-49ea-8e71-3b3134257385 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:53.209211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086612e-3ac6-49ea-8e71-3b3134257385 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:53.209644 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086612e-3ac6-49ea-8e71-3b3134257385 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:53.210620 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086612e-3ac6-49ea-8e71-3b3134257385 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:53.211078 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086612e-3ac6-49ea-8e71-3b3134257385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:53.214207 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086612e-3ac6-49ea-8e71-3b3134257385 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:53.227228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 312/612] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:16:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:53.228240 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086612e-3ac6-49ea-8e71-3b3134257385 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:53.251226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:53.297134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a090c-3012-4fad-9470-fd8165f90d7a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:53.332648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f3702-f7f1-4ccd-b2c1-abbb87ff98e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:53.333644 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f3702-f7f1-4ccd-b2c1-abbb87ff98e8 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:53.334029 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f3702-f7f1-4ccd-b2c1-abbb87ff98e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:53.334410 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f3702-f7f1-4ccd-b2c1-abbb87ff98e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:53.342059 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f3702-f7f1-4ccd-b2c1-abbb87ff98e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:53.343666 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f3702-f7f1-4ccd-b2c1-abbb87ff98e8 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:53.343966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086612e-3ac6-49ea-8e71-3b3134257385 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:53.358557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-2d0f3702-f7f1-4ccd-b2c1-abbb87ff98e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:53.358557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:53.358557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:53.358557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:53.358557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:53.358557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:53.358557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:53.358557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:53.358557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:53.358557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:53.358557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:53.358557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:53.358557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:16:53.358557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:16:53.358557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:53.359679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:53.360746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:16:53.360746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:16:53.360746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:16:53.360746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:16:53.360746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:16:53.360746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:16:53.360746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:53.360746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:53.362549 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 301/613] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:53.363420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f3702-f7f1-4ccd-b2c1-abbb87ff98e8 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:53.383970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ae046-4ddb-46cc-85ad-99aa9f58100f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:53.386014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ae046-4ddb-46cc-85ad-99aa9f58100f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:53.386442 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ae046-4ddb-46cc-85ad-99aa9f58100f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:53.386862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ae046-4ddb-46cc-85ad-99aa9f58100f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:53.399296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ae046-4ddb-46cc-85ad-99aa9f58100f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:53.401714 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ae046-4ddb-46cc-85ad-99aa9f58100f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:53.408700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:53.423969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-333ae046-4ddb-46cc-85ad-99aa9f58100f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:53.423969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:53.423969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:53.423969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:53.423969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:53.423969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:53.423969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:53.423969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:53.423969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:53.423969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:53.423969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:53.423969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:53.423969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:53.423969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:53.423969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:53.424955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:53.425830 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:53.425830 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:53.425830 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:53.425830 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:53.428188 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 313/614] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:53.429417 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ae046-4ddb-46cc-85ad-99aa9f58100f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:53.471947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f3702-f7f1-4ccd-b2c1-abbb87ff98e8 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:53.502811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:53.508473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d87c2-bfc7-4d6b-8234-2c4e7fc65ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:53.508872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d87c2-bfc7-4d6b-8234-2c4e7fc65ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:53.509213 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d87c2-bfc7-4d6b-8234-2c4e7fc65ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:53.509549 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d87c2-bfc7-4d6b-8234-2c4e7fc65ed3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:53.521613 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d87c2-bfc7-4d6b-8234-2c4e7fc65ed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:53.522882 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d87c2-bfc7-4d6b-8234-2c4e7fc65ed3 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:53.541381 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ae046-4ddb-46cc-85ad-99aa9f58100f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:53.541873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-523d87c2-bfc7-4d6b-8234-2c4e7fc65ed3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:53.541873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:53.541873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:53.541873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:53.541873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:53.541873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:53.541873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:53.541873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:53.541873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:53.541873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:53.541873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:53.541873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:53.541873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:53.541873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:53.541873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:53.542722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:53.543588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:53.543588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:53.543588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:53.543588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:53.547870 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 302/615] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:53.548709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d87c2-bfc7-4d6b-8234-2c4e7fc65ed3 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:53.582223 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66818e-f7cb-4c40-9afa-31d64b7a52b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:53.583202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66818e-f7cb-4c40-9afa-31d64b7a52b3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:53.583707 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66818e-f7cb-4c40-9afa-31d64b7a52b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:53.584445 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66818e-f7cb-4c40-9afa-31d64b7a52b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:53.586320 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66818e-f7cb-4c40-9afa-31d64b7a52b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:53.586853 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66818e-f7cb-4c40-9afa-31d64b7a52b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:53.589081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66818e-f7cb-4c40-9afa-31d64b7a52b3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:53.606937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 314/616] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:16:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:53.607812 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66818e-f7cb-4c40-9afa-31d64b7a52b3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:53.656556 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:53.669411 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d87c2-bfc7-4d6b-8234-2c4e7fc65ed3 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:53.717800 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66818e-f7cb-4c40-9afa-31d64b7a52b3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:53.718595 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80650bf4-9a9b-4481-9d24-b53ca35dd3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:53.719758 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80650bf4-9a9b-4481-9d24-b53ca35dd3ee None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:53.721084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80650bf4-9a9b-4481-9d24-b53ca35dd3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:53.721555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80650bf4-9a9b-4481-9d24-b53ca35dd3ee None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:53.722477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80650bf4-9a9b-4481-9d24-b53ca35dd3ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:53.722967 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80650bf4-9a9b-4481-9d24-b53ca35dd3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:53.724519 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80650bf4-9a9b-4481-9d24-b53ca35dd3ee None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:53.741380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 303/617] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:53.742815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80650bf4-9a9b-4481-9d24-b53ca35dd3ee None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:53.753140 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:53.768601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a8666-a6cb-4d46-9412-85e2e6292c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:53.769983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a8666-a6cb-4d46-9412-85e2e6292c9a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:53.770452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a8666-a6cb-4d46-9412-85e2e6292c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:53.770939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a8666-a6cb-4d46-9412-85e2e6292c9a None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:53.771843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a8666-a6cb-4d46-9412-85e2e6292c9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:53.772920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a8666-a6cb-4d46-9412-85e2e6292c9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:53.775046 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a8666-a6cb-4d46-9412-85e2e6292c9a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:53.792353 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 315/618] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:53.793520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a8666-a6cb-4d46-9412-85e2e6292c9a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:53.858297 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80650bf4-9a9b-4481-9d24-b53ca35dd3ee None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:53.906627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1d240-ae99-4a68-9779-5db3728116c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:53.908096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1d240-ae99-4a68-9779-5db3728116c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:53.908948 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1d240-ae99-4a68-9779-5db3728116c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:53.909751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1d240-ae99-4a68-9779-5db3728116c9 None admin] PATH_INFO: `/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/23aaef489c0948fe8bc10acb8e76c84a/roles/21cd8dfe95a341df92f26899aaae6604` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:53.918422 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a8666-a6cb-4d46-9412-85e2e6292c9a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:53.929733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1d240-ae99-4a68-9779-5db3728116c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e77f9cc1c14e35b1d3e1874f107494, user_id=23aaef489c0948fe8bc10acb8e76c84a, role_id=21cd8dfe95a341df92f26899aaae6604)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:53.932081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1d240-ae99-4a68-9779-5db3728116c9 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:53.956959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 304/619] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:16:53 2022] PUT /identity/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/23aaef489c0948fe8bc10acb8e76c84a/roles/21cd8dfe95a341df92f26899aaae6604 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:53.956959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1d240-ae99-4a68-9779-5db3728116c9 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:53.962898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:53.977033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acf139-56af-4b0b-8874-3e1150dc09be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:53.977914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acf139-56af-4b0b-8874-3e1150dc09be None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:53.978198 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acf139-56af-4b0b-8874-3e1150dc09be None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:53.978475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acf139-56af-4b0b-8874-3e1150dc09be None admin] PATH_INFO: `/v3/users/swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:53.993270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acf139-56af-4b0b-8874-3e1150dc09be None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:53.994586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acf139-56af-4b0b-8874-3e1150dc09be None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-49acf139-56af-4b0b-8874-3e1150dc09be None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:16:54.025091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:54.026769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:54.027703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:54.027703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:54.027703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:16:54.027703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:16:54.027703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:16:54.027703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:16:54.027703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:16:54.027703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:16:54.027703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:16:54.027703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:54.028518 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 316/620] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:16:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:54.038035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acf139-56af-4b0b-8874-3e1150dc09be None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:54.138551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1d240-ae99-4a68-9779-5db3728116c9 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:54.172194 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:54.183488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1b4a7-a22e-4029-a69f-9c3039603cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:54.185121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1b4a7-a22e-4029-a69f-9c3039603cee None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:54.185632 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1b4a7-a22e-4029-a69f-9c3039603cee None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:54.186357 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1b4a7-a22e-4029-a69f-9c3039603cee None admin] PATH_INFO: `/v3/users/nova` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:54.197304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1b4a7-a22e-4029-a69f-9c3039603cee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:54.200162 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1b4a7-a22e-4029-a69f-9c3039603cee None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-c3b1b4a7-a22e-4029-a69f-9c3039603cee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:16:54.220159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:54.221180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:54.222101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:54.222101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:54.222101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:16:54.222101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:16:54.222101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:16:54.222101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:16:54.222101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:16:54.222101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:16:54.222101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:16:54.222101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:54.225038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 305/621] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jul 21 22:16:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:54.234013 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1b4a7-a22e-4029-a69f-9c3039603cee None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:54.241858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acf139-56af-4b0b-8874-3e1150dc09be None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:54.279088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63950b5a-d4ad-40a6-9e57-97d780d4ea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:54.279866 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63950b5a-d4ad-40a6-9e57-97d780d4ea4a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:54.280241 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63950b5a-d4ad-40a6-9e57-97d780d4ea4a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:54.280640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63950b5a-d4ad-40a6-9e57-97d780d4ea4a None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:54.281615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63950b5a-d4ad-40a6-9e57-97d780d4ea4a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:54.282047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63950b5a-d4ad-40a6-9e57-97d780d4ea4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:54.283597 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63950b5a-d4ad-40a6-9e57-97d780d4ea4a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:54.302258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 317/622] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jul 21 22:16:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:54.308969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63950b5a-d4ad-40a6-9e57-97d780d4ea4a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:54.341887 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:54.402103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1b4a7-a22e-4029-a69f-9c3039603cee None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:54.444800 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579e0b6-7d5b-411f-a776-f52a77ec9670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:54.445506 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579e0b6-7d5b-411f-a776-f52a77ec9670 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:54.445787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579e0b6-7d5b-411f-a776-f52a77ec9670 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:54.446058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579e0b6-7d5b-411f-a776-f52a77ec9670 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:54.446901 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579e0b6-7d5b-411f-a776-f52a77ec9670 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:54.447204 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579e0b6-7d5b-411f-a776-f52a77ec9670 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:54.448021 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63950b5a-d4ad-40a6-9e57-97d780d4ea4a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:54.448654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579e0b6-7d5b-411f-a776-f52a77ec9670 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:54.464499 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:54.472994 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 306/623] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jul 21 22:16:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:16:54.474750 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41818647-9842-43d0-b014-34f6634eddc1 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:54.475251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41818647-9842-43d0-b014-34f6634eddc1 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:54.475739 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41818647-9842-43d0-b014-34f6634eddc1 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:54.480596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 307/624] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:54.481384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41818647-9842-43d0-b014-34f6634eddc1 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:54.502423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffefe2-38ff-41fd-9c94-4dabee265040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:54.504324 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffefe2-38ff-41fd-9c94-4dabee265040 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:54.504826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffefe2-38ff-41fd-9c94-4dabee265040 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:54.505554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffefe2-38ff-41fd-9c94-4dabee265040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:54.519088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffefe2-38ff-41fd-9c94-4dabee265040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:54.521667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffefe2-38ff-41fd-9c94-4dabee265040 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:54.544898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a0ffefe2-38ff-41fd-9c94-4dabee265040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:54.544898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:54.544898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:54.544898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:54.544898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:54.544898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:54.544898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:54.544898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:54.544898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:54.544898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:54.544898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:54.544898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:54.544898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:54.544898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:54.544898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:54.545878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:54.546813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:54.546813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:54.546813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:54.546813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:54.549454 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 318/625] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:16:54.551313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f984f1-a65e-4652-915d-4e608a7b127b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:54.551771 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f984f1-a65e-4652-915d-4e608a7b127b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:54.552447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f984f1-a65e-4652-915d-4e608a7b127b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:54.573031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-28f984f1-a65e-4652-915d-4e608a7b127b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:54.574833 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-28f984f1-a65e-4652-915d-4e608a7b127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:54.607140 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41818647-9842-43d0-b014-34f6634eddc1 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:54.628476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:54.644429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f2345-9349-4ae7-9973-ed349336d6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:54.644794 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f2345-9349-4ae7-9973-ed349336d6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:54.645146 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f2345-9349-4ae7-9973-ed349336d6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:54.645425 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f2345-9349-4ae7-9973-ed349336d6f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:54.670660 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 319/626] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:54.671936 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f984f1-a65e-4652-915d-4e608a7b127b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:54.736784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f2345-9349-4ae7-9973-ed349336d6f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:54.738930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f2345-9349-4ae7-9973-ed349336d6f0 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:54.782134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:54.796160 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f984f1-a65e-4652-915d-4e608a7b127b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:54.832510 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d371d-ad06-4bdb-8dd8-1e9635ea231f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:54.833277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d371d-ad06-4bdb-8dd8-1e9635ea231f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:54.833560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d371d-ad06-4bdb-8dd8-1e9635ea231f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:54.833838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d371d-ad06-4bdb-8dd8-1e9635ea231f None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:54.834558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d371d-ad06-4bdb-8dd8-1e9635ea231f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:54.834861 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d371d-ad06-4bdb-8dd8-1e9635ea231f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:54.836230 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d371d-ad06-4bdb-8dd8-1e9635ea231f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:54.845912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 308/627] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:54.845912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f2345-9349-4ae7-9973-ed349336d6f0 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:54.851911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 320/628] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:54.857062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f79a-ceaf-4b00-8b04-4fd9d5fac42d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:54.857062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f79a-ceaf-4b00-8b04-4fd9d5fac42d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:54.857062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f79a-ceaf-4b00-8b04-4fd9d5fac42d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:54.857062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 321/629] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:54.857062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89f79a-ceaf-4b00-8b04-4fd9d5fac42d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:54.873600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:54.952266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f2345-9349-4ae7-9973-ed349336d6f0 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:54.974135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89f79a-ceaf-4b00-8b04-4fd9d5fac42d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:54.987370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1f3a8-86ad-4892-8789-37b913329063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:54.988182 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1f3a8-86ad-4892-8789-37b913329063 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:54.988463 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1f3a8-86ad-4892-8789-37b913329063 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:54.988745 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1f3a8-86ad-4892-8789-37b913329063 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:54.999919 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1f3a8-86ad-4892-8789-37b913329063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-72c1f3a8-86ad-4892-8789-37b913329063 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:55.007821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:55.008826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:55.009735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:55.009735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:55.009735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:55.009735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:55.009735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:55.009735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:55.009735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:55.009735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:55.009735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:55.009735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:55.009735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:55.009735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:55.009735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 309/630] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:55.010521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1f3a8-86ad-4892-8789-37b913329063 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:55.014192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350c0c2-4246-4a3b-aec5-05ec7146c4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:55.014991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c0c2-4246-4a3b-aec5-05ec7146c4fe None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:55.015394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c0c2-4246-4a3b-aec5-05ec7146c4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:55.015673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c0c2-4246-4a3b-aec5-05ec7146c4fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:55.026433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350c0c2-4246-4a3b-aec5-05ec7146c4fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:55.028246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350c0c2-4246-4a3b-aec5-05ec7146c4fe None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:55.037738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:55.049625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-8350c0c2-4246-4a3b-aec5-05ec7146c4fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:55.049625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:55.049625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:55.049625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:55.049625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:55.049625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:55.049625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:55.049625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:55.049625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:55.049625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:55.049625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:55.049625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:55.049625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:55.049625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:55.049625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:55.050492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:55.051373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:55.051373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:55.051373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:55.051373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:55.051373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 322/631] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:55.051952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc173a36-152f-4768-9394-9b323854dddf None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:55.052237 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc173a36-152f-4768-9394-9b323854dddf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:55.052513 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc173a36-152f-4768-9394-9b323854dddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:55.075027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cc173a36-152f-4768-9394-9b323854dddf None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:55.076859 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cc173a36-152f-4768-9394-9b323854dddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:55.102800 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:55.123892 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1f3a8-86ad-4892-8789-37b913329063 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:55.148185 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 323/632] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:55.149360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc173a36-152f-4768-9394-9b323854dddf None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:55.164538 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b17adb-9c19-4392-97fa-1aae5bba6154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:55.165659 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17adb-9c19-4392-97fa-1aae5bba6154 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:55.166757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17adb-9c19-4392-97fa-1aae5bba6154 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:55.167225 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17adb-9c19-4392-97fa-1aae5bba6154 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:55.175745 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b17adb-9c19-4392-97fa-1aae5bba6154 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:55.177694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b17adb-9c19-4392-97fa-1aae5bba6154 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:55.193637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-61b17adb-9c19-4392-97fa-1aae5bba6154 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:55.193637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:55.193637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:55.193637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:55.193637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:55.193637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:55.193637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:55.193637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:55.193637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:55.193637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:55.193637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:55.193637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:55.193637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:16:55.193637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:16:55.193637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:55.194957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:55.195820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:16:55.195820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:16:55.195820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:16:55.195820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:16:55.195820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:16:55.195820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:16:55.195820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:55.195820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:55.197799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 310/633] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:55.198744 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b17adb-9c19-4392-97fa-1aae5bba6154 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:55.266181 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc173a36-152f-4768-9394-9b323854dddf None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:55.298956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:55.307579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73386d6b-c2fd-4de9-8e5b-fc8c203db4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:55.308183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73386d6b-c2fd-4de9-8e5b-fc8c203db4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:55.308466 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73386d6b-c2fd-4de9-8e5b-fc8c203db4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:55.308742 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73386d6b-c2fd-4de9-8e5b-fc8c203db4f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:55.309197 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b17adb-9c19-4392-97fa-1aae5bba6154 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:55.309527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73386d6b-c2fd-4de9-8e5b-fc8c203db4f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:55.309835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73386d6b-c2fd-4de9-8e5b-fc8c203db4f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:55.311267 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73386d6b-c2fd-4de9-8e5b-fc8c203db4f8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:55.320458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 324/634] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:16:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:55.321312 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73386d6b-c2fd-4de9-8e5b-fc8c203db4f8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:55.347890 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914409a1-cc5c-455f-a72a-9d6cd6577ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:55.348561 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914409a1-cc5c-455f-a72a-9d6cd6577ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:55.348849 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914409a1-cc5c-455f-a72a-9d6cd6577ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:55.349170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914409a1-cc5c-455f-a72a-9d6cd6577ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:55.349894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914409a1-cc5c-455f-a72a-9d6cd6577ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:55.350199 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914409a1-cc5c-455f-a72a-9d6cd6577ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:55.351564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914409a1-cc5c-455f-a72a-9d6cd6577ff6 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:55.360832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:55.370386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 311/635] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:55.371238 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914409a1-cc5c-455f-a72a-9d6cd6577ff6 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:55.440187 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73386d6b-c2fd-4de9-8e5b-fc8c203db4f8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:55.473537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914409a1-cc5c-455f-a72a-9d6cd6577ff6 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:55.474349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea59fb-b673-448e-a94e-fcaac0ef9b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:55.475218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea59fb-b673-448e-a94e-fcaac0ef9b32 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:55.475576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea59fb-b673-448e-a94e-fcaac0ef9b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:55.476514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea59fb-b673-448e-a94e-fcaac0ef9b32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:55.486592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea59fb-b673-448e-a94e-fcaac0ef9b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-49ea59fb-b673-448e-a94e-fcaac0ef9b32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:55.495023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:55.495966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:55.496786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:55.496786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:55.496786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:55.496786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:55.496786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:55.496786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:55.496786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:55.496786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:55.496786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:55.496786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:55.496786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:55.496786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:55.496786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 325/636] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:55.498044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea59fb-b673-448e-a94e-fcaac0ef9b32 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:55.509733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c0755-34f4-43e2-afa4-2c9574f98e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:55.510489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c0755-34f4-43e2-afa4-2c9574f98e45 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:55.510774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c0755-34f4-43e2-afa4-2c9574f98e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:55.511053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c0755-34f4-43e2-afa4-2c9574f98e45 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:55.511877 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c0755-34f4-43e2-afa4-2c9574f98e45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:55.512190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c0755-34f4-43e2-afa4-2c9574f98e45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:55.513649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c0755-34f4-43e2-afa4-2c9574f98e45 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:55.531880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 312/637] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:16:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:55.532721 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c0755-34f4-43e2-afa4-2c9574f98e45 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:55.555972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:55.594697 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:55.610526 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea59fb-b673-448e-a94e-fcaac0ef9b32 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:55.636118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c0755-34f4-43e2-afa4-2c9574f98e45 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:55.648358 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0e9d5-bd2f-439a-91b8-f5655132ebc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:55.649294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0e9d5-bd2f-439a-91b8-f5655132ebc9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:55.649572 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0e9d5-bd2f-439a-91b8-f5655132ebc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:55.649847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0e9d5-bd2f-439a-91b8-f5655132ebc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:55.662250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0e9d5-bd2f-439a-91b8-f5655132ebc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:55.663803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0e9d5-bd2f-439a-91b8-f5655132ebc9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:55.670535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcc0d1-adfd-4603-8d2e-5b05fccbf7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:55.671328 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcc0d1-adfd-4603-8d2e-5b05fccbf7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:55.671613 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcc0d1-adfd-4603-8d2e-5b05fccbf7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:55.671888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcc0d1-adfd-4603-8d2e-5b05fccbf7f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:55.678571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcc0d1-adfd-4603-8d2e-5b05fccbf7f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:55.679995 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcc0d1-adfd-4603-8d2e-5b05fccbf7f0 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:55.682544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-68e0e9d5-bd2f-439a-91b8-f5655132ebc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:55.682544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:55.682544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:55.682544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:55.682544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:55.682544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:55.682544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:55.682544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:55.682544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:55.682544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:55.682544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:55.682544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:55.682544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:55.682544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:55.682544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:55.683587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:55.684688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:55.684688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:55.684688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:55.684688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:55.689518 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 326/638] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:55.689518 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0e9d5-bd2f-439a-91b8-f5655132ebc9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:55.698987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-04fcc0d1-adfd-4603-8d2e-5b05fccbf7f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:55.698987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:55.698987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:55.698987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:55.698987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:55.698987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:55.698987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:55.698987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:55.698987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:55.698987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:55.698987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:55.698987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:55.698987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:16:55.698987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:16:55.698987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:55.700113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:55.705976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:16:55.705976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:16:55.705976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:16:55.705976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:16:55.705976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:16:55.705976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:16:55.705976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:55.705976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:55.705976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 313/639] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:55.705976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcc0d1-adfd-4603-8d2e-5b05fccbf7f0 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:55.804882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0e9d5-bd2f-439a-91b8-f5655132ebc9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:55.805145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcc0d1-adfd-4603-8d2e-5b05fccbf7f0 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:55.807850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:55.829074 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:55.844377 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726991aa-da9b-421f-b845-faa8562f6cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:55.845139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726991aa-da9b-421f-b845-faa8562f6cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:55.845364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726991aa-da9b-421f-b845-faa8562f6cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:55.845662 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726991aa-da9b-421f-b845-faa8562f6cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:55.846379 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726991aa-da9b-421f-b845-faa8562f6cd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:55.846550 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac738c-9db7-4f98-a527-f2bd3122513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:55.846666 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726991aa-da9b-421f-b845-faa8562f6cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:55.847671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac738c-9db7-4f98-a527-f2bd3122513e None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:55.848024 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726991aa-da9b-421f-b845-faa8562f6cd6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:55.848266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac738c-9db7-4f98-a527-f2bd3122513e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:55.848691 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac738c-9db7-4f98-a527-f2bd3122513e None admin] PATH_INFO: `/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/16a38d4a306748aa8f2e72ceb7f629e2/roles/21cd8dfe95a341df92f26899aaae6604` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:55.856881 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 327/640] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:16:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:55.857699 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726991aa-da9b-421f-b845-faa8562f6cd6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:55.865342 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac738c-9db7-4f98-a527-f2bd3122513e None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e77f9cc1c14e35b1d3e1874f107494, user_id=16a38d4a306748aa8f2e72ceb7f629e2, role_id=21cd8dfe95a341df92f26899aaae6604)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:55.866773 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac738c-9db7-4f98-a527-f2bd3122513e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:55.889020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 314/641] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:16:55 2022] PUT /identity/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/16a38d4a306748aa8f2e72ceb7f629e2/roles/21cd8dfe95a341df92f26899aaae6604 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:16:55.890060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac738c-9db7-4f98-a527-f2bd3122513e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:55.983454 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726991aa-da9b-421f-b845-faa8562f6cd6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:56.015326 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac738c-9db7-4f98-a527-f2bd3122513e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:56.022033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f2913-83cc-490f-b6ba-239e3bf477a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:56.022999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2913-83cc-490f-b6ba-239e3bf477a0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:56.023446 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2913-83cc-490f-b6ba-239e3bf477a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:56.023885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2913-83cc-490f-b6ba-239e3bf477a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:56.024839 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f2913-83cc-490f-b6ba-239e3bf477a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:56.025330 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f2913-83cc-490f-b6ba-239e3bf477a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:56.027617 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f2913-83cc-490f-b6ba-239e3bf477a0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:56.042304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 328/642] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:56.043487 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f2913-83cc-490f-b6ba-239e3bf477a0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:56.056915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006ea31-c978-4e81-b029-f6f98f17dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:56.057611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006ea31-c978-4e81-b029-f6f98f17dd57 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:56.057890 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006ea31-c978-4e81-b029-f6f98f17dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:56.058185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006ea31-c978-4e81-b029-f6f98f17dd57 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:56.059179 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006ea31-c978-4e81-b029-f6f98f17dd57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:56.059300 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006ea31-c978-4e81-b029-f6f98f17dd57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:56.060663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006ea31-c978-4e81-b029-f6f98f17dd57 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:56.073742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 315/643] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:16:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:56.074149 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006ea31-c978-4e81-b029-f6f98f17dd57 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:56.088592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:56.117049 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:56.179304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f2913-83cc-490f-b6ba-239e3bf477a0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:56.196951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006ea31-c978-4e81-b029-f6f98f17dd57 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:56.215270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526757c8-d75c-42df-b193-c4cc7531b29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:56.216064 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526757c8-d75c-42df-b193-c4cc7531b29e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:56.216343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526757c8-d75c-42df-b193-c4cc7531b29e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:56.216620 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526757c8-d75c-42df-b193-c4cc7531b29e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:56.226926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526757c8-d75c-42df-b193-c4cc7531b29e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:56.228489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526757c8-d75c-42df-b193-c4cc7531b29e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:56.234798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043c31c-6b63-4f50-a1cc-4cba03346f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:56.235610 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043c31c-6b63-4f50-a1cc-4cba03346f87 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:56.235897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043c31c-6b63-4f50-a1cc-4cba03346f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:56.236535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043c31c-6b63-4f50-a1cc-4cba03346f87 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:56.244438 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043c31c-6b63-4f50-a1cc-4cba03346f87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:56.245892 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043c31c-6b63-4f50-a1cc-4cba03346f87 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:56.247328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-526757c8-d75c-42df-b193-c4cc7531b29e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:56.247328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:56.247328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:56.247328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:56.247328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:56.247328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:56.247328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:56.247328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:56.247328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:56.247328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:56.247328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:56.247328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:56.247328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:56.247328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:56.247328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:56.248176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:56.249301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:56.249301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:56.249301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:56.249301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:56.253173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 329/644] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:56.253771 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526757c8-d75c-42df-b193-c4cc7531b29e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-f043c31c-6b63-4f50-a1cc-4cba03346f87 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:16:56.260795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:56.261880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:56.264547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:56.264547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:56.264547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:16:56.264547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:16:56.264547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:16:56.264547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:16:56.264547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:16:56.264547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:16:56.264547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 22:16:56.264547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:56.264547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 316/645] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:56.264547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243d933-4073-43d4-bf08-4d86c3322485 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:56.264547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243d933-4073-43d4-bf08-4d86c3322485 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:56.268476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243d933-4073-43d4-bf08-4d86c3322485 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:56.268476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 317/646] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:56.268476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243d933-4073-43d4-bf08-4d86c3322485 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:56.339970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:56.362970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526757c8-d75c-42df-b193-c4cc7531b29e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:56.371167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:56.382340 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243d933-4073-43d4-bf08-4d86c3322485 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:56.401684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bab94c-67d8-4d3f-9e53-da88b53fa84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:56.402347 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bab94c-67d8-4d3f-9e53-da88b53fa84e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:56.402623 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bab94c-67d8-4d3f-9e53-da88b53fa84e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:56.403228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bab94c-67d8-4d3f-9e53-da88b53fa84e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:56.403980 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bab94c-67d8-4d3f-9e53-da88b53fa84e None admin] RBAC: Adding query filter params (role.id=21cd8dfe95a341df92f26899aaae6604, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=2c04dc3ee4484afaab388cbb306974af) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:56.404288 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bab94c-67d8-4d3f-9e53-da88b53fa84e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:56.405889 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bab94c-67d8-4d3f-9e53-da88b53fa84e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:56.412006 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 330/647] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:56 2022] GET /identity/v3/role_assignments?user.id=2c04dc3ee4484afaab388cbb306974af&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=21cd8dfe95a341df92f26899aaae6604 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:56.412768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bab94c-67d8-4d3f-9e53-da88b53fa84e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:56.424077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27864a8-756a-4a95-8669-e914c914fe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:56.424945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27864a8-756a-4a95-8669-e914c914fe2f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:56.425365 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27864a8-756a-4a95-8669-e914c914fe2f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:56.425753 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27864a8-756a-4a95-8669-e914c914fe2f None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:56.426618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27864a8-756a-4a95-8669-e914c914fe2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:56.427055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27864a8-756a-4a95-8669-e914c914fe2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:56.429970 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27864a8-756a-4a95-8669-e914c914fe2f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:56.448133 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 318/648] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:56.448133 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec9b81-98e4-4aa4-a3a8-2ded8e06d6ee None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:56.448133 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec9b81-98e4-4aa4-a3a8-2ded8e06d6ee None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:56.448133 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec9b81-98e4-4aa4-a3a8-2ded8e06d6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:56.466472 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-d6ec9b81-98e4-4aa4-a3a8-2ded8e06d6ee None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:56.467833 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-d6ec9b81-98e4-4aa4-a3a8-2ded8e06d6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:56.555959 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bab94c-67d8-4d3f-9e53-da88b53fa84e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:56.569760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 319/649] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:56.571526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec9b81-98e4-4aa4-a3a8-2ded8e06d6ee None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:56.593863 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1426c89-bce7-4633-905a-c56b4eb8b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:56.594533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1426c89-bce7-4633-905a-c56b4eb8b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:56.594816 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1426c89-bce7-4633-905a-c56b4eb8b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:56.595089 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1426c89-bce7-4633-905a-c56b4eb8b5b1 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:56.595924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1426c89-bce7-4633-905a-c56b4eb8b5b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:56.596226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1426c89-bce7-4633-905a-c56b4eb8b5b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:56.597750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1426c89-bce7-4633-905a-c56b4eb8b5b1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:56.613532 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:56.617818 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 331/650] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jul 21 22:16:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:56.623291 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1426c89-bce7-4633-905a-c56b4eb8b5b1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:56.679625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:56.708527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec9b81-98e4-4aa4-a3a8-2ded8e06d6ee None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:56.746057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794ad35-e126-40f9-bcd8-473dc1e68b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:56.746861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794ad35-e126-40f9-bcd8-473dc1e68b1f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:56.747145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794ad35-e126-40f9-bcd8-473dc1e68b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:56.747426 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794ad35-e126-40f9-bcd8-473dc1e68b1f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:56.755738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794ad35-e126-40f9-bcd8-473dc1e68b1f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:56.757222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794ad35-e126-40f9-bcd8-473dc1e68b1f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:56.758660 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1426c89-bce7-4633-905a-c56b4eb8b5b1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-c794ad35-e126-40f9-bcd8-473dc1e68b1f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:16:56.772637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:56.773626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:56.774555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:56.774555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:56.774555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:16:56.774555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:16:56.774555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:16:56.774555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:16:56.774555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:16:56.774555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:16:56.774555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:16:56.774555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:56.778749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 320/651] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:56.779583 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794ad35-e126-40f9-bcd8-473dc1e68b1f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:56.800088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eecf46-3530-4e69-99f0-ba62c60b9601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:56.800892 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eecf46-3530-4e69-99f0-ba62c60b9601 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:56.801712 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eecf46-3530-4e69-99f0-ba62c60b9601 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:56.802000 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eecf46-3530-4e69-99f0-ba62c60b9601 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:56.817367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eecf46-3530-4e69-99f0-ba62c60b9601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-f0eecf46-3530-4e69-99f0-ba62c60b9601 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:56.827817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:56.829560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:56.831545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:56.831545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:56.831545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:56.831545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:56.831545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:56.831545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:56.831545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:56.831545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:56.831545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:56.831545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:56.831545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:56.831545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:56.831545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 332/652] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:56.831545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eecf46-3530-4e69-99f0-ba62c60b9601 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:56.889764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794ad35-e126-40f9-bcd8-473dc1e68b1f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:56.908173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:56.927300 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f3eeb-6fbd-49e6-9e38-a04de232b1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:56.927962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f3eeb-6fbd-49e6-9e38-a04de232b1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:56.928250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f3eeb-6fbd-49e6-9e38-a04de232b1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:56.928533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f3eeb-6fbd-49e6-9e38-a04de232b1f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:56.940018 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:56.970825 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eecf46-3530-4e69-99f0-ba62c60b9601 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:57.003633 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f3eeb-6fbd-49e6-9e38-a04de232b1f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:57.005150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f3eeb-6fbd-49e6-9e38-a04de232b1f8 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:57.017786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d1890-1fac-4fca-aca7-e1504a9d2094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:57.018961 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d1890-1fac-4fca-aca7-e1504a9d2094 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:57.019395 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d1890-1fac-4fca-aca7-e1504a9d2094 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:57.020077 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d1890-1fac-4fca-aca7-e1504a9d2094 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:57.021590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d1890-1fac-4fca-aca7-e1504a9d2094 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:57.022327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d1890-1fac-4fca-aca7-e1504a9d2094 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:57.024537 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d1890-1fac-4fca-aca7-e1504a9d2094 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:57.051731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 333/653] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jul 21 22:16:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:57.052829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d1890-1fac-4fca-aca7-e1504a9d2094 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:57.136323 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 321/654] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:57.136323 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f3eeb-6fbd-49e6-9e38-a04de232b1f8 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:57.181922 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:57.203156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d1890-1fac-4fca-aca7-e1504a9d2094 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:57.227844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:57.245546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f3eeb-6fbd-49e6-9e38-a04de232b1f8 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:57.251703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bf81e-c22d-4529-93fc-d7e72f4422a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:57.252604 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bf81e-c22d-4529-93fc-d7e72f4422a9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:57.253576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bf81e-c22d-4529-93fc-d7e72f4422a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:57.254063 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bf81e-c22d-4529-93fc-d7e72f4422a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:57.254993 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bf81e-c22d-4529-93fc-d7e72f4422a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:57.255488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bf81e-c22d-4529-93fc-d7e72f4422a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:57.257572 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bf81e-c22d-4529-93fc-d7e72f4422a9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:57.268830 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 334/655] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:16:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:57.270033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bf81e-c22d-4529-93fc-d7e72f4422a9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:57.294200 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7aee4-bcb0-4fed-9147-53bd25eb28fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:57.294856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7aee4-bcb0-4fed-9147-53bd25eb28fe None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:57.295142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7aee4-bcb0-4fed-9147-53bd25eb28fe None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:57.295419 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7aee4-bcb0-4fed-9147-53bd25eb28fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:57.384073 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7aee4-bcb0-4fed-9147-53bd25eb28fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:57.386128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7aee4-bcb0-4fed-9147-53bd25eb28fe None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:57.393960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bf81e-c22d-4529-93fc-d7e72f4422a9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:57.432279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:57.439351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b2a90-b1e4-4bb7-81f2-ac7e9dd8490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:57.440403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b2a90-b1e4-4bb7-81f2-ac7e9dd8490a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:57.440894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b2a90-b1e4-4bb7-81f2-ac7e9dd8490a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:57.441486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b2a90-b1e4-4bb7-81f2-ac7e9dd8490a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:57.453692 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b2a90-b1e4-4bb7-81f2-ac7e9dd8490a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:57.455403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b2a90-b1e4-4bb7-81f2-ac7e9dd8490a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:57.472813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3b6b2a90-b1e4-4bb7-81f2-ac7e9dd8490a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:57.472813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:57.472813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:57.472813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:57.472813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:57.472813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:57.472813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:57.472813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:57.472813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:57.472813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:57.472813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:57.472813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:57.472813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:57.472813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:57.472813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:57.473724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:57.474595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:57.474595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:57.474595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:57.474595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:57.481042 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 335/656] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:57.482080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b2a90-b1e4-4bb7-81f2-ac7e9dd8490a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:57.501319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 322/657] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:57.502208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7aee4-bcb0-4fed-9147-53bd25eb28fe None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:57.516207 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:57.587978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b2a90-b1e4-4bb7-81f2-ac7e9dd8490a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:57.608591 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7aee4-bcb0-4fed-9147-53bd25eb28fe None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:57.623812 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd5b9d-f9c5-4863-aac8-1ed389454735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:57.624955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd5b9d-f9c5-4863-aac8-1ed389454735 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:57.625437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd5b9d-f9c5-4863-aac8-1ed389454735 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:57.625909 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd5b9d-f9c5-4863-aac8-1ed389454735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:57.637590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd5b9d-f9c5-4863-aac8-1ed389454735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:57.639303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd5b9d-f9c5-4863-aac8-1ed389454735 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:57.645558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8b56d-43a8-4d59-9f09-2cb41566c9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:57.646227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8b56d-43a8-4d59-9f09-2cb41566c9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:57.646518 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8b56d-43a8-4d59-9f09-2cb41566c9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:57.646797 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8b56d-43a8-4d59-9f09-2cb41566c9f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:57.647759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8b56d-43a8-4d59-9f09-2cb41566c9f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:57.647869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8b56d-43a8-4d59-9f09-2cb41566c9f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:57.649340 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8b56d-43a8-4d59-9f09-2cb41566c9f7 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:57.658695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:57.659421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-05dd5b9d-f9c5-4863-aac8-1ed389454735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:57.659421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:57.659421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:57.659421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:57.659421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:57.659421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:57.659421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:57.659421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:57.659421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:57.659421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:57.659421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:57.659421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:57.659421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:57.659421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:57.659421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:57.660264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:57.661436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:57.661436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:57.661436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:57.661436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:57.663467 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 336/658] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:57.664532 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd5b9d-f9c5-4863-aac8-1ed389454735 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:57.668990 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 323/659] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:57.668990 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8b56d-43a8-4d59-9f09-2cb41566c9f7 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:57.758747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:57.776645 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd5b9d-f9c5-4863-aac8-1ed389454735 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:57.780122 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8b56d-43a8-4d59-9f09-2cb41566c9f7 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:57.813047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb133f-05b8-4dac-a861-215e0299377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:57.814105 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb133f-05b8-4dac-a861-215e0299377c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:57.814540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb133f-05b8-4dac-a861-215e0299377c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:57.814963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb133f-05b8-4dac-a861-215e0299377c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:57.820385 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb02383-29d1-4ad3-88c8-0d3253534bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:57.821211 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb02383-29d1-4ad3-88c8-0d3253534bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:57.821598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb02383-29d1-4ad3-88c8-0d3253534bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:57.821991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb02383-29d1-4ad3-88c8-0d3253534bf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:57.822878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb02383-29d1-4ad3-88c8-0d3253534bf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:57.823287 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb02383-29d1-4ad3-88c8-0d3253534bf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:57.824870 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb02383-29d1-4ad3-88c8-0d3253534bf6 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:57.828372 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb133f-05b8-4dac-a861-215e0299377c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:57.830025 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb133f-05b8-4dac-a861-215e0299377c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:57.839287 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 324/660] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:57.840293 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb02383-29d1-4ad3-88c8-0d3253534bf6 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:57.847774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-0cfb133f-05b8-4dac-a861-215e0299377c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:57.847774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:57.847774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:57.847774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:57.847774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:57.847774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:57.847774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:57.847774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:57.847774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:57.847774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:57.847774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:57.847774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:57.847774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:57.847774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:57.847774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:57.848824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:57.849916 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:57.849916 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:57.849916 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:57.849916 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:57.851697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 337/661] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:57.852590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb133f-05b8-4dac-a861-215e0299377c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:57.913424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:57.955040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb133f-05b8-4dac-a861-215e0299377c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:57.960871 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb02383-29d1-4ad3-88c8-0d3253534bf6 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:57.989158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6884a2-b6bd-4efd-9c9e-f9597bb0c739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:57.990186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6884a2-b6bd-4efd-9c9e-f9597bb0c739 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:57.990609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6884a2-b6bd-4efd-9c9e-f9597bb0c739 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:57.991043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6884a2-b6bd-4efd-9c9e-f9597bb0c739 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:57.993925 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:58.000443 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6884a2-b6bd-4efd-9c9e-f9597bb0c739 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:58.002585 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6884a2-b6bd-4efd-9c9e-f9597bb0c739 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:58.002772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ae347-c484-4605-b87d-c33b0d07cccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:58.003767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ae347-c484-4605-b87d-c33b0d07cccb None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:58.004196 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ae347-c484-4605-b87d-c33b0d07cccb None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:58.004727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ae347-c484-4605-b87d-c33b0d07cccb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:58.012682 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ae347-c484-4605-b87d-c33b0d07cccb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:58.014296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ae347-c484-4605-b87d-c33b0d07cccb None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ad6884a2-b6bd-4efd-9c9e-f9597bb0c739 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:16:58.017684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:58.018884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:58.020027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:58.020027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:58.020027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:16:58.020027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:16:58.020027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:16:58.020027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:16:58.020027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:16:58.020027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:16:58.020027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 22:16:58.020027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:58.021813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 338/662] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:58.022670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6884a2-b6bd-4efd-9c9e-f9597bb0c739 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:58.033653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-601ae347-c484-4605-b87d-c33b0d07cccb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:58.033653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:58.033653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:58.033653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:58.033653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:58.033653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:58.033653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:58.033653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:58.033653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:58.033653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:58.033653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:58.033653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:58.033653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:16:58.033653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:16:58.033653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:58.034649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:58.035692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:16:58.035692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:16:58.035692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:16:58.035692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:16:58.035692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:16:58.035692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:16:58.035692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:58.035692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:58.038106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 325/663] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:58.039118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ae347-c484-4605-b87d-c33b0d07cccb None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:58.141602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6884a2-b6bd-4efd-9c9e-f9597bb0c739 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:58.148309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ae347-c484-4605-b87d-c33b0d07cccb None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:58.169795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:58.178267 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f3e4b-83c4-4b9b-9435-fee8b8f2b05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:58.178945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f3e4b-83c4-4b9b-9435-fee8b8f2b05e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:58.179227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f3e4b-83c4-4b9b-9435-fee8b8f2b05e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:58.179504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f3e4b-83c4-4b9b-9435-fee8b8f2b05e None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:58.180230 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f3e4b-83c4-4b9b-9435-fee8b8f2b05e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:58.180536 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f3e4b-83c4-4b9b-9435-fee8b8f2b05e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:58.182582 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f3e4b-83c4-4b9b-9435-fee8b8f2b05e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:58.187175 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc9e36-d03c-4541-9835-48c47a129f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:58.187854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc9e36-d03c-4541-9835-48c47a129f69 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:58.188147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc9e36-d03c-4541-9835-48c47a129f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:58.188428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc9e36-d03c-4541-9835-48c47a129f69 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:58.189299 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc9e36-d03c-4541-9835-48c47a129f69 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:58.190092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc9e36-d03c-4541-9835-48c47a129f69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:58.191959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc9e36-d03c-4541-9835-48c47a129f69 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:58.199613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 339/664] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:58.199613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd754ad-c89d-4554-95f2-6c785fef61b6 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:58.199613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd754ad-c89d-4554-95f2-6c785fef61b6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:58.199613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd754ad-c89d-4554-95f2-6c785fef61b6 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:58.199613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 340/665] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:58.199613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd754ad-c89d-4554-95f2-6c785fef61b6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:58.221189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 326/666] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Jul 21 22:16:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:58.221189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc9e36-d03c-4541-9835-48c47a129f69 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:58.265008 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:58.313424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd754ad-c89d-4554-95f2-6c785fef61b6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:58.320495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc9e36-d03c-4541-9835-48c47a129f69 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:58.349676 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ecd61-94fa-4dad-b595-658d450620a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:58.350463 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ecd61-94fa-4dad-b595-658d450620a4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:58.350756 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ecd61-94fa-4dad-b595-658d450620a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:58.351035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ecd61-94fa-4dad-b595-658d450620a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:58.351877 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ecd61-94fa-4dad-b595-658d450620a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:58.352192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ecd61-94fa-4dad-b595-658d450620a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:58.354307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ecd61-94fa-4dad-b595-658d450620a4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:58.355629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff6f16-683b-4b1c-8d63-0e4e4001d6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:58.356428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff6f16-683b-4b1c-8d63-0e4e4001d6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:58.356713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff6f16-683b-4b1c-8d63-0e4e4001d6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:58.357028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff6f16-683b-4b1c-8d63-0e4e4001d6b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:58.363786 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff6f16-683b-4b1c-8d63-0e4e4001d6b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:58.365261 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff6f16-683b-4b1c-8d63-0e4e4001d6b3 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:58.372189 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 341/667] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:58.373983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0d41e-59c0-45df-9041-caef89ffa0d7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:58.374501 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0d41e-59c0-45df-9041-caef89ffa0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:58.374995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0d41e-59c0-45df-9041-caef89ffa0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:58.379266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-bbff6f16-683b-4b1c-8d63-0e4e4001d6b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:58.379266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:58.379266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:58.379266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:58.379266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:58.379266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:58.379266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:58.379266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:58.379266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:58.379266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:58.379266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:58.379266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:58.379266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:16:58.379266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:16:58.379266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:58.380218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:58.381184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:16:58.381184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:16:58.381184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:16:58.381184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:16:58.381184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:16:58.381184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:16:58.381184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:58.381184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:58.381184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 327/668] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:58.381749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff6f16-683b-4b1c-8d63-0e4e4001d6b3 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:58.397105 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7ad0d41e-59c0-45df-9041-caef89ffa0d7 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:58.398293 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7ad0d41e-59c0-45df-9041-caef89ffa0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:58.427515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:58.469499 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 342/669] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:58.470306 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0d41e-59c0-45df-9041-caef89ffa0d7 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:58.502673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff6f16-683b-4b1c-8d63-0e4e4001d6b3 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:58.518662 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:58.540426 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa41ab7-5888-4b07-81a8-e1c1cfc637fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:58.541942 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa41ab7-5888-4b07-81a8-e1c1cfc637fe None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:58.542466 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa41ab7-5888-4b07-81a8-e1c1cfc637fe None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:58.543026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa41ab7-5888-4b07-81a8-e1c1cfc637fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:58.572904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0d41e-59c0-45df-9041-caef89ffa0d7 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:58.610491 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c5c2b-d95c-4bb0-bf4e-552640ed7c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:58.611177 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c5c2b-d95c-4bb0-bf4e-552640ed7c68 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:58.611430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c5c2b-d95c-4bb0-bf4e-552640ed7c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:58.611711 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c5c2b-d95c-4bb0-bf4e-552640ed7c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:58.612533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c5c2b-d95c-4bb0-bf4e-552640ed7c68 None admin] RBAC: Adding query filter params (role.id=21cd8dfe95a341df92f26899aaae6604, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=aefb0fe4d09b451a861510508bb9cf1e) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:58.612853 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c5c2b-d95c-4bb0-bf4e-552640ed7c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:58.614319 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c5c2b-d95c-4bb0-bf4e-552640ed7c68 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:58.619194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa41ab7-5888-4b07-81a8-e1c1cfc637fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:58.620195 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 343/670] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:58 2022] GET /identity/v3/role_assignments?user.id=aefb0fe4d09b451a861510508bb9cf1e&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=21cd8dfe95a341df92f26899aaae6604 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:58.620994 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c5c2b-d95c-4bb0-bf4e-552640ed7c68 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:58.621420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa41ab7-5888-4b07-81a8-e1c1cfc637fe None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:58.669283 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:58.738608 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 328/671] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:16:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:16:58.739862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa41ab7-5888-4b07-81a8-e1c1cfc637fe None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:58.770029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c5c2b-d95c-4bb0-bf4e-552640ed7c68 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:58.782914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:58.812878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d65ae-8f70-4a83-a2af-31bdd1b54b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:58.813799 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d65ae-8f70-4a83-a2af-31bdd1b54b72 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:58.814221 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d65ae-8f70-4a83-a2af-31bdd1b54b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:58.814497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d65ae-8f70-4a83-a2af-31bdd1b54b72 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:58.815280 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d65ae-8f70-4a83-a2af-31bdd1b54b72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:58.815583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d65ae-8f70-4a83-a2af-31bdd1b54b72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:58.817084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d65ae-8f70-4a83-a2af-31bdd1b54b72 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:58.831239 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 344/672] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:58.833264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf77dc-06a7-480c-8d53-6f33810ac31d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:58.833559 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf77dc-06a7-480c-8d53-6f33810ac31d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:58.833841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf77dc-06a7-480c-8d53-6f33810ac31d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:58.835087 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 345/673] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:16:58.835839 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf77dc-06a7-480c-8d53-6f33810ac31d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:58.866390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa41ab7-5888-4b07-81a8-e1c1cfc637fe None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:58.903141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5193a4-eeec-4ff4-b006-9ee78f56f8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:58.904227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5193a4-eeec-4ff4-b006-9ee78f56f8cf None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:58.904673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5193a4-eeec-4ff4-b006-9ee78f56f8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:58.904974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5193a4-eeec-4ff4-b006-9ee78f56f8cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:58.912254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:58.917041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5193a4-eeec-4ff4-b006-9ee78f56f8cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-4c5193a4-eeec-4ff4-b006-9ee78f56f8cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:58.924862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:58.925893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:58.926749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:58.926749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:58.926749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:58.926749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:58.926749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:58.926749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:58.926749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:58.926749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:58.926749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:58.926749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:58.926749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:16:58.926749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:58.926749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 329/674] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:16:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:58.927439 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5193a4-eeec-4ff4-b006-9ee78f56f8cf None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:58.961418 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf77dc-06a7-480c-8d53-6f33810ac31d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:58.999173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dde8a-b267-4157-873c-0e43f42983c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:59.000065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dde8a-b267-4157-873c-0e43f42983c0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:59.000411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dde8a-b267-4157-873c-0e43f42983c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:59.000689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dde8a-b267-4157-873c-0e43f42983c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:59.013108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91dde8a-b267-4157-873c-0e43f42983c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:59.014548 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91dde8a-b267-4157-873c-0e43f42983c0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:59.032318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c91dde8a-b267-4157-873c-0e43f42983c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:59.032318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:59.032318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:59.032318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:59.032318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:59.032318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:59.032318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:59.032318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:59.032318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:59.032318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:59.032318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:59.032318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:59.032318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:59.032318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:59.032318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:59.033246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:59.034147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:59.034147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:59.034147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:59.034147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:59.034147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 346/675] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:59.034942 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441aedf-a23b-453f-8ee8-0109bfeadf79 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:59.035208 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441aedf-a23b-453f-8ee8-0109bfeadf79 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:59.035485 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441aedf-a23b-453f-8ee8-0109bfeadf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:59.039846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5193a4-eeec-4ff4-b006-9ee78f56f8cf None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:59.052340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a441aedf-a23b-453f-8ee8-0109bfeadf79 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:16:59.053534 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a441aedf-a23b-453f-8ee8-0109bfeadf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:16:59.076112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:59.080545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8d2bd-24ee-44a3-a590-936fb0419f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:59.081241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8d2bd-24ee-44a3-a590-936fb0419f29 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:59.081523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8d2bd-24ee-44a3-a590-936fb0419f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:59.081808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8d2bd-24ee-44a3-a590-936fb0419f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:59.082643 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8d2bd-24ee-44a3-a590-936fb0419f29 None admin] RBAC: Adding query filter params (role.id=21cd8dfe95a341df92f26899aaae6604, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=de7ad1ebf93b4e1db64e3ccf72fa54b5) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:59.082952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8d2bd-24ee-44a3-a590-936fb0419f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:59.084379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8d2bd-24ee-44a3-a590-936fb0419f29 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:59.090316 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 330/676] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:16:58 2022] GET /identity/v3/role_assignments?user.id=de7ad1ebf93b4e1db64e3ccf72fa54b5&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=21cd8dfe95a341df92f26899aaae6604 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:59.091088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8d2bd-24ee-44a3-a590-936fb0419f29 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:59.153140 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 347/677] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:16:59.153140 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441aedf-a23b-453f-8ee8-0109bfeadf79 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:59.193178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:59.247798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8d2bd-24ee-44a3-a590-936fb0419f29 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:59.275073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441aedf-a23b-453f-8ee8-0109bfeadf79 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:59.293245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10014320-b6bc-4e1d-b66f-8ccdf5824f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:59.293931 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10014320-b6bc-4e1d-b66f-8ccdf5824f6c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:59.294291 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10014320-b6bc-4e1d-b66f-8ccdf5824f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:59.294643 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10014320-b6bc-4e1d-b66f-8ccdf5824f6c None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:59.295466 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10014320-b6bc-4e1d-b66f-8ccdf5824f6c None admin] RBAC: Adding query filter params (name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:59.295779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10014320-b6bc-4e1d-b66f-8ccdf5824f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:59.298082 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10014320-b6bc-4e1d-b66f-8ccdf5824f6c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:59.308954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 331/678] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:16:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:59.309763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10014320-b6bc-4e1d-b66f-8ccdf5824f6c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:59.324170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bef3b-47a1-4ca2-b8f6-0d66a7c7255a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:59.325838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bef3b-47a1-4ca2-b8f6-0d66a7c7255a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:59.325838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bef3b-47a1-4ca2-b8f6-0d66a7c7255a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:59.326117 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bef3b-47a1-4ca2-b8f6-0d66a7c7255a None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:59.327616 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bef3b-47a1-4ca2-b8f6-0d66a7c7255a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:59.327616 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bef3b-47a1-4ca2-b8f6-0d66a7c7255a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:59.328634 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bef3b-47a1-4ca2-b8f6-0d66a7c7255a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:59.342376 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 348/679] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:59.342677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bef3b-47a1-4ca2-b8f6-0d66a7c7255a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:59.362786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:59.438735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10014320-b6bc-4e1d-b66f-8ccdf5824f6c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:59.463210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:59.477915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeec459-68ea-41e5-933e-1b12526fdbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:59.479313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec459-68ea-41e5-933e-1b12526fdbeb None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:59.479660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec459-68ea-41e5-933e-1b12526fdbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:59.480003 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec459-68ea-41e5-933e-1b12526fdbeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:59.485824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bef3b-47a1-4ca2-b8f6-0d66a7c7255a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:59.490792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeec459-68ea-41e5-933e-1b12526fdbeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-ddeec459-68ea-41e5-933e-1b12526fdbeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:16:59.499332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:59.500294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:59.501150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:59.501150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:59.501150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:59.501150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:59.501150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:16:59.501150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:16:59.501150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:16:59.501150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:16:59.501150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:16:59.501150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:16:59.501150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:16:59.501150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:59.505217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 332/680] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:16:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:59.506057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeec459-68ea-41e5-933e-1b12526fdbeb None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:59.529851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1c937-3864-4f1c-863f-0f8c2c6fc4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:59.530911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1c937-3864-4f1c-863f-0f8c2c6fc4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:59.531194 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1c937-3864-4f1c-863f-0f8c2c6fc4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:59.531716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1c937-3864-4f1c-863f-0f8c2c6fc4f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:59.546591 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1c937-3864-4f1c-863f-0f8c2c6fc4f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:59.548081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1c937-3864-4f1c-863f-0f8c2c6fc4f8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:59.572447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-36c1c937-3864-4f1c-863f-0f8c2c6fc4f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:59.572447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:59.572447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:59.572447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:59.572447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:59.572447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:59.572447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:59.572447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:59.572447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:59.572447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:59.572447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:59.572447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:59.572447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:16:59.572447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:16:59.572447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:59.574489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:59.576697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:16:59.576697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:16:59.576697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:16:59.576697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:16:59.581036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 349/681] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:59.581036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1c937-3864-4f1c-863f-0f8c2c6fc4f8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:59.615382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeec459-68ea-41e5-933e-1b12526fdbeb None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:59.650891 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be3213-1f7c-4cad-94f2-48c83eb2741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:59.651973 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be3213-1f7c-4cad-94f2-48c83eb2741a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:59.652421 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be3213-1f7c-4cad-94f2-48c83eb2741a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:59.653103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be3213-1f7c-4cad-94f2-48c83eb2741a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:59.660113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be3213-1f7c-4cad-94f2-48c83eb2741a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:59.661300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:59.662251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be3213-1f7c-4cad-94f2-48c83eb2741a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:59.679878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-b6be3213-1f7c-4cad-94f2-48c83eb2741a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:59.679878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:16:59.679878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:16:59.679878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:16:59.679878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:16:59.679878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:16:59.679878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:16:59.679878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:16:59.679878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:16:59.679878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:16:59.679878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:16:59.679878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:16:59.679878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:16:59.679878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:16:59.679878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:16:59.680815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:16:59.682724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:16:59.682724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:16:59.682724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:16:59.682724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:16:59.682724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:16:59.682724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:16:59.682724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:16:59.682724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:16:59.684910 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 333/682] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:16:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:16:59.686018 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be3213-1f7c-4cad-94f2-48c83eb2741a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:59.703027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1c937-3864-4f1c-863f-0f8c2c6fc4f8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:59.734323 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:59.745280 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62551796-8289-4377-903c-470353739c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:59.746098 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62551796-8289-4377-903c-470353739c2e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:59.746385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62551796-8289-4377-903c-470353739c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:59.746665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62551796-8289-4377-903c-470353739c2e None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:59.747407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62551796-8289-4377-903c-470353739c2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:59.747717 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62551796-8289-4377-903c-470353739c2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:59.749612 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62551796-8289-4377-903c-470353739c2e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:59.764615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 350/683] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:16:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:59.764615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62551796-8289-4377-903c-470353739c2e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:59.806032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be3213-1f7c-4cad-94f2-48c83eb2741a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:59.843801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67150f-d62e-4648-acd0-e3e04e78d52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:59.844483 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67150f-d62e-4648-acd0-e3e04e78d52b None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:59.844766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67150f-d62e-4648-acd0-e3e04e78d52b None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:59.845091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67150f-d62e-4648-acd0-e3e04e78d52b None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:59.845835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67150f-d62e-4648-acd0-e3e04e78d52b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:59.846141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67150f-d62e-4648-acd0-e3e04e78d52b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:59.847524 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67150f-d62e-4648-acd0-e3e04e78d52b None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:59.860761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 334/684] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:59.861689 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67150f-d62e-4648-acd0-e3e04e78d52b None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:59.894494 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62551796-8289-4377-903c-470353739c2e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:59.921996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:16:59.932321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114dcd6-b99c-41b8-b119-798544a4eeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:16:59.933025 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114dcd6-b99c-41b8-b119-798544a4eeca None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:16:59.933309 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114dcd6-b99c-41b8-b119-798544a4eeca None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:16:59.933596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114dcd6-b99c-41b8-b119-798544a4eeca None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:16:59.934487 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114dcd6-b99c-41b8-b119-798544a4eeca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:16:59.934740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114dcd6-b99c-41b8-b119-798544a4eeca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:16:59.936172 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114dcd6-b99c-41b8-b119-798544a4eeca None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:16:59.949369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 351/685] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:16:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:16:59.950241 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114dcd6-b99c-41b8-b119-798544a4eeca None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:16:59.993419 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67150f-d62e-4648-acd0-e3e04e78d52b None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:16:59.997626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:00.040273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d8679-5224-40f2-9d1d-5aab24dacd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:00.041968 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d8679-5224-40f2-9d1d-5aab24dacd37 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:00.042432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d8679-5224-40f2-9d1d-5aab24dacd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:00.042853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d8679-5224-40f2-9d1d-5aab24dacd37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:00.057091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d8679-5224-40f2-9d1d-5aab24dacd37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:00.057543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114dcd6-b99c-41b8-b119-798544a4eeca None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:00.059151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d8679-5224-40f2-9d1d-5aab24dacd37 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:00.082459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-3e4d8679-5224-40f2-9d1d-5aab24dacd37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:00.082459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:00.082459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:00.082459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:00.082459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:00.082459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:00.082459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:00.082459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:00.082459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:00.082459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:00.082459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:00.082459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:00.082459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:00.082459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:00.082459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:00.083447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:00.084535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:00.084535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:00.084535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:00.084535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:00.086786 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 335/686] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:00.089024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d8679-5224-40f2-9d1d-5aab24dacd37 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:00.099412 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d2aac-5ac1-4dd4-90f3-df57848addf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:00.100421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d2aac-5ac1-4dd4-90f3-df57848addf0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:00.100803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d2aac-5ac1-4dd4-90f3-df57848addf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:00.101215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d2aac-5ac1-4dd4-90f3-df57848addf0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:00.111042 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d2aac-5ac1-4dd4-90f3-df57848addf0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:00.113393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d2aac-5ac1-4dd4-90f3-df57848addf0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-252d2aac-5ac1-4dd4-90f3-df57848addf0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:00.133684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:00.135307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:00.136464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:00.136464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:00.136464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:00.136464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:00.136464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:00.136464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:00.136464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:00.136464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:00.136464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:17:00.136464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:00.143106 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 352/687] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:16:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:00.144209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d2aac-5ac1-4dd4-90f3-df57848addf0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:00.208142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:00.225247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d8679-5224-40f2-9d1d-5aab24dacd37 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:00.267391 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d2aac-5ac1-4dd4-90f3-df57848addf0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:00.272771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085142ab-0f2a-4c30-a8d2-bc01a83ee63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:00.273695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085142ab-0f2a-4c30-a8d2-bc01a83ee63e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:00.274208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085142ab-0f2a-4c30-a8d2-bc01a83ee63e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:00.274715 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085142ab-0f2a-4c30-a8d2-bc01a83ee63e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:00.276317 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085142ab-0f2a-4c30-a8d2-bc01a83ee63e None admin] RBAC: Adding query filter params (role.id=21cd8dfe95a341df92f26899aaae6604, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=23aaef489c0948fe8bc10acb8e76c84a) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:00.277144 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085142ab-0f2a-4c30-a8d2-bc01a83ee63e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:00.278820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085142ab-0f2a-4c30-a8d2-bc01a83ee63e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:00.287623 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 336/688] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:17:00 2022] GET /identity/v3/role_assignments?user.id=23aaef489c0948fe8bc10acb8e76c84a&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=21cd8dfe95a341df92f26899aaae6604 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:00.288948 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085142ab-0f2a-4c30-a8d2-bc01a83ee63e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:00.317505 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:00.357125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5156cf-34db-47ad-a823-9cae4c8911d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:00.357820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5156cf-34db-47ad-a823-9cae4c8911d9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:00.358107 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5156cf-34db-47ad-a823-9cae4c8911d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:00.358391 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5156cf-34db-47ad-a823-9cae4c8911d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:00.359151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5156cf-34db-47ad-a823-9cae4c8911d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:00.359465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5156cf-34db-47ad-a823-9cae4c8911d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:00.361350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5156cf-34db-47ad-a823-9cae4c8911d9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:00.395620 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 353/689] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:00.400796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5156cf-34db-47ad-a823-9cae4c8911d9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:00.426717 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085142ab-0f2a-4c30-a8d2-bc01a83ee63e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:00.471657 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478132b-f571-4fee-a824-a618a9668cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:00.473760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478132b-f571-4fee-a824-a618a9668cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:00.474041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478132b-f571-4fee-a824-a618a9668cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:00.474313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478132b-f571-4fee-a824-a618a9668cb1 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:00.475158 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478132b-f571-4fee-a824-a618a9668cb1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:00.475467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478132b-f571-4fee-a824-a618a9668cb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:00.476903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478132b-f571-4fee-a824-a618a9668cb1 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:00.509435 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 337/690] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jul 21 22:17:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:00.516409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478132b-f571-4fee-a824-a618a9668cb1 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:00.573155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5156cf-34db-47ad-a823-9cae4c8911d9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:00.584130 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:00.609609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:00.622960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff52aa1-979e-47d3-9d84-4c406deb6eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:00.623761 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff52aa1-979e-47d3-9d84-4c406deb6eed None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:00.624040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff52aa1-979e-47d3-9d84-4c406deb6eed None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:00.624317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff52aa1-979e-47d3-9d84-4c406deb6eed None admin] PATH_INFO: `/v3/users/nova` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:00.633054 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478132b-f571-4fee-a824-a618a9668cb1 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:00.634376 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff52aa1-979e-47d3-9d84-4c406deb6eed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:00.637087 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff52aa1-979e-47d3-9d84-4c406deb6eed None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-5ff52aa1-979e-47d3-9d84-4c406deb6eed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:00.659829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:00.660822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:00.662287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:00.662287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:00.662287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:00.662287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:00.662287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:00.662287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:00.662287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:00.662287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:00.662287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:17:00.662287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:00.662287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 354/691] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jul 21 22:17:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:00.672954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff52aa1-979e-47d3-9d84-4c406deb6eed None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:00.682678 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df867f0f-8845-41d3-97cd-ed1c0436e9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:00.683722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df867f0f-8845-41d3-97cd-ed1c0436e9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:00.684274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df867f0f-8845-41d3-97cd-ed1c0436e9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:00.684551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df867f0f-8845-41d3-97cd-ed1c0436e9c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:00.765732 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df867f0f-8845-41d3-97cd-ed1c0436e9c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:00.767190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df867f0f-8845-41d3-97cd-ed1c0436e9c5 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:00.795439 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff52aa1-979e-47d3-9d84-4c406deb6eed None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:00.844326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e325de-24c1-445d-9b25-7fff3015826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:00.844917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e325de-24c1-445d-9b25-7fff3015826e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:00.845382 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e325de-24c1-445d-9b25-7fff3015826e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:00.845668 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e325de-24c1-445d-9b25-7fff3015826e None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:00.846504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e325de-24c1-445d-9b25-7fff3015826e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:00.846814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e325de-24c1-445d-9b25-7fff3015826e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:00.848354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e325de-24c1-445d-9b25-7fff3015826e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:00.848783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:00.875597 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 338/692] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:17:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 22:17:00.877090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235cc8-0c3f-4b3f-b311-7610bd624f05 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:00.877452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235cc8-0c3f-4b3f-b311-7610bd624f05 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:00.877861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe235cc8-0c3f-4b3f-b311-7610bd624f05 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:00.879486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 339/693] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:00.880867 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 355/694] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jul 21 22:17:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:00.881636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe235cc8-0c3f-4b3f-b311-7610bd624f05 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:00.887115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4315d-ed3f-41b3-a399-d5c7588c4e5e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:00.887552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4315d-ed3f-41b3-a399-d5c7588c4e5e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:00.887906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4315d-ed3f-41b3-a399-d5c7588c4e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:00.906329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-bdc4315d-ed3f-41b3-a399-d5c7588c4e5e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:00.907613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bdc4315d-ed3f-41b3-a399-d5c7588c4e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:00.926816 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:00.983041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 356/695] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:17:00.984196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4315d-ed3f-41b3-a399-d5c7588c4e5e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:00.993756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe235cc8-0c3f-4b3f-b311-7610bd624f05 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:01.030300 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42382f84-8ed1-45a0-b973-696f37f7f5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:01.031103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42382f84-8ed1-45a0-b973-696f37f7f5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:01.031386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42382f84-8ed1-45a0-b973-696f37f7f5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:01.031660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42382f84-8ed1-45a0-b973-696f37f7f5f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:01.042505 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42382f84-8ed1-45a0-b973-696f37f7f5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:01.044006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42382f84-8ed1-45a0-b973-696f37f7f5f5 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:01.068302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-42382f84-8ed1-45a0-b973-696f37f7f5f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:01.068302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:01.068302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:01.068302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:01.068302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:01.068302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:01.068302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:01.068302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:01.068302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:01.068302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:01.068302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:01.068302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:01.068302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:01.068302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:01.068302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:01.069285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:01.070191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:01.070191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:01.070191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:01.070191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:01.075347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 340/696] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:01.080290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42382f84-8ed1-45a0-b973-696f37f7f5f5 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:01.104328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4315d-ed3f-41b3-a399-d5c7588c4e5e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:01.111910 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:01.144575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49f931-4423-46e9-8386-4e714ef49c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:01.145715 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49f931-4423-46e9-8386-4e714ef49c6f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:01.146278 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49f931-4423-46e9-8386-4e714ef49c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:01.146855 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49f931-4423-46e9-8386-4e714ef49c6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:01.174215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:01.188757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42382f84-8ed1-45a0-b973-696f37f7f5f5 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:01.223097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49f931-4423-46e9-8386-4e714ef49c6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:01.225168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49f931-4423-46e9-8386-4e714ef49c6f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:01.225835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b7721-ae88-4333-8c39-4ca2289be743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:01.226643 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b7721-ae88-4333-8c39-4ca2289be743 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:01.226928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b7721-ae88-4333-8c39-4ca2289be743 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:01.227207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b7721-ae88-4333-8c39-4ca2289be743 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:01.239785 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b7721-ae88-4333-8c39-4ca2289be743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:01.241438 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b7721-ae88-4333-8c39-4ca2289be743 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:01.261693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-250b7721-ae88-4333-8c39-4ca2289be743 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:01.261693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:01.261693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:01.261693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:01.261693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:01.261693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:01.261693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:01.261693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:01.261693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:01.261693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:01.261693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:01.261693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:01.261693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:01.261693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:01.261693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:01.262615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:01.263501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:01.263501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:01.263501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:01.263501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:01.263501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 341/697] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:01.264351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b7721-ae88-4333-8c39-4ca2289be743 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:01.341434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 357/698] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:17:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:17:01.342591 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49f931-4423-46e9-8386-4e714ef49c6f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:01.355936 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:01.376745 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b7721-ae88-4333-8c39-4ca2289be743 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:01.403904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:01.417181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e968581-e2cd-41ae-a6d9-e34db20f9a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:01.417974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e968581-e2cd-41ae-a6d9-e34db20f9a96 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:01.418263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e968581-e2cd-41ae-a6d9-e34db20f9a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:01.418546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e968581-e2cd-41ae-a6d9-e34db20f9a96 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:01.419276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e968581-e2cd-41ae-a6d9-e34db20f9a96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:01.419589 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e968581-e2cd-41ae-a6d9-e34db20f9a96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:01.421189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e968581-e2cd-41ae-a6d9-e34db20f9a96 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:01.438263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 342/699] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:01.439073 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e968581-e2cd-41ae-a6d9-e34db20f9a96 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:01.452062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49f931-4423-46e9-8386-4e714ef49c6f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:01.489299 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e449a-d3f4-4fcd-b275-1c5843e23c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:01.489962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e449a-d3f4-4fcd-b275-1c5843e23c13 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:01.490247 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e449a-d3f4-4fcd-b275-1c5843e23c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:01.490526 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e449a-d3f4-4fcd-b275-1c5843e23c13 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:01.491238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e449a-d3f4-4fcd-b275-1c5843e23c13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:01.491545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e449a-d3f4-4fcd-b275-1c5843e23c13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:01.492905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e449a-d3f4-4fcd-b275-1c5843e23c13 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:01.504570 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 358/700] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:01.506137 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeadf2c-b457-42d6-847f-e31490adaca0 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:01.506427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeadf2c-b457-42d6-847f-e31490adaca0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:01.506706 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeadf2c-b457-42d6-847f-e31490adaca0 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:01.509045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 359/701] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:01.509045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeadf2c-b457-42d6-847f-e31490adaca0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:01.548189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e968581-e2cd-41ae-a6d9-e34db20f9a96 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:01.582162 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023fdf48-bd58-4045-aa07-aa0386bb6d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:01.583060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fdf48-bd58-4045-aa07-aa0386bb6d76 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:01.584066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fdf48-bd58-4045-aa07-aa0386bb6d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:01.584351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fdf48-bd58-4045-aa07-aa0386bb6d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:01.596437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023fdf48-bd58-4045-aa07-aa0386bb6d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:01.597887 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023fdf48-bd58-4045-aa07-aa0386bb6d76 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:01.599629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:01.614374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeadf2c-b457-42d6-847f-e31490adaca0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:01.618270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-023fdf48-bd58-4045-aa07-aa0386bb6d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:01.618270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:01.618270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:01.618270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:01.618270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:01.618270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:01.618270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:01.618270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:01.618270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:01.618270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:01.618270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:01.618270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:01.618270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:01.618270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:01.618270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:01.619231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:01.620135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:01.620135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:01.620135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:01.620135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:01.624079 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 343/702] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:01.624899 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023fdf48-bd58-4045-aa07-aa0386bb6d76 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:01.628988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:01.651795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac1a67-4f0f-4373-99f4-0fda069db590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:01.652590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac1a67-4f0f-4373-99f4-0fda069db590 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:01.653177 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac1a67-4f0f-4373-99f4-0fda069db590 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:01.653453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac1a67-4f0f-4373-99f4-0fda069db590 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:01.660248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac1a67-4f0f-4373-99f4-0fda069db590 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:01.661719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac1a67-4f0f-4373-99f4-0fda069db590 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:01.675713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c4ac1a67-4f0f-4373-99f4-0fda069db590 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:01.675713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:01.675713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:01.675713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:01.675713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:01.675713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:01.675713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:01.675713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:01.675713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:01.675713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:01.675713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:01.675713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:01.675713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:01.675713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:01.675713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:01.676607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:01.677984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:01.677984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:01.677984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:01.677984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:01.677984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:01.677984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:01.677984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:01.677984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:01.677984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 360/703] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:01.678457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fa2bd-baec-42c1-bd5f-2f6fc7081eb6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:01.678457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fa2bd-baec-42c1-bd5f-2f6fc7081eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:01.678579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fa2bd-baec-42c1-bd5f-2f6fc7081eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:01.695327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7d1fa2bd-baec-42c1-bd5f-2f6fc7081eb6 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:01.696511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7d1fa2bd-baec-42c1-bd5f-2f6fc7081eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:01.738397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023fdf48-bd58-4045-aa07-aa0386bb6d76 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:01.768678 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 361/704] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:17:01.769725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fa2bd-baec-42c1-bd5f-2f6fc7081eb6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:01.785234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645f388-0141-43f1-9351-d42367caadca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:01.786328 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645f388-0141-43f1-9351-d42367caadca None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:01.786933 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645f388-0141-43f1-9351-d42367caadca None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:01.787411 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645f388-0141-43f1-9351-d42367caadca None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:01.788317 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645f388-0141-43f1-9351-d42367caadca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:01.790193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645f388-0141-43f1-9351-d42367caadca None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:01.812072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 344/705] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:17:01 2022] POST /identity/v3/users => generated 254 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:17:01.813789 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645f388-0141-43f1-9351-d42367caadca None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:01.885427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fa2bd-baec-42c1-bd5f-2f6fc7081eb6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:01.888993 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:01.890225 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:01.931201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850108d-e4bb-443d-adac-e7ec14db0be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:01.932726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850108d-e4bb-443d-adac-e7ec14db0be0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:01.933141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850108d-e4bb-443d-adac-e7ec14db0be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:01.933594 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850108d-e4bb-443d-adac-e7ec14db0be0 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:01.934560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850108d-e4bb-443d-adac-e7ec14db0be0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:01.935091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850108d-e4bb-443d-adac-e7ec14db0be0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:01.936745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850108d-e4bb-443d-adac-e7ec14db0be0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:01.955197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 362/706] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:01.956272 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850108d-e4bb-443d-adac-e7ec14db0be0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:01.957077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645f388-0141-43f1-9351-d42367caadca None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:02.008258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aea9c7-cc6c-488f-a5a0-45147e480d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:02.009052 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aea9c7-cc6c-488f-a5a0-45147e480d82 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:02.009342 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aea9c7-cc6c-488f-a5a0-45147e480d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:02.009656 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aea9c7-cc6c-488f-a5a0-45147e480d82 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:02.010894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aea9c7-cc6c-488f-a5a0-45147e480d82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:02.012075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aea9c7-cc6c-488f-a5a0-45147e480d82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:02.013193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aea9c7-cc6c-488f-a5a0-45147e480d82 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:02.030907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 345/707] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:02.030907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aea9c7-cc6c-488f-a5a0-45147e480d82 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:02.104120 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850108d-e4bb-443d-adac-e7ec14db0be0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:02.139890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8c1ab-ec9f-46a3-a0c0-de2bd2f4d357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:02.140632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8c1ab-ec9f-46a3-a0c0-de2bd2f4d357 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:02.140913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8c1ab-ec9f-46a3-a0c0-de2bd2f4d357 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:02.141218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8c1ab-ec9f-46a3-a0c0-de2bd2f4d357 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:02.141869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8c1ab-ec9f-46a3-a0c0-de2bd2f4d357 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:02.143362 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8c1ab-ec9f-46a3-a0c0-de2bd2f4d357 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-63d8c1ab-ec9f-46a3-a0c0-de2bd2f4d357 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:02.158546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:02.159772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:02.160786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 363/708] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Jul 21 22:17:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:02.161659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8c1ab-ec9f-46a3-a0c0-de2bd2f4d357 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:02.168011 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aea9c7-cc6c-488f-a5a0-45147e480d82 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:02.182376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:02.198040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:02.216238 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f65a1-1a80-43d0-a9b1-858927b23f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:02.217092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f65a1-1a80-43d0-a9b1-858927b23f0a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:02.217381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f65a1-1a80-43d0-a9b1-858927b23f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:02.217656 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f65a1-1a80-43d0-a9b1-858927b23f0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:02.225507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f65a1-1a80-43d0-a9b1-858927b23f0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:02.227117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f65a1-1a80-43d0-a9b1-858927b23f0a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:02.243381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-9c6f65a1-1a80-43d0-a9b1-858927b23f0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:02.243381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:02.243381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:02.243381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:02.243381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:02.243381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:02.243381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:02.243381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:02.243381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:02.243381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:02.243381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:02.243381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:02.243381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:02.243381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:02.243381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:02.244489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:02.245516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:02.245516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:02.245516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:02.245516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:02.245516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:02.245516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:02.245516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:02.245516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:02.249671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 346/709] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:02.250711 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f65a1-1a80-43d0-a9b1-858927b23f0a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:02.295370 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8c1ab-ec9f-46a3-a0c0-de2bd2f4d357 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:02.342870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99766a-17b4-4e36-b156-d328c25311e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:02.343781 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99766a-17b4-4e36-b156-d328c25311e7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:02.344238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99766a-17b4-4e36-b156-d328c25311e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:02.344675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99766a-17b4-4e36-b156-d328c25311e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:02.346269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99766a-17b4-4e36-b156-d328c25311e7 None admin] RBAC: Adding query filter params (role.id=21cd8dfe95a341df92f26899aaae6604, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=16a38d4a306748aa8f2e72ceb7f629e2) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:02.346862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99766a-17b4-4e36-b156-d328c25311e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:02.348960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99766a-17b4-4e36-b156-d328c25311e7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:02.362434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f65a1-1a80-43d0-a9b1-858927b23f0a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:02.362631 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 364/710] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:17:02 2022] GET /identity/v3/role_assignments?user.id=16a38d4a306748aa8f2e72ceb7f629e2&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=21cd8dfe95a341df92f26899aaae6604 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:02.362631 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99766a-17b4-4e36-b156-d328c25311e7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:02.418505 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ebf48-cbeb-4c23-b009-8e10d21a836f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:02.419448 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ebf48-cbeb-4c23-b009-8e10d21a836f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:02.419829 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ebf48-cbeb-4c23-b009-8e10d21a836f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:02.420206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ebf48-cbeb-4c23-b009-8e10d21a836f None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:02.421115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ebf48-cbeb-4c23-b009-8e10d21a836f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:02.421526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ebf48-cbeb-4c23-b009-8e10d21a836f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:02.423497 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ebf48-cbeb-4c23-b009-8e10d21a836f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:02.429655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 347/711] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jul 21 22:17:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:02.435624 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ebf48-cbeb-4c23-b009-8e10d21a836f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:02.479222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:02.560329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ebf48-cbeb-4c23-b009-8e10d21a836f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:02.595533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:02.604473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99766a-17b4-4e36-b156-d328c25311e7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:02.607083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5571398-6011-4110-bf2d-a0994004febe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:02.608692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5571398-6011-4110-bf2d-a0994004febe None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:02.609154 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5571398-6011-4110-bf2d-a0994004febe None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:02.609557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5571398-6011-4110-bf2d-a0994004febe None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:02.610352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5571398-6011-4110-bf2d-a0994004febe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:02.610728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5571398-6011-4110-bf2d-a0994004febe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:02.613510 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5571398-6011-4110-bf2d-a0994004febe None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:02.620014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 348/712] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jul 21 22:17:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:02.655688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c20bc-9897-4c8d-a178-397365fbf78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:02.656764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c20bc-9897-4c8d-a178-397365fbf78a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:02.657283 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c20bc-9897-4c8d-a178-397365fbf78a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:02.657774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c20bc-9897-4c8d-a178-397365fbf78a None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:02.658833 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c20bc-9897-4c8d-a178-397365fbf78a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:02.659397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c20bc-9897-4c8d-a178-397365fbf78a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:02.661210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c20bc-9897-4c8d-a178-397365fbf78a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:02.675200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 365/713] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:02.680730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5571398-6011-4110-bf2d-a0994004febe None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:02.710232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb037d9-4f4f-49d1-8b67-46e85d830563 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:02.710933 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb037d9-4f4f-49d1-8b67-46e85d830563 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:02.711423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb037d9-4f4f-49d1-8b67-46e85d830563 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:02.713439 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 366/714] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:02.719226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5825ff-a034-4f7e-9185-18ff0e5de65c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:02.719510 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5825ff-a034-4f7e-9185-18ff0e5de65c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:02.719878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5825ff-a034-4f7e-9185-18ff0e5de65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:02.746391 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3c5825ff-a034-4f7e-9185-18ff0e5de65c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:02.748486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3c5825ff-a034-4f7e-9185-18ff0e5de65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:02.801683 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:02.810310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5571398-6011-4110-bf2d-a0994004febe None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:02.847343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 367/715] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:17:02.852969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c752310-a419-4d8f-be37-cdfc60b4f05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:02.852969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c752310-a419-4d8f-be37-cdfc60b4f05a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:02.852969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c752310-a419-4d8f-be37-cdfc60b4f05a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:02.852969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c752310-a419-4d8f-be37-cdfc60b4f05a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:02.853465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c752310-a419-4d8f-be37-cdfc60b4f05a None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=2c04dc3ee4484afaab388cbb306974af) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:02.853465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c752310-a419-4d8f-be37-cdfc60b4f05a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:02.853465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c752310-a419-4d8f-be37-cdfc60b4f05a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:02.859641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 349/716] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:17:02 2022] GET /identity/v3/role_assignments?user.id=2c04dc3ee4484afaab388cbb306974af&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:02.872127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5825ff-a034-4f7e-9185-18ff0e5de65c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:02.961489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:02.982033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5825ff-a034-4f7e-9185-18ff0e5de65c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:03.047069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9b560-9ddd-43cd-a5ac-2f39e76b3df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:03.048257 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9b560-9ddd-43cd-a5ac-2f39e76b3df3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:03.048750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9b560-9ddd-43cd-a5ac-2f39e76b3df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:03.049277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9b560-9ddd-43cd-a5ac-2f39e76b3df3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:03.050199 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9b560-9ddd-43cd-a5ac-2f39e76b3df3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:03.051824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9b560-9ddd-43cd-a5ac-2f39e76b3df3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-dbc9b560-9ddd-43cd-a5ac-2f39e76b3df3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:03.067695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:03.068746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:03.069601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:03.069601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:03.069601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:03.069601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:03.069601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:03.069601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:03.069601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:03.069601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:03.069601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:03.069601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:03.069601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:03.069601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:03.069601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:17:03.069601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:03.072705 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 368/717] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:02 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:03.082057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c752310-a419-4d8f-be37-cdfc60b4f05a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:03.215541 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c752310-a419-4d8f-be37-cdfc60b4f05a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:03.252204 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47685116-77b6-4ccb-8a7d-de80dbde58b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:03.252891 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47685116-77b6-4ccb-8a7d-de80dbde58b9 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:03.253210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47685116-77b6-4ccb-8a7d-de80dbde58b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:03.253493 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47685116-77b6-4ccb-8a7d-de80dbde58b9 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:03.254223 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47685116-77b6-4ccb-8a7d-de80dbde58b9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:03.254531 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47685116-77b6-4ccb-8a7d-de80dbde58b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:03.255955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47685116-77b6-4ccb-8a7d-de80dbde58b9 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:03.261666 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 350/718] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jul 21 22:17:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:03.266953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9b560-9ddd-43cd-a5ac-2f39e76b3df3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:03.408040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9b560-9ddd-43cd-a5ac-2f39e76b3df3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:03.459478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398831b-e5b2-44e0-a36f-2b37fea03648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:03.460514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398831b-e5b2-44e0-a36f-2b37fea03648 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:03.461036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398831b-e5b2-44e0-a36f-2b37fea03648 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:03.461513 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398831b-e5b2-44e0-a36f-2b37fea03648 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:03.462473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398831b-e5b2-44e0-a36f-2b37fea03648 None admin] RBAC: Adding query filter params (type=network) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:03.463505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398831b-e5b2-44e0-a36f-2b37fea03648 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:03.465135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398831b-e5b2-44e0-a36f-2b37fea03648 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:03.477920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 369/719] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jul 21 22:17:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:04.404161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e524641-510f-45bb-8f2b-76f4d1d3cd0f None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:04.404681 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e524641-510f-45bb-8f2b-76f4d1d3cd0f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:04.404681 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e524641-510f-45bb-8f2b-76f4d1d3cd0f None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:04.406185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 351/720] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:04.411073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c547761-62e9-4177-81cc-18e3727ca073 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:04.411484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c547761-62e9-4177-81cc-18e3727ca073 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:04.411668 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c547761-62e9-4177-81cc-18e3727ca073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:04.437945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0c547761-62e9-4177-81cc-18e3727ca073 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:04.439155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0c547761-62e9-4177-81cc-18e3727ca073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:04.442171 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:04.530864 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 370/721] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:17:04.562530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e524641-510f-45bb-8f2b-76f4d1d3cd0f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:04.601955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:04.702630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e524641-510f-45bb-8f2b-76f4d1d3cd0f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:04.740624 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d83f23-60a8-4518-bd5c-c707972390bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:04.741465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d83f23-60a8-4518-bd5c-c707972390bd None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:04.741749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d83f23-60a8-4518-bd5c-c707972390bd None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:04.742025 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d83f23-60a8-4518-bd5c-c707972390bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:04.752430 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d83f23-60a8-4518-bd5c-c707972390bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-10d83f23-60a8-4518-bd5c-c707972390bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:04.760227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:04.761254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:04.762090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:04.762090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:04.762090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:04.762090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:04.762090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:04.762090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:04.762090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:04.762090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:04.762090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:04.762090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:04.762090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:17:04.762090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:04.762090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 352/722] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:17:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:04.770678 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c547761-62e9-4177-81cc-18e3727ca073 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:04.905641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c547761-62e9-4177-81cc-18e3727ca073 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:04.952371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70076e-d89a-41fe-8132-dc346857906c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:04.953130 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70076e-d89a-41fe-8132-dc346857906c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:04.953350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70076e-d89a-41fe-8132-dc346857906c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:04.953628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70076e-d89a-41fe-8132-dc346857906c None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:04.954372 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70076e-d89a-41fe-8132-dc346857906c None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:04.954676 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70076e-d89a-41fe-8132-dc346857906c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:04.956050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70076e-d89a-41fe-8132-dc346857906c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:04.965148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 371/723] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:17:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:04.970545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d83f23-60a8-4518-bd5c-c707972390bd None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:05.096044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a83bf-ae0a-48df-800b-3a6c328f7d05 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:05.096349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a83bf-ae0a-48df-800b-3a6c328f7d05 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:05.096602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a83bf-ae0a-48df-800b-3a6c328f7d05 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:05.098059 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 372/724] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:05.103170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de17355-6863-4596-979c-fdecaac2facc None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:05.103465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de17355-6863-4596-979c-fdecaac2facc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:05.103751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de17355-6863-4596-979c-fdecaac2facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:05.108804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:05.123239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:05.129934 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9de17355-6863-4596-979c-fdecaac2facc None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:05.131267 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9de17355-6863-4596-979c-fdecaac2facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:05.146453 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d83f23-60a8-4518-bd5c-c707972390bd None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:05.193023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecae425-ed4f-44c3-8a56-b13dead986ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:05.193861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecae425-ed4f-44c3-8a56-b13dead986ba None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:05.194145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecae425-ed4f-44c3-8a56-b13dead986ba None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:05.194422 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecae425-ed4f-44c3-8a56-b13dead986ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:05.207740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecae425-ed4f-44c3-8a56-b13dead986ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:05.209148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecae425-ed4f-44c3-8a56-b13dead986ba None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:05.227131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 373/725] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:17:05.228508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd8cf6-cdac-4680-a16e-de3c88e22609 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:05.228800 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd8cf6-cdac-4680-a16e-de3c88e22609 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:05.230384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-aecae425-ed4f-44c3-8a56-b13dead986ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:05.230384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:05.230384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:05.230384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:05.230384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:05.230384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:05.230384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:05.230384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:05.230384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:05.230384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:05.230384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:05.230384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:05.230384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:05.230384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:05.230384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:05.231234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:05.232139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:05.232139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:05.232139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:05.232139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:05.238576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd8cf6-cdac-4680-a16e-de3c88e22609 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:05.238883 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 374/727] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:05.239072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 353/727] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:05.240459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd8cf6-cdac-4680-a16e-de3c88e22609 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:05.244979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0371f-0963-445d-ae2b-daf5da109db4 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:05.245521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0371f-0963-445d-ae2b-daf5da109db4 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:05.246067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0371f-0963-445d-ae2b-daf5da109db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:05.273090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-b3c0371f-0963-445d-ae2b-daf5da109db4 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:05.275795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b3c0371f-0963-445d-ae2b-daf5da109db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:05.364947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 354/728] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 22:17:05.364947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0371f-0963-445d-ae2b-daf5da109db4 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:05.386815 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd8cf6-cdac-4680-a16e-de3c88e22609 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:05.424073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:05.433624 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556035a-7581-40e0-83db-79874271dca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:05.434833 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556035a-7581-40e0-83db-79874271dca7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:05.435328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556035a-7581-40e0-83db-79874271dca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:05.436580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:05.437067 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556035a-7581-40e0-83db-79874271dca7 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:05.439118 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556035a-7581-40e0-83db-79874271dca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:05.439648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556035a-7581-40e0-83db-79874271dca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:05.443061 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556035a-7581-40e0-83db-79874271dca7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:05.458806 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 375/729] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:05.459833 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556035a-7581-40e0-83db-79874271dca7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:05.485229 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0371f-0963-445d-ae2b-daf5da109db4 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:05.524577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e7ee1-1e2b-4edd-89fd-d39f1ecb5b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:05.525751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e7ee1-1e2b-4edd-89fd-d39f1ecb5b6c None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:05.526273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e7ee1-1e2b-4edd-89fd-d39f1ecb5b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:05.526755 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e7ee1-1e2b-4edd-89fd-d39f1ecb5b6c None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:05.527740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e7ee1-1e2b-4edd-89fd-d39f1ecb5b6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:05.529881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e7ee1-1e2b-4edd-89fd-d39f1ecb5b6c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:05.547994 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 355/730] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jul 21 22:17:05 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:17:05.549208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e7ee1-1e2b-4edd-89fd-d39f1ecb5b6c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:05.566197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556035a-7581-40e0-83db-79874271dca7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:05.610881 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c6801-76d4-4c34-a6e9-85ce6c11e324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:05.611787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c6801-76d4-4c34-a6e9-85ce6c11e324 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:05.612058 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c6801-76d4-4c34-a6e9-85ce6c11e324 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:05.612332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c6801-76d4-4c34-a6e9-85ce6c11e324 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:05.625078 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c6801-76d4-4c34-a6e9-85ce6c11e324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c68c6801-76d4-4c34-a6e9-85ce6c11e324 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:05.633080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:05.634092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:05.635507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:05.635507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:05.635507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:05.635507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:05.635507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:05.635507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:05.635507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:05.635507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:05.635507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:05.635507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:05.635507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:05.635507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:05.640139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 376/731] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:17:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:05.641694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a37ec-378b-45a9-933a-47acf10ff926 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:05.641980 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a37ec-378b-45a9-933a-47acf10ff926 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:05.642259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a37ec-378b-45a9-933a-47acf10ff926 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:05.644342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 377/732] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:05.645144 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a37ec-378b-45a9-933a-47acf10ff926 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:05.678428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e7ee1-1e2b-4edd-89fd-d39f1ecb5b6c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:05.710375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:05.720066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:05.721493 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93458bb3-5278-4658-9daa-f9157e3582e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:05.722409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93458bb3-5278-4658-9daa-f9157e3582e3 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:05.722785 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93458bb3-5278-4658-9daa-f9157e3582e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:05.723069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93458bb3-5278-4658-9daa-f9157e3582e3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:05.732391 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93458bb3-5278-4658-9daa-f9157e3582e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:05.733868 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93458bb3-5278-4658-9daa-f9157e3582e3 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-93458bb3-5278-4658-9daa-f9157e3582e3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:05.750113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:05.751106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:05.752063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:05.752063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:05.752063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:05.752063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:05.752063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:05.752063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:05.752063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:05.752063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:05.752063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:17:05.752063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:05.752063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 356/733] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jul 21 22:17:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:05.753208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487f749-ce95-4a92-9dc5-57dd94cd79b4 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:05.753208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487f749-ce95-4a92-9dc5-57dd94cd79b4 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:05.753374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487f749-ce95-4a92-9dc5-57dd94cd79b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:05.769605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a37ec-378b-45a9-933a-47acf10ff926 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:05.772700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-2487f749-ce95-4a92-9dc5-57dd94cd79b4 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:05.773942 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2487f749-ce95-4a92-9dc5-57dd94cd79b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:05.814827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8eea70-a909-4dd0-981d-95e4ce4a7888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:05.815905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8eea70-a909-4dd0-981d-95e4ce4a7888 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:05.816450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8eea70-a909-4dd0-981d-95e4ce4a7888 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:05.817184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8eea70-a909-4dd0-981d-95e4ce4a7888 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:05.819079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8eea70-a909-4dd0-981d-95e4ce4a7888 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:05.819594 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8eea70-a909-4dd0-981d-95e4ce4a7888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:05.821256 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8eea70-a909-4dd0-981d-95e4ce4a7888 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:05.838274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 378/734] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:17:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:05.839462 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8eea70-a909-4dd0-981d-95e4ce4a7888 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:05.860604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 357/735] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:17:05.861973 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487f749-ce95-4a92-9dc5-57dd94cd79b4 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:05.950461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8eea70-a909-4dd0-981d-95e4ce4a7888 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:05.961978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:05.988563 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb74857-4c3d-4eb8-84bb-779fc1aa7542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:05.989630 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb74857-4c3d-4eb8-84bb-779fc1aa7542 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:05.990022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb74857-4c3d-4eb8-84bb-779fc1aa7542 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:05.990411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb74857-4c3d-4eb8-84bb-779fc1aa7542 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:05.991578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb74857-4c3d-4eb8-84bb-779fc1aa7542 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:05.991737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb74857-4c3d-4eb8-84bb-779fc1aa7542 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:05.993339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb74857-4c3d-4eb8-84bb-779fc1aa7542 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:05.995247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487f749-ce95-4a92-9dc5-57dd94cd79b4 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:06.016394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 379/736] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jul 21 22:17:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:06.016394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb74857-4c3d-4eb8-84bb-779fc1aa7542 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:06.021746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:06.047735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c76af-0762-4907-ab38-10c228b95c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:06.049348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c76af-0762-4907-ab38-10c228b95c26 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:06.049800 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c76af-0762-4907-ab38-10c228b95c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:06.050380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c76af-0762-4907-ab38-10c228b95c26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:06.063765 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c76af-0762-4907-ab38-10c228b95c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:06.065854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c76af-0762-4907-ab38-10c228b95c26 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:06.089928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-4b3c76af-0762-4907-ab38-10c228b95c26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:06.089928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:06.089928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:06.089928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:06.089928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:06.089928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:06.089928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:06.089928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:06.089928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:06.089928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:06.089928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:06.089928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:06.089928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:06.089928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:06.089928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:06.091085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:06.092165 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:06.092165 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:06.092165 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:06.092165 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:06.094109 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 358/737] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:06.095172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c76af-0762-4907-ab38-10c228b95c26 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:06.130543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb74857-4c3d-4eb8-84bb-779fc1aa7542 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:06.171691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9536b7a-1586-416b-9913-1f311a8082f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:06.172485 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9536b7a-1586-416b-9913-1f311a8082f2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:06.172764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9536b7a-1586-416b-9913-1f311a8082f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:06.173068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9536b7a-1586-416b-9913-1f311a8082f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:06.185034 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9536b7a-1586-416b-9913-1f311a8082f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d9536b7a-1586-416b-9913-1f311a8082f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:06.193153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:06.194249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:06.195192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:06.195192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:06.195192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:06.195192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:06.195192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:06.195192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:06.195192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:06.195192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:06.195192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:06.195192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:06.195192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:06.195192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:06.195192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 380/738] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:17:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:06.195937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fba8b-43ff-42ef-b2af-800d80b9e2ed None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:06.196084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fba8b-43ff-42ef-b2af-800d80b9e2ed None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:06.196355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fba8b-43ff-42ef-b2af-800d80b9e2ed None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:06.201087 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 381/739] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:06.201087 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fba8b-43ff-42ef-b2af-800d80b9e2ed None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:06.205393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c76af-0762-4907-ab38-10c228b95c26 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:06.230499 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:06.239159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00224d-b857-4c44-b7eb-462ab22f7e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:06.240067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00224d-b857-4c44-b7eb-462ab22f7e7c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:06.240347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00224d-b857-4c44-b7eb-462ab22f7e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:06.240628 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00224d-b857-4c44-b7eb-462ab22f7e7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:06.281551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:06.306297 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fba8b-43ff-42ef-b2af-800d80b9e2ed None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:06.314226 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00224d-b857-4c44-b7eb-462ab22f7e7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:06.315759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00224d-b857-4c44-b7eb-462ab22f7e7c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:06.344347 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2cdb1-41ea-417f-85d8-08a78367588a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:06.345032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2cdb1-41ea-417f-85d8-08a78367588a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:06.345313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2cdb1-41ea-417f-85d8-08a78367588a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:06.345587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2cdb1-41ea-417f-85d8-08a78367588a None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:06.346305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2cdb1-41ea-417f-85d8-08a78367588a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:06.346611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2cdb1-41ea-417f-85d8-08a78367588a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:06.347964 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2cdb1-41ea-417f-85d8-08a78367588a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:06.363543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 382/740] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:06.363543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2cdb1-41ea-417f-85d8-08a78367588a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:06.421939 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 359/741] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:17:06 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 22:17:06.423465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da0161-c9d9-448a-9ff8-62169e8ce554 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:06.423754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da0161-c9d9-448a-9ff8-62169e8ce554 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:06.424026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da0161-c9d9-448a-9ff8-62169e8ce554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:06.440122 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-20da0161-c9d9-448a-9ff8-62169e8ce554 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:06.441324 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-20da0161-c9d9-448a-9ff8-62169e8ce554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:06.458053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:06.470522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2cdb1-41ea-417f-85d8-08a78367588a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:06.504765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e9f5c-4d20-4605-8094-20c677cad2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:06.505643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e9f5c-4d20-4605-8094-20c677cad2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:06.505925 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e9f5c-4d20-4605-8094-20c677cad2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:06.506199 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e9f5c-4d20-4605-8094-20c677cad2e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:06.506937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e9f5c-4d20-4605-8094-20c677cad2e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:06.507239 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e9f5c-4d20-4605-8094-20c677cad2e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:06.508405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:06.508592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e9f5c-4d20-4605-8094-20c677cad2e0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:06.521092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 383/742] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:17:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:06.521092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e9f5c-4d20-4605-8094-20c677cad2e0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:06.521977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 360/743] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 22:17:06.525027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da0161-c9d9-448a-9ff8-62169e8ce554 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:06.625531 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e9f5c-4d20-4605-8094-20c677cad2e0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:06.628533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da0161-c9d9-448a-9ff8-62169e8ce554 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:06.658012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41240560-ea79-4f5c-92e4-607eabbe806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:06.658799 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41240560-ea79-4f5c-92e4-607eabbe806a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:06.659082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41240560-ea79-4f5c-92e4-607eabbe806a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:06.659358 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41240560-ea79-4f5c-92e4-607eabbe806a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:06.664788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d543e-360a-45e1-bff3-6bde8bad02d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:06.666295 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d543e-360a-45e1-bff3-6bde8bad02d1 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:06.666720 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d543e-360a-45e1-bff3-6bde8bad02d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:06.667136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d543e-360a-45e1-bff3-6bde8bad02d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:06.667756 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41240560-ea79-4f5c-92e4-607eabbe806a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:06.669204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41240560-ea79-4f5c-92e4-607eabbe806a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:06.678018 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d543e-360a-45e1-bff3-6bde8bad02d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:06.679597 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d543e-360a-45e1-bff3-6bde8bad02d1 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-41240560-ea79-4f5c-92e4-607eabbe806a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:06.682955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:06.684035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:06.684978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:06.684978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:06.684978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:06.684978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:06.684978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:06.684978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:06.684978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:06.684978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:06.684978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:17:06.684978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:06.684978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 384/744] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:17:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:06.684978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41240560-ea79-4f5c-92e4-607eabbe806a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:06.701043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:06.702370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-ad2d543e-360a-45e1-bff3-6bde8bad02d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:06.702370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:06.702370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:06.702370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:06.702370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:06.702370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:06.702370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:06.702370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:06.702370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:06.702370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:06.702370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:06.702370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:06.702370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:06.702370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:06.702370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:06.703247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:06.704176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:06.704176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:06.704176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:06.704176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:06.704176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 361/745] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:06.708780 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d543e-360a-45e1-bff3-6bde8bad02d1 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:06.771126 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:06.798665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41240560-ea79-4f5c-92e4-607eabbe806a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:06.825629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d543e-360a-45e1-bff3-6bde8bad02d1 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:06.833577 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec7739-0693-4976-95f7-3bf4f06b70dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:06.834970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec7739-0693-4976-95f7-3bf4f06b70dd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:06.834970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec7739-0693-4976-95f7-3bf4f06b70dd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:06.834970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec7739-0693-4976-95f7-3bf4f06b70dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:06.845472 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec7739-0693-4976-95f7-3bf4f06b70dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:06.846912 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec7739-0693-4976-95f7-3bf4f06b70dd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:06.862983 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765f84f-4ce5-44b2-9646-fc99aa6cc7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:06.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c4ec7739-0693-4976-95f7-3bf4f06b70dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:06.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:06.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:06.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:06.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:06.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:06.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:06.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:06.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:06.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:06.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:06.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:06.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:06.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:06.863744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:06.864618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:06.865619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:06.865619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:06.865619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:06.865619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:06.865619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 385/746] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:06.865896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec7739-0693-4976-95f7-3bf4f06b70dd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:06.866480 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765f84f-4ce5-44b2-9646-fc99aa6cc7c2 None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:06.866775 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765f84f-4ce5-44b2-9646-fc99aa6cc7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:06.867053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765f84f-4ce5-44b2-9646-fc99aa6cc7c2 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:06.867779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765f84f-4ce5-44b2-9646-fc99aa6cc7c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:06.869672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765f84f-4ce5-44b2-9646-fc99aa6cc7c2 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:06.883667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 362/747] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jul 21 22:17:06 2022] POST /identity/v3/services => generated 240 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:17:06.885332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765f84f-4ce5-44b2-9646-fc99aa6cc7c2 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:06.953240 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:07.011005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec7739-0693-4976-95f7-3bf4f06b70dd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:07.022257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765f84f-4ce5-44b2-9646-fc99aa6cc7c2 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:07.033767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:07.064802 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43151b0-0e2a-4468-8f23-d7548913f769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:07.068659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43151b0-0e2a-4468-8f23-d7548913f769 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:07.068659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43151b0-0e2a-4468-8f23-d7548913f769 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:07.068659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43151b0-0e2a-4468-8f23-d7548913f769 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:07.068659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43151b0-0e2a-4468-8f23-d7548913f769 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:07.068659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43151b0-0e2a-4468-8f23-d7548913f769 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:07.073179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43151b0-0e2a-4468-8f23-d7548913f769 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:07.075394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c635c-738a-4ed8-922d-2b5f878cf178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:07.075851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c635c-738a-4ed8-922d-2b5f878cf178 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:07.076133 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c635c-738a-4ed8-922d-2b5f878cf178 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:07.076419 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c635c-738a-4ed8-922d-2b5f878cf178 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:07.078225 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c635c-738a-4ed8-922d-2b5f878cf178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:07.078225 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c635c-738a-4ed8-922d-2b5f878cf178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:07.079912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c635c-738a-4ed8-922d-2b5f878cf178 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:07.095926 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 363/748] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:07.097581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 386/749] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jul 21 22:17:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:07.097749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c635c-738a-4ed8-922d-2b5f878cf178 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:07.105941 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43151b0-0e2a-4468-8f23-d7548913f769 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:07.219650 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c635c-738a-4ed8-922d-2b5f878cf178 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:07.224538 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43151b0-0e2a-4468-8f23-d7548913f769 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:07.248814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:07.265240 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721855ef-df10-4ede-a4bc-4183e5dc95f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:07.266041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721855ef-df10-4ede-a4bc-4183e5dc95f1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:07.266552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721855ef-df10-4ede-a4bc-4183e5dc95f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:07.266871 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721855ef-df10-4ede-a4bc-4183e5dc95f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:07.272770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b117c74-8aa2-4e25-b8fd-62d49120a36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:07.273648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b117c74-8aa2-4e25-b8fd-62d49120a36d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:07.274081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b117c74-8aa2-4e25-b8fd-62d49120a36d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:07.274527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b117c74-8aa2-4e25-b8fd-62d49120a36d None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:07.275403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b117c74-8aa2-4e25-b8fd-62d49120a36d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:07.275859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b117c74-8aa2-4e25-b8fd-62d49120a36d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:07.278205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b117c74-8aa2-4e25-b8fd-62d49120a36d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:07.295888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 364/750] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:07.296989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b117c74-8aa2-4e25-b8fd-62d49120a36d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:07.332676 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:07.348580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721855ef-df10-4ede-a4bc-4183e5dc95f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:07.350555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721855ef-df10-4ede-a4bc-4183e5dc95f1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:07.433741 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b117c74-8aa2-4e25-b8fd-62d49120a36d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:07.469905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 387/751] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:17:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:17:07.470683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721855ef-df10-4ede-a4bc-4183e5dc95f1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:07.479267 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735149ee-983f-4c9f-9889-81f2f75bdd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:07.480115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735149ee-983f-4c9f-9889-81f2f75bdd3a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:07.480399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735149ee-983f-4c9f-9889-81f2f75bdd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:07.480674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735149ee-983f-4c9f-9889-81f2f75bdd3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:07.488041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735149ee-983f-4c9f-9889-81f2f75bdd3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:07.489670 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735149ee-983f-4c9f-9889-81f2f75bdd3a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:07.495918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:07.505609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-735149ee-983f-4c9f-9889-81f2f75bdd3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:07.505609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:07.505609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:07.505609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:07.505609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:07.505609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:07.505609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:07.505609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:07.505609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:07.505609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:07.505609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:07.505609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:07.505609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:07.505609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:07.505609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:07.506534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:07.507397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:07.507397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:07.507397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:07.507397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:07.507397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:07.507397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:07.507397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:07.507397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:07.507397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 365/752] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:07.507872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735149ee-983f-4c9f-9889-81f2f75bdd3a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:07.582477 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721855ef-df10-4ede-a4bc-4183e5dc95f1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:07.620713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95548da4-1c0a-44ab-92e6-693e39cffb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:07.621991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95548da4-1c0a-44ab-92e6-693e39cffb0b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:07.622477 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95548da4-1c0a-44ab-92e6-693e39cffb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:07.622965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95548da4-1c0a-44ab-92e6-693e39cffb0b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:07.624118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:07.633221 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95548da4-1c0a-44ab-92e6-693e39cffb0b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:07.635086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95548da4-1c0a-44ab-92e6-693e39cffb0b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:07.638519 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735149ee-983f-4c9f-9889-81f2f75bdd3a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-95548da4-1c0a-44ab-92e6-693e39cffb0b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:07.650983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:07.652151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:07.653459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:07.653459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:07.653459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:07.653459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:07.653459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:07.653459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:07.653459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:07.653459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:07.653459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:17:07.653459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:07.655976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 388/753] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jul 21 22:17:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:07.656986 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95548da4-1c0a-44ab-92e6-693e39cffb0b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:07.684523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd57eff-6162-41bc-a2e8-f9af105e28d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:07.685359 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd57eff-6162-41bc-a2e8-f9af105e28d9 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:07.685639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd57eff-6162-41bc-a2e8-f9af105e28d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:07.685912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd57eff-6162-41bc-a2e8-f9af105e28d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:07.696818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd57eff-6162-41bc-a2e8-f9af105e28d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:07.699283 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd57eff-6162-41bc-a2e8-f9af105e28d9 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:07.717822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-cfd57eff-6162-41bc-a2e8-f9af105e28d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:07.717822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:07.717822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:07.717822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:07.717822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:07.717822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:07.717822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:07.717822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:07.717822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:07.717822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:07.717822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:07.717822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:07.717822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:07.717822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:07.717822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:07.718929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:07.720009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:07.720009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:07.720009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:07.720009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:07.723516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 366/754] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:07.724247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd57eff-6162-41bc-a2e8-f9af105e28d9 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:07.750902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:07.772396 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95548da4-1c0a-44ab-92e6-693e39cffb0b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:07.809122 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64216ce7-1f4a-46e2-9ba7-e1fce06d6468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:07.809833 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64216ce7-1f4a-46e2-9ba7-e1fce06d6468 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:07.810116 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64216ce7-1f4a-46e2-9ba7-e1fce06d6468 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:07.810439 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64216ce7-1f4a-46e2-9ba7-e1fce06d6468 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:07.811346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64216ce7-1f4a-46e2-9ba7-e1fce06d6468 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:07.811655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64216ce7-1f4a-46e2-9ba7-e1fce06d6468 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:07.813250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64216ce7-1f4a-46e2-9ba7-e1fce06d6468 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:07.823510 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd57eff-6162-41bc-a2e8-f9af105e28d9 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:07.833052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 389/755] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:07.833052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2030041-ad98-4292-9b6f-398600138268 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:07.833052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2030041-ad98-4292-9b6f-398600138268 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:07.833052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2030041-ad98-4292-9b6f-398600138268 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:07.833052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 390/756] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:07.833052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2030041-ad98-4292-9b6f-398600138268 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:07.862190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09d121-ae98-4069-9cdc-556b090e3dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:07.862860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09d121-ae98-4069-9cdc-556b090e3dfb None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:07.863143 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09d121-ae98-4069-9cdc-556b090e3dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:07.863419 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09d121-ae98-4069-9cdc-556b090e3dfb None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:07.864298 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09d121-ae98-4069-9cdc-556b090e3dfb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:07.864613 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09d121-ae98-4069-9cdc-556b090e3dfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:07.866061 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09d121-ae98-4069-9cdc-556b090e3dfb None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:07.875306 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:07.888559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 367/757] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jul 21 22:17:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:07.888559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09d121-ae98-4069-9cdc-556b090e3dfb None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:07.946117 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2030041-ad98-4292-9b6f-398600138268 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:07.981857 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d832188-9882-49f1-9cc8-4d302bf4a369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:07.982759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d832188-9882-49f1-9cc8-4d302bf4a369 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:07.983323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d832188-9882-49f1-9cc8-4d302bf4a369 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:07.983323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d832188-9882-49f1-9cc8-4d302bf4a369 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:07.984062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d832188-9882-49f1-9cc8-4d302bf4a369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:07.984372 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d832188-9882-49f1-9cc8-4d302bf4a369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:07.985770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d832188-9882-49f1-9cc8-4d302bf4a369 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:07.995366 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:07.996774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09d121-ae98-4069-9cdc-556b090e3dfb None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:08.004542 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 391/758] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:08.006587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749fe1f-32c5-4230-8e09-865affddd23e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:08.007252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749fe1f-32c5-4230-8e09-865affddd23e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:08.007855 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749fe1f-32c5-4230-8e09-865affddd23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:08.024554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0749fe1f-32c5-4230-8e09-865affddd23e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:08.025750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0749fe1f-32c5-4230-8e09-865affddd23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:08.031451 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bc706-c1c3-40f6-8297-92fb69c7f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:08.032113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bc706-c1c3-40f6-8297-92fb69c7f32a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:08.032398 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bc706-c1c3-40f6-8297-92fb69c7f32a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:08.032675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bc706-c1c3-40f6-8297-92fb69c7f32a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:08.033534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bc706-c1c3-40f6-8297-92fb69c7f32a None admin] RBAC: Adding query filter params (role.id=21cd8dfe95a341df92f26899aaae6604, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=9fd7af9bcff947afad3e7de1fe204472) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:08.033847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bc706-c1c3-40f6-8297-92fb69c7f32a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:08.035278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bc706-c1c3-40f6-8297-92fb69c7f32a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:08.052961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 368/759] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:17:07 2022] GET /identity/v3/role_assignments?user.id=9fd7af9bcff947afad3e7de1fe204472&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=21cd8dfe95a341df92f26899aaae6604 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:08.052961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bc706-c1c3-40f6-8297-92fb69c7f32a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:08.129537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:08.137641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 392/760] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:08.139359 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749fe1f-32c5-4230-8e09-865affddd23e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:08.191140 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bc706-c1c3-40f6-8297-92fb69c7f32a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:08.246999 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345d749-c521-4281-b2e5-c36f04619750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:08.248056 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345d749-c521-4281-b2e5-c36f04619750 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:08.248763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345d749-c521-4281-b2e5-c36f04619750 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:08.249109 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345d749-c521-4281-b2e5-c36f04619750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:08.264160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345d749-c521-4281-b2e5-c36f04619750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:08.265701 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345d749-c521-4281-b2e5-c36f04619750 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:08.267054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749fe1f-32c5-4230-8e09-865affddd23e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:08.282938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-b345d749-c521-4281-b2e5-c36f04619750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:08.282938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:08.282938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:08.282938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:08.282938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:08.282938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:08.282938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:08.282938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:08.282938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:08.282938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:08.282938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:08.282938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:08.282938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:08.282938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:08.282938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:08.283857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:08.284764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:08.284764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:08.284764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:08.284764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:08.284764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 369/761] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:08.285511 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345d749-c521-4281-b2e5-c36f04619750 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:08.311232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:08.320949 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbb6f1-88fe-4b36-a831-dd2130236078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:08.322057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbb6f1-88fe-4b36-a831-dd2130236078 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:08.322791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbb6f1-88fe-4b36-a831-dd2130236078 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:08.323289 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbb6f1-88fe-4b36-a831-dd2130236078 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:08.333070 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbb6f1-88fe-4b36-a831-dd2130236078 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:08.335109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbb6f1-88fe-4b36-a831-dd2130236078 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:08.354726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-2bdbb6f1-88fe-4b36-a831-dd2130236078 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:08.354726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:08.354726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:08.354726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:08.354726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:08.354726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:08.354726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:08.354726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:08.354726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:08.354726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:08.354726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:08.354726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:08.354726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:08.354726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:08.354726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:08.355820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:08.356903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:08.356903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:08.356903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:08.356903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:08.356903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:08.356903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:08.356903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:08.356903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:08.364033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 393/762] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:08.364033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbb6f1-88fe-4b36-a831-dd2130236078 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:08.412114 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345d749-c521-4281-b2e5-c36f04619750 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:08.429868 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:08.458081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c2af6-c680-47ed-bba8-5e16879fed4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:08.459571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c2af6-c680-47ed-bba8-5e16879fed4d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:08.460246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c2af6-c680-47ed-bba8-5e16879fed4d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:08.460669 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c2af6-c680-47ed-bba8-5e16879fed4d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:08.461734 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c2af6-c680-47ed-bba8-5e16879fed4d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:08.464504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c2af6-c680-47ed-bba8-5e16879fed4d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:08.481783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbb6f1-88fe-4b36-a831-dd2130236078 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-7a5c2af6-c680-47ed-bba8-5e16879fed4d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:08.483897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:08.485242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:08.486051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:08.486051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:08.486051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:08.486051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:08.486051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:08.486051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:08.486051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:08.486051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:08.486051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:08.486051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:08.486051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:08.486051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:08.486051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:08.486051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:17:08.486051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:08.486819 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 370/763] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Jul 21 22:17:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:08.488061 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c2af6-c680-47ed-bba8-5e16879fed4d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:08.526882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98730e1-1ebb-4609-85c1-a6bcd5ce64a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:08.528030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98730e1-1ebb-4609-85c1-a6bcd5ce64a7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:08.528310 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98730e1-1ebb-4609-85c1-a6bcd5ce64a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:08.528590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98730e1-1ebb-4609-85c1-a6bcd5ce64a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:08.529744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98730e1-1ebb-4609-85c1-a6bcd5ce64a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:08.530075 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98730e1-1ebb-4609-85c1-a6bcd5ce64a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:08.531702 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98730e1-1ebb-4609-85c1-a6bcd5ce64a7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:08.547181 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 394/764] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:08.548480 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98730e1-1ebb-4609-85c1-a6bcd5ce64a7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:08.609136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:08.613141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c2af6-c680-47ed-bba8-5e16879fed4d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:08.648053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe34b9-af9e-4fb7-b66a-b6d52958a211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:08.648791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe34b9-af9e-4fb7-b66a-b6d52958a211 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:08.649115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe34b9-af9e-4fb7-b66a-b6d52958a211 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:08.649393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe34b9-af9e-4fb7-b66a-b6d52958a211 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:08.650701 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe34b9-af9e-4fb7-b66a-b6d52958a211 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:08.651010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe34b9-af9e-4fb7-b66a-b6d52958a211 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:08.652444 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe34b9-af9e-4fb7-b66a-b6d52958a211 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:08.665369 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 371/765] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:08.666303 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe34b9-af9e-4fb7-b66a-b6d52958a211 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:08.667420 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98730e1-1ebb-4609-85c1-a6bcd5ce64a7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:08.704630 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8c2c2-31ab-476a-9902-94baef6373a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:08.705773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8c2c2-31ab-476a-9902-94baef6373a7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:08.706281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8c2c2-31ab-476a-9902-94baef6373a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:08.706755 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:08.707858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8c2c2-31ab-476a-9902-94baef6373a7 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:08.708834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8c2c2-31ab-476a-9902-94baef6373a7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:08.709535 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8c2c2-31ab-476a-9902-94baef6373a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:08.711243 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8c2c2-31ab-476a-9902-94baef6373a7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:08.718535 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 395/766] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jul 21 22:17:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:08.719670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8c2c2-31ab-476a-9902-94baef6373a7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:08.769372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe34b9-af9e-4fb7-b66a-b6d52958a211 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:08.804606 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc44b7c-5a73-4bd3-bbb2-bd98382e781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:08.805452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc44b7c-5a73-4bd3-bbb2-bd98382e781c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:08.805950 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc44b7c-5a73-4bd3-bbb2-bd98382e781c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:08.806411 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc44b7c-5a73-4bd3-bbb2-bd98382e781c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:08.813638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc44b7c-5a73-4bd3-bbb2-bd98382e781c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:08.815250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc44b7c-5a73-4bd3-bbb2-bd98382e781c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:08.830406 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8c2c2-31ab-476a-9902-94baef6373a7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:08.831473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-0fc44b7c-5a73-4bd3-bbb2-bd98382e781c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:08.831473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:08.831473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:08.831473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:08.831473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:08.831473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:08.831473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:08.831473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:08.831473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:08.831473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:08.831473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:08.831473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:08.831473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:08.831473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:08.831473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:08.832315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:08.833231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:08.833231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:08.833231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:08.833231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:08.833231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:08.833231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:08.833231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:08.833231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:08.833231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 372/767] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:08.834143 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc44b7c-5a73-4bd3-bbb2-bd98382e781c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:08.848984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:08.877671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7b18e-830d-48bc-88f3-ff955039ce84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:08.879085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7b18e-830d-48bc-88f3-ff955039ce84 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:08.879373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7b18e-830d-48bc-88f3-ff955039ce84 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:08.879646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7b18e-830d-48bc-88f3-ff955039ce84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:08.880474 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7b18e-830d-48bc-88f3-ff955039ce84 None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=16a38d4a306748aa8f2e72ceb7f629e2) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:08.880783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7b18e-830d-48bc-88f3-ff955039ce84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:08.882241 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7b18e-830d-48bc-88f3-ff955039ce84 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:08.889286 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 396/768] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:17:08 2022] GET /identity/v3/role_assignments?user.id=16a38d4a306748aa8f2e72ceb7f629e2&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:08.890544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7b18e-830d-48bc-88f3-ff955039ce84 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:08.968030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:08.975151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc44b7c-5a73-4bd3-bbb2-bd98382e781c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:09.013434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7b18e-830d-48bc-88f3-ff955039ce84 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:09.023627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c92989-5404-47c3-b844-e4b4bbeb9113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:09.025713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c92989-5404-47c3-b844-e4b4bbeb9113 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:09.026473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c92989-5404-47c3-b844-e4b4bbeb9113 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:09.026982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c92989-5404-47c3-b844-e4b4bbeb9113 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:09.028422 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c92989-5404-47c3-b844-e4b4bbeb9113 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:09.029506 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c92989-5404-47c3-b844-e4b4bbeb9113 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:09.031673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c92989-5404-47c3-b844-e4b4bbeb9113 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:09.039581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 373/769] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jul 21 22:17:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:09.047660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c92989-5404-47c3-b844-e4b4bbeb9113 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:09.066822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec13a69-8f50-4e60-8487-23a4de479e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:09.067550 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec13a69-8f50-4e60-8487-23a4de479e22 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:09.067832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec13a69-8f50-4e60-8487-23a4de479e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:09.068106 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec13a69-8f50-4e60-8487-23a4de479e22 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:09.068974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec13a69-8f50-4e60-8487-23a4de479e22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:09.069292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec13a69-8f50-4e60-8487-23a4de479e22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:09.070798 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec13a69-8f50-4e60-8487-23a4de479e22 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:09.100573 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 397/770] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:09.104273 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec13a69-8f50-4e60-8487-23a4de479e22 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:09.164627 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:09.255079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec13a69-8f50-4e60-8487-23a4de479e22 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:09.293541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676004d-bfe1-4f07-ab4b-a9155f7754e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:09.294447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676004d-bfe1-4f07-ab4b-a9155f7754e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:09.294733 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676004d-bfe1-4f07-ab4b-a9155f7754e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:09.295011 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676004d-bfe1-4f07-ab4b-a9155f7754e7 None admin] PATH_INFO: `/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/2c04dc3ee4484afaab388cbb306974af/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:09.297060 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676004d-bfe1-4f07-ab4b-a9155f7754e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e77f9cc1c14e35b1d3e1874f107494, user_id=2c04dc3ee4484afaab388cbb306974af, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:09.298547 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676004d-bfe1-4f07-ab4b-a9155f7754e7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:09.317363 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 398/771] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:17:09 2022] PUT /identity/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/2c04dc3ee4484afaab388cbb306974af/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:17:09.319178 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeccb3b-9f3b-4fd2-8093-a4ede71f66bb None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:09.319700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeccb3b-9f3b-4fd2-8093-a4ede71f66bb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:09.320253 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeccb3b-9f3b-4fd2-8093-a4ede71f66bb None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:09.322854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 399/772] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:09.330947 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbda962-91ef-484a-b181-f43d4aa361de None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:09.331137 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbda962-91ef-484a-b181-f43d4aa361de None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:09.333049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbda962-91ef-484a-b181-f43d4aa361de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:09.364314 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c92989-5404-47c3-b844-e4b4bbeb9113 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:09.376905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0fbda962-91ef-484a-b181-f43d4aa361de None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:09.378136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0fbda962-91ef-484a-b181-f43d4aa361de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:09.418897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630e323-f94a-4087-bb3d-525222198560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:09.420734 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630e323-f94a-4087-bb3d-525222198560 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:09.422675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630e323-f94a-4087-bb3d-525222198560 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:09.422982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630e323-f94a-4087-bb3d-525222198560 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:09.423815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630e323-f94a-4087-bb3d-525222198560 None admin] RBAC: Adding query filter params (interface=public, service_id=01a491984fe14ee08092a961a7a484f9, region_id=RegionOne) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:09.424131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630e323-f94a-4087-bb3d-525222198560 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:09.428340 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630e323-f94a-4087-bb3d-525222198560 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:09.447064 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 374/773] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jul 21 22:17:09 2022] GET /identity/v3/endpoints?service_id=01a491984fe14ee08092a961a7a484f9&interface=public®ion_id=RegionOne => generated 194 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:09.452722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630e323-f94a-4087-bb3d-525222198560 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:09.505464 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:09.592637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630e323-f94a-4087-bb3d-525222198560 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:09.642486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c44a6-f973-430d-b7d9-63db85406507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:09.643387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c44a6-f973-430d-b7d9-63db85406507 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:09.643771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c44a6-f973-430d-b7d9-63db85406507 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:09.644152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c44a6-f973-430d-b7d9-63db85406507 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:09.644957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c44a6-f973-430d-b7d9-63db85406507 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:09.646485 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c44a6-f973-430d-b7d9-63db85406507 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:09.652738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 400/774] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:09.655190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 375/775] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jul 21 22:17:09 2022] GET /identity/v3/services => generated 772 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:09.678981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbda962-91ef-484a-b181-f43d4aa361de None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:09.716285 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:09.791764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbda962-91ef-484a-b181-f43d4aa361de None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:09.844105 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc0874-de20-417b-ad6a-bc7efdf7d0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:09.844956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc0874-de20-417b-ad6a-bc7efdf7d0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:09.845234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc0874-de20-417b-ad6a-bc7efdf7d0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:09.845512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc0874-de20-417b-ad6a-bc7efdf7d0a6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:09.846178 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc0874-de20-417b-ad6a-bc7efdf7d0a6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:09.847579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc0874-de20-417b-ad6a-bc7efdf7d0a6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-30bc0874-de20-417b-ad6a-bc7efdf7d0a6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:09.863974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:09.865050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:09.865897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:09.865897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:09.865897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:09.865897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:09.865897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:09.865897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:09.865897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:09.865897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:09.865897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:09.865897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:09.865897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:09.865897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:09.865897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:17:09.865897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:09.865897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 401/776] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:09 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:09.873312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c44a6-f973-430d-b7d9-63db85406507 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:09.975275 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:09.985421 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c44a6-f973-430d-b7d9-63db85406507 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:10.027166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f1979-d0ef-4395-bf5f-5916d73f0dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:10.028105 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f1979-d0ef-4395-bf5f-5916d73f0dab None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:10.028392 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f1979-d0ef-4395-bf5f-5916d73f0dab None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:10.028672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f1979-d0ef-4395-bf5f-5916d73f0dab None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:10.029445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f1979-d0ef-4395-bf5f-5916d73f0dab None admin] RBAC: Adding query filter params (name=network) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:10.029755 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f1979-d0ef-4395-bf5f-5916d73f0dab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:10.031131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f1979-d0ef-4395-bf5f-5916d73f0dab None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:10.038395 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 376/777] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jul 21 22:17:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:10.043801 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc0874-de20-417b-ad6a-bc7efdf7d0a6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:10.187154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:10.200002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc0874-de20-417b-ad6a-bc7efdf7d0a6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:10.249918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c0f18-fdb0-402b-886b-41030051d733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:10.250635 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c0f18-fdb0-402b-886b-41030051d733 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:10.250921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c0f18-fdb0-402b-886b-41030051d733 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:10.251196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c0f18-fdb0-402b-886b-41030051d733 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:10.251910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c0f18-fdb0-402b-886b-41030051d733 None admin] RBAC: Adding query filter params (type=network) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:10.252216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c0f18-fdb0-402b-886b-41030051d733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:10.253611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c0f18-fdb0-402b-886b-41030051d733 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:10.258954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 402/778] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jul 21 22:17:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:10.264956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f1979-d0ef-4395-bf5f-5916d73f0dab None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:10.379867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f1979-d0ef-4395-bf5f-5916d73f0dab None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:10.382189 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b0b3c-1f07-44d3-8701-6d25e64fbda8 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:10.382473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b0b3c-1f07-44d3-8701-6d25e64fbda8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:10.382753 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b0b3c-1f07-44d3-8701-6d25e64fbda8 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:10.384179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 403/779] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:10.389660 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f03ff-a0a2-4292-87fe-07756a5ead43 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:10.389942 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f03ff-a0a2-4292-87fe-07756a5ead43 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:10.390226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f03ff-a0a2-4292-87fe-07756a5ead43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:10.413887 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d04f03ff-a0a2-4292-87fe-07756a5ead43 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:10.415076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d04f03ff-a0a2-4292-87fe-07756a5ead43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:10.455471 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfe7bc-1d03-471c-989c-7799db855bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:10.456140 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfe7bc-1d03-471c-989c-7799db855bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:10.456418 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfe7bc-1d03-471c-989c-7799db855bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:10.456692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfe7bc-1d03-471c-989c-7799db855bf7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:10.457515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfe7bc-1d03-471c-989c-7799db855bf7 None admin] RBAC: Adding query filter params (interface=public, service_id=18d00ecaf91c4ddd816c8c816b5c551b, region_id=RegionOne) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:10.457829 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfe7bc-1d03-471c-989c-7799db855bf7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:10.459192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfe7bc-1d03-471c-989c-7799db855bf7 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:10.473981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 377/780] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jul 21 22:17:10 2022] GET /identity/v3/endpoints?service_id=18d00ecaf91c4ddd816c8c816b5c551b&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:10.480106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfe7bc-1d03-471c-989c-7799db855bf7 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:10.520719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 404/781] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:10.533020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:10.550273 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f03ff-a0a2-4292-87fe-07756a5ead43 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:10.680799 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:10.700094 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f03ff-a0a2-4292-87fe-07756a5ead43 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:10.719019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfe7bc-1d03-471c-989c-7799db855bf7 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:10.746650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ff755-f381-40c5-aaf6-f6fdcf5c4d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:10.747456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ff755-f381-40c5-aaf6-f6fdcf5c4d87 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:10.747732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ff755-f381-40c5-aaf6-f6fdcf5c4d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:10.748005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ff755-f381-40c5-aaf6-f6fdcf5c4d87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:10.769191 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ff755-f381-40c5-aaf6-f6fdcf5c4d87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-8b9ff755-f381-40c5-aaf6-f6fdcf5c4d87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:10.782851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:10.783766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:10.785004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:10.785004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:10.785004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:10.785004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:10.785004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:10.785004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:10.785004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:10.785004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:10.785004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:10.785004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:10.785004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:17:10.785004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:10.785004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 405/782] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:17:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:10.789917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ff755-f381-40c5-aaf6-f6fdcf5c4d87 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:10.798941 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887909c-d55b-4ca2-8d40-657ccfedb479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:10.800279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887909c-d55b-4ca2-8d40-657ccfedb479 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:10.800567 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887909c-d55b-4ca2-8d40-657ccfedb479 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:10.800838 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887909c-d55b-4ca2-8d40-657ccfedb479 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:10.802011 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887909c-d55b-4ca2-8d40-657ccfedb479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:10.803799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887909c-d55b-4ca2-8d40-657ccfedb479 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:10.817615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 378/783] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jul 21 22:17:10 2022] GET /identity/v3/services => generated 772 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:10.911663 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ff755-f381-40c5-aaf6-f6fdcf5c4d87 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:10.949487 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250644e-8943-4b20-b2bc-524dfcba3051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:10.950088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250644e-8943-4b20-b2bc-524dfcba3051 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:10.950369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250644e-8943-4b20-b2bc-524dfcba3051 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:10.950698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250644e-8943-4b20-b2bc-524dfcba3051 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:10.951465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250644e-8943-4b20-b2bc-524dfcba3051 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:10.951820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250644e-8943-4b20-b2bc-524dfcba3051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:10.953321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250644e-8943-4b20-b2bc-524dfcba3051 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:10.963326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 406/784] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:17:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:10.968917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887909c-d55b-4ca2-8d40-657ccfedb479 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:11.091054 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:11.111438 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887909c-d55b-4ca2-8d40-657ccfedb479 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:11.149211 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016501b7-0ffb-478c-8728-57ad1a7225a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:11.150594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016501b7-0ffb-478c-8728-57ad1a7225a2 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:11.150879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016501b7-0ffb-478c-8728-57ad1a7225a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:11.151156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016501b7-0ffb-478c-8728-57ad1a7225a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:11.164054 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016501b7-0ffb-478c-8728-57ad1a7225a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:11.165561 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016501b7-0ffb-478c-8728-57ad1a7225a2 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:11.182835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-016501b7-0ffb-478c-8728-57ad1a7225a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:11.182835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:11.182835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:11.182835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:11.182835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:11.182835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:11.182835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:11.182835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:11.182835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:11.182835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:11.182835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:11.182835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:11.182835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:11.182835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:11.182835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:11.184898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:11.187042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:11.187042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:11.187042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:11.187042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:11.187042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 379/785] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:11.189938 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250644e-8943-4b20-b2bc-524dfcba3051 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:11.202146 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:11.294473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250644e-8943-4b20-b2bc-524dfcba3051 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:11.329180 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033c833-a427-4895-8266-d8ce34392580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:11.329845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033c833-a427-4895-8266-d8ce34392580 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:11.330129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033c833-a427-4895-8266-d8ce34392580 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:11.330405 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033c833-a427-4895-8266-d8ce34392580 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:11.331124 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033c833-a427-4895-8266-d8ce34392580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:11.331430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033c833-a427-4895-8266-d8ce34392580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:11.332795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033c833-a427-4895-8266-d8ce34392580 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:11.345541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 407/786] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:11.351214 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016501b7-0ffb-478c-8728-57ad1a7225a2 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:11.464823 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6629-f197-40b9-9ce5-80b202d70c09 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:11.465143 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6629-f197-40b9-9ce5-80b202d70c09 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:11.465299 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6629-f197-40b9-9ce5-80b202d70c09 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:11.466818 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 408/787] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:11.473702 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490931e4-0c19-4fd7-a539-d7c47231508b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:11.473702 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490931e4-0c19-4fd7-a539-d7c47231508b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:11.473702 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490931e4-0c19-4fd7-a539-d7c47231508b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:11.475891 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016501b7-0ffb-478c-8728-57ad1a7225a2 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:11.505944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-490931e4-0c19-4fd7-a539-d7c47231508b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:11.507558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-490931e4-0c19-4fd7-a539-d7c47231508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:11.512552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ba181-46b7-400f-a87e-08be77e80008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:11.513400 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ba181-46b7-400f-a87e-08be77e80008 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:11.513681 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ba181-46b7-400f-a87e-08be77e80008 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:11.513956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ba181-46b7-400f-a87e-08be77e80008 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:11.516818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:11.525255 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ba181-46b7-400f-a87e-08be77e80008 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:11.526996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ba181-46b7-400f-a87e-08be77e80008 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-4e5ba181-46b7-400f-a87e-08be77e80008 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:11.545185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:11.546599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:11.547540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:11.547540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:11.547540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:11.547540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:11.547540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:11.547540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:11.547540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:11.547540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:11.547540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:17:11.547540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:11.550403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 380/788] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jul 21 22:17:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:11.557263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ba181-46b7-400f-a87e-08be77e80008 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:11.659538 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:11.683178 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 409/789] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:11.689409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ba181-46b7-400f-a87e-08be77e80008 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:11.718461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490931e4-0c19-4fd7-a539-d7c47231508b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:11.731263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ebe25-2f54-4d4d-b87a-0acdd2f219f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:11.731947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ebe25-2f54-4d4d-b87a-0acdd2f219f8 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:11.732229 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ebe25-2f54-4d4d-b87a-0acdd2f219f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:11.732508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ebe25-2f54-4d4d-b87a-0acdd2f219f8 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:11.733389 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ebe25-2f54-4d4d-b87a-0acdd2f219f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:11.733701 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ebe25-2f54-4d4d-b87a-0acdd2f219f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:11.735205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ebe25-2f54-4d4d-b87a-0acdd2f219f8 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:11.768337 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 381/790] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jul 21 22:17:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:11.775396 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ebe25-2f54-4d4d-b87a-0acdd2f219f8 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:11.879429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:11.926551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ebe25-2f54-4d4d-b87a-0acdd2f219f8 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:11.946911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490931e4-0c19-4fd7-a539-d7c47231508b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:11.962087 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131b424-c20f-45a5-8123-d1d9a4d9b9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:11.963000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131b424-c20f-45a5-8123-d1d9a4d9b9fe None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:11.963379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131b424-c20f-45a5-8123-d1d9a4d9b9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:11.963746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131b424-c20f-45a5-8123-d1d9a4d9b9fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:11.974365 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131b424-c20f-45a5-8123-d1d9a4d9b9fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:11.975863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131b424-c20f-45a5-8123-d1d9a4d9b9fe None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:11.994387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-5131b424-c20f-45a5-8123-d1d9a4d9b9fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:11.994387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:11.994387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:11.994387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:11.994387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:11.994387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:11.994387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:11.994387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:11.994387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:11.994387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:11.994387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:11.994387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:11.994387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:11.994387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:11.994387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:11.995351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:11.996228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:11.996228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:11.996228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:11.996228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:11.996228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 382/791] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:11.998007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9c5a6-714b-4864-8ad5-c061c99f4b38 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:11.998007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9c5a6-714b-4864-8ad5-c061c99f4b38 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:11.998007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9c5a6-714b-4864-8ad5-c061c99f4b38 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:11.999208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 383/792] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:12.003534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9c5a6-714b-4864-8ad5-c061c99f4b38 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:12.020192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299152e8-736a-4dbe-8e42-6ebaec04702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:12.021411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299152e8-736a-4dbe-8e42-6ebaec04702e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:12.021947 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299152e8-736a-4dbe-8e42-6ebaec04702e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:12.022544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299152e8-736a-4dbe-8e42-6ebaec04702e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:12.034324 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299152e8-736a-4dbe-8e42-6ebaec04702e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-299152e8-736a-4dbe-8e42-6ebaec04702e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:12.043578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:12.044517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:12.045389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:12.045389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:12.045389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:12.045389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:12.045389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:12.045389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:12.045389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:12.045389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:12.045389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:12.045389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:12.045389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:12.045389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:12.048119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 410/793] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:17:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:12.049631 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09973615-338c-49d6-9793-6b3d71e3a978 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:12.050175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09973615-338c-49d6-9793-6b3d71e3a978 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:12.050668 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09973615-338c-49d6-9793-6b3d71e3a978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:12.080417 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-09973615-338c-49d6-9793-6b3d71e3a978 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:12.081966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-09973615-338c-49d6-9793-6b3d71e3a978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:12.115594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9c5a6-714b-4864-8ad5-c061c99f4b38 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:12.118774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:12.147766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:12.152309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f379a-30bc-41e4-aa80-d5725b112a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:12.153258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f379a-30bc-41e4-aa80-d5725b112a6d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:12.153547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f379a-30bc-41e4-aa80-d5725b112a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:12.153823 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f379a-30bc-41e4-aa80-d5725b112a6d None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:12.154546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f379a-30bc-41e4-aa80-d5725b112a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:12.154856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f379a-30bc-41e4-aa80-d5725b112a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:12.156230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f379a-30bc-41e4-aa80-d5725b112a6d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:12.165119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 411/794] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:12.167073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09973615-338c-49d6-9793-6b3d71e3a978 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:12.168421 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 384/795] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:12.175169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96dd2f-9104-4da9-ae8d-f206814f2217 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:12.175169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96dd2f-9104-4da9-ae8d-f206814f2217 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:12.175169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96dd2f-9104-4da9-ae8d-f206814f2217 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:12.175713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 385/796] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:12.176845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96dd2f-9104-4da9-ae8d-f206814f2217 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:12.278299 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09973615-338c-49d6-9793-6b3d71e3a978 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:12.288917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96dd2f-9104-4da9-ae8d-f206814f2217 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:12.313369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335507ac-9003-49fd-ab7b-46208123a4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:12.314037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335507ac-9003-49fd-ab7b-46208123a4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:12.314321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335507ac-9003-49fd-ab7b-46208123a4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:12.314602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335507ac-9003-49fd-ab7b-46208123a4b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:12.315342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335507ac-9003-49fd-ab7b-46208123a4b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:12.315656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335507ac-9003-49fd-ab7b-46208123a4b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:12.317042 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335507ac-9003-49fd-ab7b-46208123a4b0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:12.325233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 412/797] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:17:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:12.326410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f137fc-ce5c-4d80-8f4c-8c67feba42f3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:12.326699 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f137fc-ce5c-4d80-8f4c-8c67feba42f3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:12.326981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f137fc-ce5c-4d80-8f4c-8c67feba42f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:12.331114 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7818da4-1c6a-46fd-a80c-a730786d2330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:12.332186 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7818da4-1c6a-46fd-a80c-a730786d2330 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:12.332640 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7818da4-1c6a-46fd-a80c-a730786d2330 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:12.333120 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7818da4-1c6a-46fd-a80c-a730786d2330 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:12.341768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7818da4-1c6a-46fd-a80c-a730786d2330 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:12.343430 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7818da4-1c6a-46fd-a80c-a730786d2330 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:12.344635 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-19f137fc-ce5c-4d80-8f4c-8c67feba42f3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:12.345834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-19f137fc-ce5c-4d80-8f4c-8c67feba42f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:12.359033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-c7818da4-1c6a-46fd-a80c-a730786d2330 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:12.359033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:12.359033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:12.359033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:12.359033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:12.359033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:12.359033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:12.359033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:12.359033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:12.359033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:12.359033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:12.359033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:12.359033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:12.359033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:12.359033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:12.360023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:12.360908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:12.360908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:12.360908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:12.360908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:12.360908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:12.360908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:12.360908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:12.360908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:12.360908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 386/798] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:12.360908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7818da4-1c6a-46fd-a80c-a730786d2330 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:12.396191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:12.396785 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:12.421112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 413/799] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:12.421112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f137fc-ce5c-4d80-8f4c-8c67feba42f3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:12.480847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7818da4-1c6a-46fd-a80c-a730786d2330 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:12.514879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbfa52-3c58-4936-8e1b-d45cc9cb25c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:12.515679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbfa52-3c58-4936-8e1b-d45cc9cb25c0 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:12.515967 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbfa52-3c58-4936-8e1b-d45cc9cb25c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:12.516249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbfa52-3c58-4936-8e1b-d45cc9cb25c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:12.528730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbfa52-3c58-4936-8e1b-d45cc9cb25c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:12.531212 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f137fc-ce5c-4d80-8f4c-8c67feba42f3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-20fbfa52-3c58-4936-8e1b-d45cc9cb25c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:12.536635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:12.537776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:12.538614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:12.538614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:12.538614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:12.538614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:12.538614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:12.538614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:12.538614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:12.538614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:12.538614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:12.538614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:12.538614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:12.538614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:12.538614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 387/800] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:17:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:12.539305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbfa52-3c58-4936-8e1b-d45cc9cb25c0 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:12.572300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e12a40-1db0-47bc-a394-ed5babc1221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:12.573133 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e12a40-1db0-47bc-a394-ed5babc1221c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:12.573419 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e12a40-1db0-47bc-a394-ed5babc1221c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:12.573700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e12a40-1db0-47bc-a394-ed5babc1221c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:12.583923 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e12a40-1db0-47bc-a394-ed5babc1221c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:12.585394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e12a40-1db0-47bc-a394-ed5babc1221c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:12.602965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a9e12a40-1db0-47bc-a394-ed5babc1221c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:12.602965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:12.602965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:12.602965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:12.602965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:12.602965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:12.602965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:12.602965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:12.602965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:12.602965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:12.602965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:12.602965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:12.602965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:12.602965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:12.602965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:12.604533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:12.605665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:12.605665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:12.605665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:12.605665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:12.605665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 414/801] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:12.605995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e12a40-1db0-47bc-a394-ed5babc1221c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:12.637202 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:12.637694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:12.655709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbfa52-3c58-4936-8e1b-d45cc9cb25c0 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:12.691398 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da9985-98bf-4f22-82ef-c9e9862cc6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:12.692068 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da9985-98bf-4f22-82ef-c9e9862cc6fb None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:12.692348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da9985-98bf-4f22-82ef-c9e9862cc6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:12.692621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da9985-98bf-4f22-82ef-c9e9862cc6fb None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:12.693552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da9985-98bf-4f22-82ef-c9e9862cc6fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:12.693857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da9985-98bf-4f22-82ef-c9e9862cc6fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:12.695314 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da9985-98bf-4f22-82ef-c9e9862cc6fb None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:12.706010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e12a40-1db0-47bc-a394-ed5babc1221c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:12.716070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 388/802] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:12.716070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da9985-98bf-4f22-82ef-c9e9862cc6fb None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:12.743397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a2670-00b1-4cd7-b333-3634f494c680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:12.744229 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a2670-00b1-4cd7-b333-3634f494c680 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:12.744516 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a2670-00b1-4cd7-b333-3634f494c680 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:12.744793 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a2670-00b1-4cd7-b333-3634f494c680 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:12.745484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a2670-00b1-4cd7-b333-3634f494c680 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:12.746849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a2670-00b1-4cd7-b333-3634f494c680 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1a6a2670-00b1-4cd7-b333-3634f494c680 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:12.758745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:12.760197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:12.761056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 415/803] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Jul 21 22:17:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:12.762376 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a2670-00b1-4cd7-b333-3634f494c680 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:12.824656 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da9985-98bf-4f22-82ef-c9e9862cc6fb None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:12.860083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007af00-0c0a-460f-9919-6f68f164e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:12.860982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007af00-0c0a-460f-9919-6f68f164e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:12.861419 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007af00-0c0a-460f-9919-6f68f164e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:12.861688 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007af00-0c0a-460f-9919-6f68f164e5e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:12.861959 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:12.862425 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007af00-0c0a-460f-9919-6f68f164e5e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:12.862727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007af00-0c0a-460f-9919-6f68f164e5e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:12.864097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007af00-0c0a-460f-9919-6f68f164e5e8 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:12.868409 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a2670-00b1-4cd7-b333-3634f494c680 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:12.878187 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 389/804] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:17:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:12.878187 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007af00-0c0a-460f-9919-6f68f164e5e8 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:12.889233 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:12.905605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4da4c4-3180-4664-9594-913e03cc5b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:12.906273 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4da4c4-3180-4664-9594-913e03cc5b38 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:12.906565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4da4c4-3180-4664-9594-913e03cc5b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:12.906845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4da4c4-3180-4664-9594-913e03cc5b38 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:12.907575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4da4c4-3180-4664-9594-913e03cc5b38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:12.907946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4da4c4-3180-4664-9594-913e03cc5b38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:12.909268 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4da4c4-3180-4664-9594-913e03cc5b38 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:12.921877 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 416/805] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:12.922740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4da4c4-3180-4664-9594-913e03cc5b38 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:12.990365 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007af00-0c0a-460f-9919-6f68f164e5e8 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:13.025469 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d7040-a1b5-456b-83aa-862314ed0f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:13.026620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d7040-a1b5-456b-83aa-862314ed0f0a None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:13.026849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4da4c4-3180-4664-9594-913e03cc5b38 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:13.027225 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d7040-a1b5-456b-83aa-862314ed0f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:13.027651 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d7040-a1b5-456b-83aa-862314ed0f0a None admin] PATH_INFO: `/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/9fd7af9bcff947afad3e7de1fe204472/roles/21cd8dfe95a341df92f26899aaae6604` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:13.043546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d7040-a1b5-456b-83aa-862314ed0f0a None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e77f9cc1c14e35b1d3e1874f107494, user_id=9fd7af9bcff947afad3e7de1fe204472, role_id=21cd8dfe95a341df92f26899aaae6604)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:13.045231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d7040-a1b5-456b-83aa-862314ed0f0a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:13.061786 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 390/806] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:17:12 2022] PUT /identity/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/9fd7af9bcff947afad3e7de1fe204472/roles/21cd8dfe95a341df92f26899aaae6604 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:17:13.062704 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d7040-a1b5-456b-83aa-862314ed0f0a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:13.075917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91500f27-8b30-4fce-a3c0-04e48af665a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:13.076646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91500f27-8b30-4fce-a3c0-04e48af665a9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:13.076818 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91500f27-8b30-4fce-a3c0-04e48af665a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:13.077126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91500f27-8b30-4fce-a3c0-04e48af665a9 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:13.077869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91500f27-8b30-4fce-a3c0-04e48af665a9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:13.078182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91500f27-8b30-4fce-a3c0-04e48af665a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:13.079622 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91500f27-8b30-4fce-a3c0-04e48af665a9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:13.085287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 417/807] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jul 21 22:17:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:13.085958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91500f27-8b30-4fce-a3c0-04e48af665a9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:13.110602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:13.146927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:13.206359 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d7040-a1b5-456b-83aa-862314ed0f0a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:13.227947 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91500f27-8b30-4fce-a3c0-04e48af665a9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:13.258865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f04946-20e3-4dcf-82a3-99066dd75f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:13.260813 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f04946-20e3-4dcf-82a3-99066dd75f2c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:13.261493 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f04946-20e3-4dcf-82a3-99066dd75f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:13.262317 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f04946-20e3-4dcf-82a3-99066dd75f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:13.268540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07587498-e11e-45b7-b4fc-3d5f03819eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:13.269381 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07587498-e11e-45b7-b4fc-3d5f03819eda None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:13.269673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07587498-e11e-45b7-b4fc-3d5f03819eda None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:13.269949 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07587498-e11e-45b7-b4fc-3d5f03819eda None admin] PATH_INFO: `/v3/users/swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:13.277287 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f04946-20e3-4dcf-82a3-99066dd75f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:13.279461 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f04946-20e3-4dcf-82a3-99066dd75f2c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:13.280131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07587498-e11e-45b7-b4fc-3d5f03819eda None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:13.281708 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07587498-e11e-45b7-b4fc-3d5f03819eda None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-07587498-e11e-45b7-b4fc-3d5f03819eda None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:13.298002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:13.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:13.301952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:13.301952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:13.301952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:13.301952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:13.301952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:13.301952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:13.301952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:13.301952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:13.301952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:17:13.301952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:13.302604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-a6f04946-20e3-4dcf-82a3-99066dd75f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:13.302604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:13.302604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:13.302604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:13.302604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:13.302604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:13.302604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:13.302604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:13.302604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:13.302604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:13.302604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:13.302604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:13.302604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:13.302604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:13.302604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:13.303587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:13.304750 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:13.304750 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:13.304750 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:13.304750 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:13.313403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 418/808] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:17:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:13.313403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07587498-e11e-45b7-b4fc-3d5f03819eda None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:13.313668 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 391/809] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:13.313668 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f04946-20e3-4dcf-82a3-99066dd75f2c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:13.418952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:13.426670 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f04946-20e3-4dcf-82a3-99066dd75f2c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:13.436673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:13.443544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07587498-e11e-45b7-b4fc-3d5f03819eda None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:13.464581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb14735-8c3e-46bb-bcb2-0dc25465ed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:13.465475 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb14735-8c3e-46bb-bcb2-0dc25465ed1e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:13.465829 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb14735-8c3e-46bb-bcb2-0dc25465ed1e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:13.466186 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb14735-8c3e-46bb-bcb2-0dc25465ed1e None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:13.467388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb14735-8c3e-46bb-bcb2-0dc25465ed1e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:13.467388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb14735-8c3e-46bb-bcb2-0dc25465ed1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:13.469206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb14735-8c3e-46bb-bcb2-0dc25465ed1e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:13.483056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8a27-f0ef-43ce-aaa1-d4e0cd3abbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:13.483954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8a27-f0ef-43ce-aaa1-d4e0cd3abbab None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:13.484484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8a27-f0ef-43ce-aaa1-d4e0cd3abbab None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:13.484902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8a27-f0ef-43ce-aaa1-d4e0cd3abbab None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:13.485794 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be8a27-f0ef-43ce-aaa1-d4e0cd3abbab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:13.486291 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be8a27-f0ef-43ce-aaa1-d4e0cd3abbab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:13.487902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be8a27-f0ef-43ce-aaa1-d4e0cd3abbab None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:13.488361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 392/810] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jul 21 22:17:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:13.489241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb14735-8c3e-46bb-bcb2-0dc25465ed1e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:13.495504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 419/811] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jul 21 22:17:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:13.496627 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8a27-f0ef-43ce-aaa1-d4e0cd3abbab None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:13.594861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb14735-8c3e-46bb-bcb2-0dc25465ed1e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:13.608835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8a27-f0ef-43ce-aaa1-d4e0cd3abbab None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:13.633621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b7473-a891-4aca-a1d9-7353243957b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:13.634587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7473-a891-4aca-a1d9-7353243957b1 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:13.634875 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7473-a891-4aca-a1d9-7353243957b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:13.635152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7473-a891-4aca-a1d9-7353243957b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:13.636542 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b7473-a891-4aca-a1d9-7353243957b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:13.636859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b7473-a891-4aca-a1d9-7353243957b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:13.638822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b7473-a891-4aca-a1d9-7353243957b1 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:13.644612 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaacf53-5063-47bc-a936-f68b73abcb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:13.645599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaacf53-5063-47bc-a936-f68b73abcb19 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:13.645799 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaacf53-5063-47bc-a936-f68b73abcb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:13.646480 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaacf53-5063-47bc-a936-f68b73abcb19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:13.656855 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 393/812] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:13.656855 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b7473-a891-4aca-a1d9-7353243957b1 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:13.659123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaacf53-5063-47bc-a936-f68b73abcb19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:13.660588 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaacf53-5063-47bc-a936-f68b73abcb19 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:13.663579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:13.680374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-bcaacf53-5063-47bc-a936-f68b73abcb19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:13.680374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:13.680374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:13.680374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:13.680374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:13.680374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:13.680374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:13.680374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:13.680374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:13.680374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:13.680374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:13.680374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:13.680374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:13.680374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:13.680374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:13.681356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:13.682249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:13.682249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:13.682249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:13.682249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:13.686550 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 420/813] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:13.687325 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cddec-f8b5-4ab2-bc18-8e3d9a5f8ff6 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:13.687617 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cddec-f8b5-4ab2-bc18-8e3d9a5f8ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:13.687905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cddec-f8b5-4ab2-bc18-8e3d9a5f8ff6 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:13.689495 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 421/814] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:13.689744 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:13.690517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cddec-f8b5-4ab2-bc18-8e3d9a5f8ff6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:13.769623 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b7473-a891-4aca-a1d9-7353243957b1 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:13.802957 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cddec-f8b5-4ab2-bc18-8e3d9a5f8ff6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:13.805112 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7e714-1932-4791-83a0-1226e38e52ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:13.805857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e714-1932-4791-83a0-1226e38e52ba None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:13.806729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e714-1932-4791-83a0-1226e38e52ba None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:13.807013 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e714-1932-4791-83a0-1226e38e52ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:13.807758 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7e714-1932-4791-83a0-1226e38e52ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:13.809152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7e714-1932-4791-83a0-1226e38e52ba None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:13.830906 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 394/815] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jul 21 22:17:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:17:13.831552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7e714-1932-4791-83a0-1226e38e52ba None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:13.874849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ff202-3ba8-4082-b545-dbeceb064a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:13.876116 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ff202-3ba8-4082-b545-dbeceb064a65 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:13.876689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ff202-3ba8-4082-b545-dbeceb064a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:13.877758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ff202-3ba8-4082-b545-dbeceb064a65 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:13.889593 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ff202-3ba8-4082-b545-dbeceb064a65 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:13.891470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ff202-3ba8-4082-b545-dbeceb064a65 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-550ff202-3ba8-4082-b545-dbeceb064a65 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:13.913619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:13.914643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:13.915646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:13.915646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:13.915646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:13.915646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:13.915646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:13.915646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:13.915646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:13.915646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:13.915646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:17:13.915646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:13.919435 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 422/816] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jul 21 22:17:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:13.922145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036577f-a5b6-4325-bc8d-bae880572537 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:13.922955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036577f-a5b6-4325-bc8d-bae880572537 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:13.923441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036577f-a5b6-4325-bc8d-bae880572537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:13.925340 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:13.948683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8036577f-a5b6-4325-bc8d-bae880572537 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:13.950251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7e714-1932-4791-83a0-1226e38e52ba None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:13.950651 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8036577f-a5b6-4325-bc8d-bae880572537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:13.992277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a75ba1-f4a3-4ace-ba9f-0e3281f0a1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:13.993949 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a75ba1-f4a3-4ace-ba9f-0e3281f0a1ad None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:13.994279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a75ba1-f4a3-4ace-ba9f-0e3281f0a1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:13.994733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a75ba1-f4a3-4ace-ba9f-0e3281f0a1ad None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:13.995476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a75ba1-f4a3-4ace-ba9f-0e3281f0a1ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:13.995788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a75ba1-f4a3-4ace-ba9f-0e3281f0a1ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:13.997193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a75ba1-f4a3-4ace-ba9f-0e3281f0a1ad None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:14.013028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 395/817] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:14.013983 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a75ba1-f4a3-4ace-ba9f-0e3281f0a1ad None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:14.019691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:14.044551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 423/818] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:14.045438 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036577f-a5b6-4325-bc8d-bae880572537 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:14.143496 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a75ba1-f4a3-4ace-ba9f-0e3281f0a1ad None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:14.176587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036577f-a5b6-4325-bc8d-bae880572537 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:14.185220 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835d7c6-87c6-45b0-9376-f34a9c01c25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:14.185958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835d7c6-87c6-45b0-9376-f34a9c01c25d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:14.186250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835d7c6-87c6-45b0-9376-f34a9c01c25d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:14.186533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835d7c6-87c6-45b0-9376-f34a9c01c25d None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:14.187846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835d7c6-87c6-45b0-9376-f34a9c01c25d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:14.188163 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835d7c6-87c6-45b0-9376-f34a9c01c25d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:14.190010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835d7c6-87c6-45b0-9376-f34a9c01c25d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:14.213315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:14.213579 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 396/819] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jul 21 22:17:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:14.218888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835d7c6-87c6-45b0-9376-f34a9c01c25d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:14.223911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d15f95-5015-4a9d-8e8a-01993f327606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:14.224737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d15f95-5015-4a9d-8e8a-01993f327606 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:14.225072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d15f95-5015-4a9d-8e8a-01993f327606 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:14.225357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d15f95-5015-4a9d-8e8a-01993f327606 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:14.235918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d15f95-5015-4a9d-8e8a-01993f327606 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:14.237613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d15f95-5015-4a9d-8e8a-01993f327606 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:14.257797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-f7d15f95-5015-4a9d-8e8a-01993f327606 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:14.257797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:14.257797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:14.257797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:14.257797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:14.257797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:14.257797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:14.257797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:14.257797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:14.257797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:14.257797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:14.257797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:14.257797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:14.257797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:14.257797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:14.258758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:14.259789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:14.259789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:14.259789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:14.259789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:14.259789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:14.259789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:14.259789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:14.259789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:14.259789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 424/820] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:14.260274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d15f95-5015-4a9d-8e8a-01993f327606 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:14.319132 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:14.334416 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835d7c6-87c6-45b0-9376-f34a9c01c25d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:14.370680 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d31b5d-bd3b-42ee-820a-4ed0042e8fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:14.371882 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d31b5d-bd3b-42ee-820a-4ed0042e8fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:14.372362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d31b5d-bd3b-42ee-820a-4ed0042e8fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:14.372857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d31b5d-bd3b-42ee-820a-4ed0042e8fd4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:14.373736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d31b5d-bd3b-42ee-820a-4ed0042e8fd4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:14.375290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d31b5d-bd3b-42ee-820a-4ed0042e8fd4 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-60d31b5d-bd3b-42ee-820a-4ed0042e8fd4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:14.387774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:14.388787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:14.389637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:14.389637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:14.389637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:14.389637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:14.389637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:14.389637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:14.389637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:14.389637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:14.389637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:14.389637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:14.389637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:14.389637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:14.389637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 22:17:14.389637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:14.391249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d15f95-5015-4a9d-8e8a-01993f327606 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:14.396699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 397/821] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:14 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:14.397842 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d31b5d-bd3b-42ee-820a-4ed0042e8fd4 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:14.430556 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84647a-259f-4552-b754-ea5224acd133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:14.431592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84647a-259f-4552-b754-ea5224acd133 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:14.432116 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84647a-259f-4552-b754-ea5224acd133 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:14.432589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84647a-259f-4552-b754-ea5224acd133 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:14.475314 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:14.509317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84647a-259f-4552-b754-ea5224acd133 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:14.511514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84647a-259f-4552-b754-ea5224acd133 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:14.524326 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d31b5d-bd3b-42ee-820a-4ed0042e8fd4 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:14.563547 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:14.568838 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a5301-315a-42b1-85f8-31ff98445580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:14.569980 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a5301-315a-42b1-85f8-31ff98445580 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:14.570371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a5301-315a-42b1-85f8-31ff98445580 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:14.570724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a5301-315a-42b1-85f8-31ff98445580 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:14.571918 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a5301-315a-42b1-85f8-31ff98445580 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:14.572309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a5301-315a-42b1-85f8-31ff98445580 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:14.574341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a5301-315a-42b1-85f8-31ff98445580 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:14.591011 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 398/822] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:14.592153 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a5301-315a-42b1-85f8-31ff98445580 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:14.643203 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 425/823] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:17:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:17:14.643675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84647a-259f-4552-b754-ea5224acd133 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:14.713397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a5301-315a-42b1-85f8-31ff98445580 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:14.738820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:14.752830 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bd627-a745-4901-96b7-de50b14c7ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:14.753757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bd627-a745-4901-96b7-de50b14c7ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:14.754193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bd627-a745-4901-96b7-de50b14c7ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:14.754633 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bd627-a745-4901-96b7-de50b14c7ef6 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:14.755508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bd627-a745-4901-96b7-de50b14c7ef6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:14.755965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bd627-a745-4901-96b7-de50b14c7ef6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:14.757499 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bd627-a745-4901-96b7-de50b14c7ef6 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:14.762827 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 399/824] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jul 21 22:17:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:14.763856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bd627-a745-4901-96b7-de50b14c7ef6 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:14.783093 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84647a-259f-4552-b754-ea5224acd133 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:14.826427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f659b-cbdc-4194-ad66-9600349fb14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:14.827992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f659b-cbdc-4194-ad66-9600349fb14d None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:14.828565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f659b-cbdc-4194-ad66-9600349fb14d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:14.829067 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f659b-cbdc-4194-ad66-9600349fb14d None admin] PATH_INFO: `/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/16a38d4a306748aa8f2e72ceb7f629e2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:14.831577 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f659b-cbdc-4194-ad66-9600349fb14d None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e77f9cc1c14e35b1d3e1874f107494, user_id=16a38d4a306748aa8f2e72ceb7f629e2, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:14.833257 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f659b-cbdc-4194-ad66-9600349fb14d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:14.850043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 426/825] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:17:14 2022] PUT /identity/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/16a38d4a306748aa8f2e72ceb7f629e2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:17:14.851363 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f659b-cbdc-4194-ad66-9600349fb14d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:14.855778 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:14.909097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bd627-a745-4901-96b7-de50b14c7ef6 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:14.973835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570f52b-7fcb-4854-9b1c-88fa2ec9ef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:14.974715 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570f52b-7fcb-4854-9b1c-88fa2ec9ef7b None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:14.974999 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570f52b-7fcb-4854-9b1c-88fa2ec9ef7b None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:14.975265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570f52b-7fcb-4854-9b1c-88fa2ec9ef7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:14.984346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f659b-cbdc-4194-ad66-9600349fb14d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:14.999095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570f52b-7fcb-4854-9b1c-88fa2ec9ef7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:15.000485 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570f52b-7fcb-4854-9b1c-88fa2ec9ef7b None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:15.026115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee94b4f-367e-4ddc-8784-a6bac5f02e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:15.027196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee94b4f-367e-4ddc-8784-a6bac5f02e35 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:15.027688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee94b4f-367e-4ddc-8784-a6bac5f02e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:15.028424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee94b4f-367e-4ddc-8784-a6bac5f02e35 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:15.029383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee94b4f-367e-4ddc-8784-a6bac5f02e35 None admin] RBAC: Adding query filter params (type=network) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:15.029897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee94b4f-367e-4ddc-8784-a6bac5f02e35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:15.030102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-2570f52b-7fcb-4854-9b1c-88fa2ec9ef7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:15.030102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:15.030102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:15.030102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:15.030102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:15.030102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:15.030102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:15.030102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:15.030102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:15.030102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:15.030102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:15.030102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:15.030102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:15.030102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:15.030102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:15.030927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:15.031815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:15.031815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:15.031815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:15.031815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:15.033990 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee94b4f-367e-4ddc-8784-a6bac5f02e35 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:15.037517 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 400/826] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:15.041466 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 427/827] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jul 21 22:17:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:15.049564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570f52b-7fcb-4854-9b1c-88fa2ec9ef7b None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:15.053747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee94b4f-367e-4ddc-8784-a6bac5f02e35 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:15.145349 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:15.194364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570f52b-7fcb-4854-9b1c-88fa2ec9ef7b None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:15.197267 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:15.238616 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c39df4-cb71-46cb-9c77-84b18a256eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:15.239213 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee94b4f-367e-4ddc-8784-a6bac5f02e35 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:15.239332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c39df4-cb71-46cb-9c77-84b18a256eef None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:15.239540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c39df4-cb71-46cb-9c77-84b18a256eef None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:15.239817 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c39df4-cb71-46cb-9c77-84b18a256eef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:15.240566 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c39df4-cb71-46cb-9c77-84b18a256eef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:15.241967 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c39df4-cb71-46cb-9c77-84b18a256eef None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:15.273040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 401/828] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jul 21 22:17:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:17:15.273040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78c972-3835-4fb8-afe5-c5438204510c None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:15.273040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78c972-3835-4fb8-afe5-c5438204510c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:15.273040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78c972-3835-4fb8-afe5-c5438204510c None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:15.273040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 402/829] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:15.275968 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9123451-1c0a-43ca-a60b-6d2cc65a59ab None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:15.276274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9123451-1c0a-43ca-a60b-6d2cc65a59ab None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:15.276558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9123451-1c0a-43ca-a60b-6d2cc65a59ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:15.315632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea60fcf-2236-4d36-8c0d-5f5ccc55cd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:15.317644 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea60fcf-2236-4d36-8c0d-5f5ccc55cd1f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:15.318731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea60fcf-2236-4d36-8c0d-5f5ccc55cd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:15.319738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea60fcf-2236-4d36-8c0d-5f5ccc55cd1f None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:15.320125 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-a9123451-1c0a-43ca-a60b-6d2cc65a59ab None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:15.322269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea60fcf-2236-4d36-8c0d-5f5ccc55cd1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:15.323018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea60fcf-2236-4d36-8c0d-5f5ccc55cd1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:15.323558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a9123451-1c0a-43ca-a60b-6d2cc65a59ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:15.325567 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea60fcf-2236-4d36-8c0d-5f5ccc55cd1f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:15.355796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 428/830] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:15.361693 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea60fcf-2236-4d36-8c0d-5f5ccc55cd1f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:15.481243 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 403/831] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:15.499517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea60fcf-2236-4d36-8c0d-5f5ccc55cd1f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:15.513429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9123451-1c0a-43ca-a60b-6d2cc65a59ab None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:15.526792 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:15.543449 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91faa476-9ad3-46e3-992e-aad243e15370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:15.545083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faa476-9ad3-46e3-992e-aad243e15370 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:15.545877 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faa476-9ad3-46e3-992e-aad243e15370 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:15.546301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faa476-9ad3-46e3-992e-aad243e15370 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:15.550355 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:15.557575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91faa476-9ad3-46e3-992e-aad243e15370 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:15.559031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91faa476-9ad3-46e3-992e-aad243e15370 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:15.575099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-91faa476-9ad3-46e3-992e-aad243e15370 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:15.575099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:15.575099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:15.575099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:15.575099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:15.575099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:15.575099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:15.575099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:15.575099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:15.575099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:15.575099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:15.575099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:15.575099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:15.575099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:15.575099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:15.576186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:15.577276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:15.577276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:15.577276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:15.577276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:15.577276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:15.577276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:15.577276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:15.577276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:15.577276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 429/832] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:15.589681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91faa476-9ad3-46e3-992e-aad243e15370 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:15.642757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9123451-1c0a-43ca-a60b-6d2cc65a59ab None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:15.689840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397d5e8-d537-4fbd-9bd1-a84642a3f917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:15.690768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397d5e8-d537-4fbd-9bd1-a84642a3f917 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:15.691160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397d5e8-d537-4fbd-9bd1-a84642a3f917 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:15.691777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397d5e8-d537-4fbd-9bd1-a84642a3f917 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:15.709347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397d5e8-d537-4fbd-9bd1-a84642a3f917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-c397d5e8-d537-4fbd-9bd1-a84642a3f917 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:15.720799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:15.722437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:15.723467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:15.723467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:15.723467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:15.723467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:15.723467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:15.723467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:15.723467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:15.723467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:15.723467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:15.723467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:15.723467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:17:15.723467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:15.726861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 404/833] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:17:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:15.732205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91faa476-9ad3-46e3-992e-aad243e15370 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:15.732602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397d5e8-d537-4fbd-9bd1-a84642a3f917 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:15.770900 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd7ef0-6ca6-4e3e-ac15-78e7821273fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:15.771665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd7ef0-6ca6-4e3e-ac15-78e7821273fd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:15.771965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd7ef0-6ca6-4e3e-ac15-78e7821273fd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:15.772220 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd7ef0-6ca6-4e3e-ac15-78e7821273fd None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:15.773044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd7ef0-6ca6-4e3e-ac15-78e7821273fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:15.773369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd7ef0-6ca6-4e3e-ac15-78e7821273fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:15.775411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd7ef0-6ca6-4e3e-ac15-78e7821273fd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:15.789620 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 430/834] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:15.795304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd7ef0-6ca6-4e3e-ac15-78e7821273fd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:15.830687 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:15.845541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:15.849151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397d5e8-d537-4fbd-9bd1-a84642a3f917 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:15.884983 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaf8ef-3b91-42ab-a317-2437bf4ee3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:15.886031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaf8ef-3b91-42ab-a317-2437bf4ee3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:15.886514 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaf8ef-3b91-42ab-a317-2437bf4ee3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:15.886988 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaf8ef-3b91-42ab-a317-2437bf4ee3e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:15.887958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eaf8ef-3b91-42ab-a317-2437bf4ee3e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:15.888466 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eaf8ef-3b91-42ab-a317-2437bf4ee3e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:15.890087 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eaf8ef-3b91-42ab-a317-2437bf4ee3e4 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:15.899089 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 405/835] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:17:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:15.905927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaf8ef-3b91-42ab-a317-2437bf4ee3e4 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:15.913365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd7ef0-6ca6-4e3e-ac15-78e7821273fd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:15.948199 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ad8f9-505b-4fa0-a2e2-dad960a2f6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:15.948850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ad8f9-505b-4fa0-a2e2-dad960a2f6af None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:15.949169 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ad8f9-505b-4fa0-a2e2-dad960a2f6af None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:15.949442 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ad8f9-505b-4fa0-a2e2-dad960a2f6af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:15.950268 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ad8f9-505b-4fa0-a2e2-dad960a2f6af None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=2c04dc3ee4484afaab388cbb306974af) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:15.950576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ad8f9-505b-4fa0-a2e2-dad960a2f6af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:15.951992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ad8f9-505b-4fa0-a2e2-dad960a2f6af None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:15.958289 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 431/836] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:17:15 2022] GET /identity/v3/role_assignments?user.id=2c04dc3ee4484afaab388cbb306974af&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:16.028431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ec683-896f-400c-9acc-56be4d2d2d1c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:16.028718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ec683-896f-400c-9acc-56be4d2d2d1c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:16.029032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ec683-896f-400c-9acc-56be4d2d2d1c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:16.030744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 432/837] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:16.031058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaf8ef-3b91-42ab-a317-2437bf4ee3e4 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:16.036300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aba8b8-d028-45e6-875a-1a276a2e6740 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:16.036583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aba8b8-d028-45e6-875a-1a276a2e6740 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:16.036869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aba8b8-d028-45e6-875a-1a276a2e6740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:16.055640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c9aba8b8-d028-45e6-875a-1a276a2e6740 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:16.057704 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c9aba8b8-d028-45e6-875a-1a276a2e6740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:16.076638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed051e-6142-4640-9e0d-f1056b7c53e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:16.077722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed051e-6142-4640-9e0d-f1056b7c53e3 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:16.078156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed051e-6142-4640-9e0d-f1056b7c53e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:16.078579 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed051e-6142-4640-9e0d-f1056b7c53e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:16.095062 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed051e-6142-4640-9e0d-f1056b7c53e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:16.096976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed051e-6142-4640-9e0d-f1056b7c53e3 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:16.107343 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:16.118457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-d5ed051e-6142-4640-9e0d-f1056b7c53e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:16.118457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:16.118457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:16.118457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:16.118457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:16.118457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:16.118457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:16.118457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:16.118457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:16.118457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:16.118457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:16.118457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:16.118457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:16.118457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:16.118457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:16.120083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:16.121079 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:16.121079 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:16.121079 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:16.121079 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:16.122975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 406/838] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:16.132191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed051e-6142-4640-9e0d-f1056b7c53e3 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:16.159924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 433/839] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:16.187973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aba8b8-d028-45e6-875a-1a276a2e6740 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:16.245032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:16.246756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed051e-6142-4640-9e0d-f1056b7c53e3 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:16.289616 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38892b46-81db-429a-ab94-d7b0e7feeb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:16.291137 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38892b46-81db-429a-ab94-d7b0e7feeb78 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:16.291432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38892b46-81db-429a-ab94-d7b0e7feeb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:16.291710 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38892b46-81db-429a-ab94-d7b0e7feeb78 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:16.292470 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38892b46-81db-429a-ab94-d7b0e7feeb78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:16.292781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38892b46-81db-429a-ab94-d7b0e7feeb78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:16.294550 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38892b46-81db-429a-ab94-d7b0e7feeb78 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:16.310586 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 407/840] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:16.317158 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38892b46-81db-429a-ab94-d7b0e7feeb78 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:16.321488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aba8b8-d028-45e6-875a-1a276a2e6740 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:16.359367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202512a-f57e-4634-b476-c96fdcaba86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:16.360313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202512a-f57e-4634-b476-c96fdcaba86b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:16.360648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202512a-f57e-4634-b476-c96fdcaba86b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:16.360945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202512a-f57e-4634-b476-c96fdcaba86b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:16.361611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202512a-f57e-4634-b476-c96fdcaba86b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:16.363093 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202512a-f57e-4634-b476-c96fdcaba86b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c202512a-f57e-4634-b476-c96fdcaba86b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:16.376465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:16.377731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:16.378749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:16.378749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:16.378749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:16.378749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:16.378749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:16.378749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:16.378749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:16.378749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:16.378749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:16.378749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:16.378749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:16.378749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:16.378749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:17:16.378749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:16.378749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 434/841] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:17:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:16.383486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202512a-f57e-4634-b476-c96fdcaba86b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:16.390814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:16.428215 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38892b46-81db-429a-ab94-d7b0e7feeb78 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:16.471138 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da4f67-c4ee-48dd-b25f-7586912f90e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:16.472751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da4f67-c4ee-48dd-b25f-7586912f90e8 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:16.473154 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da4f67-c4ee-48dd-b25f-7586912f90e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:16.473510 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da4f67-c4ee-48dd-b25f-7586912f90e8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:16.484044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da4f67-c4ee-48dd-b25f-7586912f90e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:16.485678 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da4f67-c4ee-48dd-b25f-7586912f90e8 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-09da4f67-c4ee-48dd-b25f-7586912f90e8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:16.507791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:16.508989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:16.510219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:16.510219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:16.510219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:16.510219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:16.510219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:16.510219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:16.510219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:16.510219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:16.510219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:17:16.510219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:16.511725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 408/842] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jul 21 22:17:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:16.513644 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:16.516171 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202512a-f57e-4634-b476-c96fdcaba86b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:16.517419 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da4f67-c4ee-48dd-b25f-7586912f90e8 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:16.553286 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0119b7a-1229-4a50-b957-d0aadd9c02df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:16.554226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0119b7a-1229-4a50-b957-d0aadd9c02df None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:16.554708 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0119b7a-1229-4a50-b957-d0aadd9c02df None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:16.555139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0119b7a-1229-4a50-b957-d0aadd9c02df None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:16.556045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0119b7a-1229-4a50-b957-d0aadd9c02df None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:16.557074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0119b7a-1229-4a50-b957-d0aadd9c02df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:16.558587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0119b7a-1229-4a50-b957-d0aadd9c02df None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:16.563896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 435/843] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:17:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:16.570786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0119b7a-1229-4a50-b957-d0aadd9c02df None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:16.636512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da4f67-c4ee-48dd-b25f-7586912f90e8 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:16.658302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:16.675660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dd923-8203-4a60-917d-5d58aa665498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:16.676571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dd923-8203-4a60-917d-5d58aa665498 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:16.677077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dd923-8203-4a60-917d-5d58aa665498 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:16.677515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dd923-8203-4a60-917d-5d58aa665498 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:16.678557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910dd923-8203-4a60-917d-5d58aa665498 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:16.679043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910dd923-8203-4a60-917d-5d58aa665498 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:16.680624 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910dd923-8203-4a60-917d-5d58aa665498 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:16.699033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 409/844] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jul 21 22:17:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:16.708967 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dd923-8203-4a60-917d-5d58aa665498 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:16.709104 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0119b7a-1229-4a50-b957-d0aadd9c02df None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:16.755659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1f8b5-940d-497d-8af1-d47de6aa78c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:16.756497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1f8b5-940d-497d-8af1-d47de6aa78c1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:16.757009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1f8b5-940d-497d-8af1-d47de6aa78c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:16.757298 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1f8b5-940d-497d-8af1-d47de6aa78c1 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:16.758411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1f8b5-940d-497d-8af1-d47de6aa78c1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:16.758724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1f8b5-940d-497d-8af1-d47de6aa78c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:16.760139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1f8b5-940d-497d-8af1-d47de6aa78c1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:16.769097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 436/845] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:17:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:16.821499 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dd923-8203-4a60-917d-5d58aa665498 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:16.865564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b8666-8952-47e5-ada3-b1aea7f19f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:16.866248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b8666-8952-47e5-ada3-b1aea7f19f66 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:16.866575 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b8666-8952-47e5-ada3-b1aea7f19f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:16.866858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b8666-8952-47e5-ada3-b1aea7f19f66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:16.920341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:16.944876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b8666-8952-47e5-ada3-b1aea7f19f66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:16.946430 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b8666-8952-47e5-ada3-b1aea7f19f66 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:17.052598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 410/846] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:17:16 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:17:17.057978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1f8b5-940d-497d-8af1-d47de6aa78c1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:17.099733 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:17.184121 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1f8b5-940d-497d-8af1-d47de6aa78c1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:17.220016 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9ad59-7078-4938-8029-b2a312e819a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:17.221195 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9ad59-7078-4938-8029-b2a312e819a1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:17.221682 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9ad59-7078-4938-8029-b2a312e819a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:17.222159 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9ad59-7078-4938-8029-b2a312e819a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:17.234159 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9ad59-7078-4938-8029-b2a312e819a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:17.235954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9ad59-7078-4938-8029-b2a312e819a1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:17.253294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-12d9ad59-7078-4938-8029-b2a312e819a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:17.253294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:17.253294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:17.253294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:17.253294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:17.253294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:17.253294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:17.253294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:17.253294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:17.253294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:17.253294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:17.253294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:17.253294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:17.253294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:17.253294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:17.254158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:17.255054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:17.255054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:17.255054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:17.255054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:17.257252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 437/847] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:17.263796 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b8666-8952-47e5-ada3-b1aea7f19f66 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:17.265428 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b3c01-45e8-48eb-97f9-da67de7f15b7 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:17.265709 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b3c01-45e8-48eb-97f9-da67de7f15b7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:17.265986 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b3c01-45e8-48eb-97f9-da67de7f15b7 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:17.268473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 438/848] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:17.277387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea71c48-b69d-4282-b077-481779b4a9ab None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:17.278290 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea71c48-b69d-4282-b077-481779b4a9ab None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:17.278796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea71c48-b69d-4282-b077-481779b4a9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:17.296464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6ea71c48-b69d-4282-b077-481779b4a9ab None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:17.297941 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6ea71c48-b69d-4282-b077-481779b4a9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:17.362633 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:17.380950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 439/849] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:17.397109 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b8666-8952-47e5-ada3-b1aea7f19f66 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:17.398116 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea71c48-b69d-4282-b077-481779b4a9ab None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:17.411264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:17.452310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472e561-cf6c-423a-8256-3f66f7045b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:17.454053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472e561-cf6c-423a-8256-3f66f7045b49 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:17.454568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472e561-cf6c-423a-8256-3f66f7045b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:17.455069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472e561-cf6c-423a-8256-3f66f7045b49 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:17.456713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472e561-cf6c-423a-8256-3f66f7045b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:17.457378 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472e561-cf6c-423a-8256-3f66f7045b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:17.459405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472e561-cf6c-423a-8256-3f66f7045b49 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:17.476180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 411/850] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:17.481920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472e561-cf6c-423a-8256-3f66f7045b49 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:17.517069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea71c48-b69d-4282-b077-481779b4a9ab None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:17.552525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eaf548-b8dd-40a0-af6f-ed5418562c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:17.553498 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaf548-b8dd-40a0-af6f-ed5418562c6f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:17.553867 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaf548-b8dd-40a0-af6f-ed5418562c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:17.554134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaf548-b8dd-40a0-af6f-ed5418562c6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:17.565607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eaf548-b8dd-40a0-af6f-ed5418562c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d7eaf548-b8dd-40a0-af6f-ed5418562c6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:17.574156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:17.575126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:17.575966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:17.575966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:17.575966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:17.575966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:17.575966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:17.575966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:17.575966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:17.575966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:17.575966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:17.575966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:17.575966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:17.575966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:17.575966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 440/851] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:17:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:17.582312 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eaf548-b8dd-40a0-af6f-ed5418562c6f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:17.604176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472e561-cf6c-423a-8256-3f66f7045b49 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:17.640825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8df756-3276-499c-bc04-9c2ad650861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:17.642097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8df756-3276-499c-bc04-9c2ad650861a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:17.642590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8df756-3276-499c-bc04-9c2ad650861a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:17.643074 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8df756-3276-499c-bc04-9c2ad650861a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:17.650590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8df756-3276-499c-bc04-9c2ad650861a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:17.652355 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8df756-3276-499c-bc04-9c2ad650861a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:17.654597 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:17.656591 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:17.671344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-4e8df756-3276-499c-bc04-9c2ad650861a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:17.671344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:17.671344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:17.671344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:17.671344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:17.671344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:17.671344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:17.671344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:17.671344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:17.671344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:17.671344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:17.671344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:17.671344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:17.671344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:17.671344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:17.672276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:17.673192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:17.673192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:17.673192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:17.673192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:17.673192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:17.673192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:17.673192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:17.673192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:17.675628 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 412/852] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:17.682962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8df756-3276-499c-bc04-9c2ad650861a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:17.694665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eaf548-b8dd-40a0-af6f-ed5418562c6f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:17.730061 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcf9c3-616a-432f-94fe-e82193088b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:17.730732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcf9c3-616a-432f-94fe-e82193088b57 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:17.731012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcf9c3-616a-432f-94fe-e82193088b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:17.731288 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcf9c3-616a-432f-94fe-e82193088b57 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:17.732029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfcf9c3-616a-432f-94fe-e82193088b57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:17.732330 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfcf9c3-616a-432f-94fe-e82193088b57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:17.733913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfcf9c3-616a-432f-94fe-e82193088b57 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:17.742540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 441/853] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:17.747920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcf9c3-616a-432f-94fe-e82193088b57 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:17.793922 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8df756-3276-499c-bc04-9c2ad650861a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:17.829793 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a7c6c-21e4-41cc-849c-dc0d4d1fa69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:17.830558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a7c6c-21e4-41cc-849c-dc0d4d1fa69e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:17.830827 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a7c6c-21e4-41cc-849c-dc0d4d1fa69e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:17.831106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a7c6c-21e4-41cc-849c-dc0d4d1fa69e None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:17.831889 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a7c6c-21e4-41cc-849c-dc0d4d1fa69e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:17.832194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a7c6c-21e4-41cc-849c-dc0d4d1fa69e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:17.833634 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a7c6c-21e4-41cc-849c-dc0d4d1fa69e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:17.850712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 413/854] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:17.852038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a7c6c-21e4-41cc-849c-dc0d4d1fa69e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:17.862743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcf9c3-616a-432f-94fe-e82193088b57 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:17.893515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:17.899911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765dd87-d3c9-4568-a98d-f46983a5d6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:17.901643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765dd87-d3c9-4568-a98d-f46983a5d6bc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:17.902135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765dd87-d3c9-4568-a98d-f46983a5d6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:17.902629 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765dd87-d3c9-4568-a98d-f46983a5d6bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:17.913732 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:17.914289 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765dd87-d3c9-4568-a98d-f46983a5d6bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:17.916731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765dd87-d3c9-4568-a98d-f46983a5d6bc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:17.934805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-6765dd87-d3c9-4568-a98d-f46983a5d6bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:17.934805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:17.934805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:17.934805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:17.934805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:17.934805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:17.934805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:17.934805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:17.934805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:17.934805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:17.934805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:17.934805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:17.934805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:17.934805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:17.934805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:17.935710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:17.936614 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:17.936614 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:17.936614 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:17.936614 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:17.938838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 442/855] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:17.945790 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765dd87-d3c9-4568-a98d-f46983a5d6bc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:17.967282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a7c6c-21e4-41cc-849c-dc0d4d1fa69e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:18.004958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a552d-6a59-4377-a303-2a292331d475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:18.005658 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a552d-6a59-4377-a303-2a292331d475 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:18.005947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a552d-6a59-4377-a303-2a292331d475 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:18.006230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a552d-6a59-4377-a303-2a292331d475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:18.007085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a552d-6a59-4377-a303-2a292331d475 None admin] RBAC: Adding query filter params (role.id=21cd8dfe95a341df92f26899aaae6604, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=9fd7af9bcff947afad3e7de1fe204472) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:18.007405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a552d-6a59-4377-a303-2a292331d475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:18.008944 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a552d-6a59-4377-a303-2a292331d475 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:18.015790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 414/856] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:17:17 2022] GET /identity/v3/role_assignments?user.id=9fd7af9bcff947afad3e7de1fe204472&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=21cd8dfe95a341df92f26899aaae6604 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:18.080918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765dd87-d3c9-4568-a98d-f46983a5d6bc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:18.101558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89d256-930f-4884-a847-45ef4c6be648 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:18.101872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89d256-930f-4884-a847-45ef4c6be648 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:18.102124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89d256-930f-4884-a847-45ef4c6be648 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:18.107683 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 415/857] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:18.109635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17669d6f-19bc-46d1-a7f9-bc79ba570881 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:18.109924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17669d6f-19bc-46d1-a7f9-bc79ba570881 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:18.110205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17669d6f-19bc-46d1-a7f9-bc79ba570881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:18.121440 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48419009-8658-42c6-ac2c-523bddaad623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:18.122172 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48419009-8658-42c6-ac2c-523bddaad623 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:18.122455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48419009-8658-42c6-ac2c-523bddaad623 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:18.122786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48419009-8658-42c6-ac2c-523bddaad623 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:18.123536 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48419009-8658-42c6-ac2c-523bddaad623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:18.123845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48419009-8658-42c6-ac2c-523bddaad623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:18.125260 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48419009-8658-42c6-ac2c-523bddaad623 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:18.129429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-17669d6f-19bc-46d1-a7f9-bc79ba570881 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:18.130639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-17669d6f-19bc-46d1-a7f9-bc79ba570881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:18.139454 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 443/858] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:18.146146 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48419009-8658-42c6-ac2c-523bddaad623 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:18.201572 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:18.230057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 416/859] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:18.252136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17669d6f-19bc-46d1-a7f9-bc79ba570881 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:18.276502 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48419009-8658-42c6-ac2c-523bddaad623 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:18.318334 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:18.320289 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b432cd-c4f4-40cb-9b95-387b6b4ecb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:18.321479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b432cd-c4f4-40cb-9b95-387b6b4ecb52 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:18.321999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b432cd-c4f4-40cb-9b95-387b6b4ecb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:18.322450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b432cd-c4f4-40cb-9b95-387b6b4ecb52 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:18.330657 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b432cd-c4f4-40cb-9b95-387b6b4ecb52 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:18.332293 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b432cd-c4f4-40cb-9b95-387b6b4ecb52 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-92b432cd-c4f4-40cb-9b95-387b6b4ecb52 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:18.349765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:18.350951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:18.352119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:18.352119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:18.352119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:18.352119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:18.352119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:18.352119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:18.352119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:18.352119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:18.352119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 22:17:18.352119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:18.357202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 444/860] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:17:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:18.359498 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b432cd-c4f4-40cb-9b95-387b6b4ecb52 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:18.373361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17669d6f-19bc-46d1-a7f9-bc79ba570881 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:18.418207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b727a4f-d56d-44b6-9d33-1a1c81177d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:18.418950 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b727a4f-d56d-44b6-9d33-1a1c81177d63 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:18.419264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b727a4f-d56d-44b6-9d33-1a1c81177d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:18.419664 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b727a4f-d56d-44b6-9d33-1a1c81177d63 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:18.420349 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b727a4f-d56d-44b6-9d33-1a1c81177d63 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:18.422332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b727a4f-d56d-44b6-9d33-1a1c81177d63 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-1b727a4f-d56d-44b6-9d33-1a1c81177d63 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:18.437987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:18.438958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:18.439896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:18.439896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:18.439896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:18.439896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:18.439896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:18.439896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:18.439896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:18.439896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:18.439896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:18.439896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:18.439896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:18.439896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:18.439896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:18.439896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:17:18.439896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:18.444626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 417/861] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Jul 21 22:17:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:18.447614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b727a4f-d56d-44b6-9d33-1a1c81177d63 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:18.470643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b432cd-c4f4-40cb-9b95-387b6b4ecb52 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:18.473689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:18.517453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74a26e-ed4f-46f9-9538-2560436f92e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:18.518128 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74a26e-ed4f-46f9-9538-2560436f92e5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:18.518406 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74a26e-ed4f-46f9-9538-2560436f92e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:18.518709 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74a26e-ed4f-46f9-9538-2560436f92e5 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:18.519524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74a26e-ed4f-46f9-9538-2560436f92e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:18.519838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74a26e-ed4f-46f9-9538-2560436f92e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:18.521289 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74a26e-ed4f-46f9-9538-2560436f92e5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:18.544691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 445/862] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jul 21 22:17:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:18.545804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74a26e-ed4f-46f9-9538-2560436f92e5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:18.578999 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b727a4f-d56d-44b6-9d33-1a1c81177d63 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:18.596620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:18.616626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25957e-3b67-4f86-a50c-91824d3dfedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:18.617381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25957e-3b67-4f86-a50c-91824d3dfedc None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:18.617661 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25957e-3b67-4f86-a50c-91824d3dfedc None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:18.617938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25957e-3b67-4f86-a50c-91824d3dfedc None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:18.618742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25957e-3b67-4f86-a50c-91824d3dfedc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:18.619049 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25957e-3b67-4f86-a50c-91824d3dfedc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:18.620456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25957e-3b67-4f86-a50c-91824d3dfedc None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:18.625527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 418/863] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jul 21 22:17:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:18.630746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25957e-3b67-4f86-a50c-91824d3dfedc None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:18.686234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74a26e-ed4f-46f9-9538-2560436f92e5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:18.727484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a789457-b738-4bb1-9e62-051adf6ed0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:18.728144 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a789457-b738-4bb1-9e62-051adf6ed0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:18.728427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a789457-b738-4bb1-9e62-051adf6ed0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:18.728701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a789457-b738-4bb1-9e62-051adf6ed0c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:18.752768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25957e-3b67-4f86-a50c-91824d3dfedc None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:18.768948 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:18.803984 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ca77f-c57a-438d-825d-6e7ee166465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:18.804917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ca77f-c57a-438d-825d-6e7ee166465c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:18.805238 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ca77f-c57a-438d-825d-6e7ee166465c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:18.805512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ca77f-c57a-438d-825d-6e7ee166465c None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:18.806256 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ca77f-c57a-438d-825d-6e7ee166465c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:18.806612 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ca77f-c57a-438d-825d-6e7ee166465c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:18.808947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ca77f-c57a-438d-825d-6e7ee166465c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:18.810654 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a789457-b738-4bb1-9e62-051adf6ed0c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:18.812758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a789457-b738-4bb1-9e62-051adf6ed0c3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:18.814391 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 419/864] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jul 21 22:17:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:18.932309 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 446/865] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:17:18 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 22:17:18.938447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ca77f-c57a-438d-825d-6e7ee166465c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:18.960906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd625e-ca91-491b-bf53-2bb43e057eb9 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:18.961647 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd625e-ca91-491b-bf53-2bb43e057eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:18.962239 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd625e-ca91-491b-bf53-2bb43e057eb9 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:18.963975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 447/866] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:18.970340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ccb46-db28-41ff-9420-d5b93f2344fb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:18.970628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ccb46-db28-41ff-9420-d5b93f2344fb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:18.970888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ccb46-db28-41ff-9420-d5b93f2344fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:18.988055 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d34ccb46-db28-41ff-9420-d5b93f2344fb None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:18.989410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d34ccb46-db28-41ff-9420-d5b93f2344fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:18.994276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:19.053468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:19.064969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 448/867] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:19.073719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ca77f-c57a-438d-825d-6e7ee166465c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:19.089136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ccb46-db28-41ff-9420-d5b93f2344fb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:19.114484 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bca15-9ede-441c-9b7a-f126c12010b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:19.115341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bca15-9ede-441c-9b7a-f126c12010b5 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:19.115642 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bca15-9ede-441c-9b7a-f126c12010b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:19.115950 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bca15-9ede-441c-9b7a-f126c12010b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:19.128696 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bca15-9ede-441c-9b7a-f126c12010b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:19.130195 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bca15-9ede-441c-9b7a-f126c12010b5 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:19.150094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-5f5bca15-9ede-441c-9b7a-f126c12010b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:19.150094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:19.150094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:19.150094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:19.150094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:19.150094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:19.150094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:19.150094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:19.150094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:19.150094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:19.150094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:19.150094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:19.150094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:19.150094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:19.150094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:19.151020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:19.151902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:19.151902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:19.151902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:19.151902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:19.151902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 420/868] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:19.164640 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bca15-9ede-441c-9b7a-f126c12010b5 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:19.227903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ccb46-db28-41ff-9420-d5b93f2344fb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:19.265832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38de2c-fd40-413e-9a53-64d7b1e034ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:19.266902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38de2c-fd40-413e-9a53-64d7b1e034ba None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:19.267406 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38de2c-fd40-413e-9a53-64d7b1e034ba None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:19.267902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38de2c-fd40-413e-9a53-64d7b1e034ba None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:19.268815 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38de2c-fd40-413e-9a53-64d7b1e034ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:19.270401 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38de2c-fd40-413e-9a53-64d7b1e034ba None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:19.298197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 449/869] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jul 21 22:17:19 2022] POST /identity/v3/services => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:17:19.342774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:19.349178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bca15-9ede-441c-9b7a-f126c12010b5 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:19.419318 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e87fa3-2cd8-4a3e-aab6-5d148bc91f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:19.420009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e87fa3-2cd8-4a3e-aab6-5d148bc91f34 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:19.420295 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e87fa3-2cd8-4a3e-aab6-5d148bc91f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:19.420574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e87fa3-2cd8-4a3e-aab6-5d148bc91f34 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:19.421612 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e87fa3-2cd8-4a3e-aab6-5d148bc91f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:19.421929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e87fa3-2cd8-4a3e-aab6-5d148bc91f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:19.423382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e87fa3-2cd8-4a3e-aab6-5d148bc91f34 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:19.438848 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 421/870] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:19.443991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38de2c-fd40-413e-9a53-64d7b1e034ba None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:19.501885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:19.563359 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38de2c-fd40-413e-9a53-64d7b1e034ba None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:19.601473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972706e-1f41-4201-8237-636ba2715a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:19.602282 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972706e-1f41-4201-8237-636ba2715a08 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:19.602563 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972706e-1f41-4201-8237-636ba2715a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:19.602908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972706e-1f41-4201-8237-636ba2715a08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:19.611976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972706e-1f41-4201-8237-636ba2715a08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:19.615098 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972706e-1f41-4201-8237-636ba2715a08 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:19.635186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-e972706e-1f41-4201-8237-636ba2715a08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:19.635186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:19.635186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:19.635186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:19.635186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:19.635186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:19.635186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:19.635186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:19.635186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:19.635186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:19.635186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:19.635186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:19.635186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:19.635186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:19.635186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:19.636109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:19.637002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:19.637002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:19.637002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:19.637002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:19.637002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:19.637002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:19.637002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:19.637002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:19.642678 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e87fa3-2cd8-4a3e-aab6-5d148bc91f34 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:19.651073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 450/871] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:19.793359 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e87fa3-2cd8-4a3e-aab6-5d148bc91f34 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:19.855373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b1874-4a25-40fd-a678-a6899aef5534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:19.856037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b1874-4a25-40fd-a678-a6899aef5534 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:19.856318 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b1874-4a25-40fd-a678-a6899aef5534 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:19.856593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b1874-4a25-40fd-a678-a6899aef5534 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:19.857414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b1874-4a25-40fd-a678-a6899aef5534 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:19.857719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b1874-4a25-40fd-a678-a6899aef5534 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:19.859135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b1874-4a25-40fd-a678-a6899aef5534 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:19.871279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 422/872] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:19.877204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972706e-1f41-4201-8237-636ba2715a08 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:19.980153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972706e-1f41-4201-8237-636ba2715a08 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:19.994599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:20.016358 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679b31b-a82f-4c5d-8f89-1dffad1acfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:20.017049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679b31b-a82f-4c5d-8f89-1dffad1acfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:20.017332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679b31b-a82f-4c5d-8f89-1dffad1acfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:20.017605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679b31b-a82f-4c5d-8f89-1dffad1acfa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:20.018436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679b31b-a82f-4c5d-8f89-1dffad1acfa7 None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=16a38d4a306748aa8f2e72ceb7f629e2) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:20.018744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679b31b-a82f-4c5d-8f89-1dffad1acfa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:20.020168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679b31b-a82f-4c5d-8f89-1dffad1acfa7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:20.027160 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 451/873] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:17:19 2022] GET /identity/v3/role_assignments?user.id=16a38d4a306748aa8f2e72ceb7f629e2&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:20.448642 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91385f3d-2f76-4419-935a-1b90825e588d None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:20.448642 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91385f3d-2f76-4419-935a-1b90825e588d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:20.448642 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91385f3d-2f76-4419-935a-1b90825e588d None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:20.449776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 423/874] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:20.455271 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f9b23-541c-4323-813f-741303cbfae7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:20.456078 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f9b23-541c-4323-813f-741303cbfae7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:20.456558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f9b23-541c-4323-813f-741303cbfae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:20.474375 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3d3f9b23-541c-4323-813f-741303cbfae7 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:20.475891 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3d3f9b23-541c-4323-813f-741303cbfae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:20.549378 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 452/875] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:20 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:20.573913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91385f3d-2f76-4419-935a-1b90825e588d None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:20.591338 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:20.682668 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91385f3d-2f76-4419-935a-1b90825e588d None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:20.717124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef55b6b-673e-4489-8863-bb7f2f544f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:20.718282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef55b6b-673e-4489-8863-bb7f2f544f13 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:20.718783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef55b6b-673e-4489-8863-bb7f2f544f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:20.719298 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef55b6b-673e-4489-8863-bb7f2f544f13 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:20.730379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef55b6b-673e-4489-8863-bb7f2f544f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-2ef55b6b-673e-4489-8863-bb7f2f544f13 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:20.739098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:20.740094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:20.740945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:20.740945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:20.740945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:20.740945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:20.740945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:20.740945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:20.740945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:20.740945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:20.740945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:20.740945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:20.740945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:17:20.740945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:20.749133 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 424/876] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jul 21 22:17:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:20.750903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f9b23-541c-4323-813f-741303cbfae7 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:20.855418 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f9b23-541c-4323-813f-741303cbfae7 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:20.862855 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:20.891584 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15e252-35b6-4f32-ac48-7063e13a7f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:20.892257 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e252-35b6-4f32-ac48-7063e13a7f6a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:20.892541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e252-35b6-4f32-ac48-7063e13a7f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:20.892818 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15e252-35b6-4f32-ac48-7063e13a7f6a None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:20.893596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15e252-35b6-4f32-ac48-7063e13a7f6a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:20.893901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15e252-35b6-4f32-ac48-7063e13a7f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:20.895268 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15e252-35b6-4f32-ac48-7063e13a7f6a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:20.903862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 453/877] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jul 21 22:17:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:20.910259 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef55b6b-673e-4489-8863-bb7f2f544f13 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:20.985047 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:21.016976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef55b6b-673e-4489-8863-bb7f2f544f13 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:21.025523 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacc1e5-787a-46a6-891f-b1e9512fadb0 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:21.025813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacc1e5-787a-46a6-891f-b1e9512fadb0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:21.026093 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacc1e5-787a-46a6-891f-b1e9512fadb0 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:21.027943 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 454/878] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:21.033287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2055938-2df2-410c-abec-50d75ce83799 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:21.033578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2055938-2df2-410c-abec-50d75ce83799 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:21.033864 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2055938-2df2-410c-abec-50d75ce83799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:21.050744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e2055938-2df2-410c-abec-50d75ce83799 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:21.051946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e2055938-2df2-410c-abec-50d75ce83799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:21.052683 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b940871-b210-4dda-87f9-53f9107cbc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:21.053529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b940871-b210-4dda-87f9-53f9107cbc15 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:21.053811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b940871-b210-4dda-87f9-53f9107cbc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:21.054346 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b940871-b210-4dda-87f9-53f9107cbc15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:21.066080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b940871-b210-4dda-87f9-53f9107cbc15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:21.067596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b940871-b210-4dda-87f9-53f9107cbc15 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:21.085742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-4b940871-b210-4dda-87f9-53f9107cbc15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:21.085742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:21.085742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:21.085742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:21.085742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:21.085742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:21.085742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:21.085742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:21.085742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:21.085742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:21.085742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:21.085742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:21.085742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:21.085742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:21.085742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:21.086818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:21.087924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:21.087924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:21.087924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:21.087924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:21.089029 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 425/879] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:21.093009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b940871-b210-4dda-87f9-53f9107cbc15 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:21.137205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 455/880] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:21 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:21.154936 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2055938-2df2-410c-abec-50d75ce83799 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:21.215526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b940871-b210-4dda-87f9-53f9107cbc15 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:21.245262 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:21.260351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94535d1f-0e8d-49b3-9c67-b6c123ad899f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:21.261185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94535d1f-0e8d-49b3-9c67-b6c123ad899f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:21.261492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94535d1f-0e8d-49b3-9c67-b6c123ad899f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:21.261777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94535d1f-0e8d-49b3-9c67-b6c123ad899f None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:21.262532 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94535d1f-0e8d-49b3-9c67-b6c123ad899f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:21.262845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94535d1f-0e8d-49b3-9c67-b6c123ad899f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:21.264244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94535d1f-0e8d-49b3-9c67-b6c123ad899f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:21.276704 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 426/881] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:21.281755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2055938-2df2-410c-abec-50d75ce83799 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:21.283507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:21.284853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94535d1f-0e8d-49b3-9c67-b6c123ad899f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:21.332522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b58e91-96a7-49ce-bb3e-d1667b2abe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:21.333383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b58e91-96a7-49ce-bb3e-d1667b2abe09 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:21.333773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b58e91-96a7-49ce-bb3e-d1667b2abe09 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:21.334154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b58e91-96a7-49ce-bb3e-d1667b2abe09 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:21.335021 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b58e91-96a7-49ce-bb3e-d1667b2abe09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:21.336961 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b58e91-96a7-49ce-bb3e-d1667b2abe09 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:21.361014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 456/882] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jul 21 22:17:21 2022] POST /identity/v3/services => generated 269 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:17:21.418715 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94535d1f-0e8d-49b3-9c67-b6c123ad899f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:21.465149 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbbec0-7cc9-4586-9439-7a24567163d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:21.465982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbbec0-7cc9-4586-9439-7a24567163d8 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:21.466266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbbec0-7cc9-4586-9439-7a24567163d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:21.466540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbbec0-7cc9-4586-9439-7a24567163d8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:21.474836 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbbec0-7cc9-4586-9439-7a24567163d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:21.476300 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbbec0-7cc9-4586-9439-7a24567163d8 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-9efbbec0-7cc9-4586-9439-7a24567163d8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:21.494166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:21.495852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:21.498067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:21.498067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:21.498067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:21.498067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:21.498067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:21.498067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:21.498067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:21.498067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:21.498067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:17:21.498067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:21.498067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 427/883] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jul 21 22:17:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:21.501319 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b58e91-96a7-49ce-bb3e-d1667b2abe09 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:21.583873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a35ad7-57f8-48aa-8ad5-f707e13dd176 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:21.584560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a35ad7-57f8-48aa-8ad5-f707e13dd176 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:21.585065 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a35ad7-57f8-48aa-8ad5-f707e13dd176 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:21.587109 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 428/884] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:21.592465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15457e5e-4848-4a0f-be28-669efc069743 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:21.593085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15457e5e-4848-4a0f-be28-669efc069743 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:21.593085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15457e5e-4848-4a0f-be28-669efc069743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:21.609422 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b58e91-96a7-49ce-bb3e-d1667b2abe09 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:21.611107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-15457e5e-4848-4a0f-be28-669efc069743 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:21.613227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-15457e5e-4848-4a0f-be28-669efc069743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:21.653147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ac3dd-6c8f-4e05-b1e0-9b03bc853338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:21.653886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ac3dd-6c8f-4e05-b1e0-9b03bc853338 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:21.654169 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ac3dd-6c8f-4e05-b1e0-9b03bc853338 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:21.654484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ac3dd-6c8f-4e05-b1e0-9b03bc853338 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:21.655333 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ac3dd-6c8f-4e05-b1e0-9b03bc853338 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:21.655647 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ac3dd-6c8f-4e05-b1e0-9b03bc853338 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:21.657213 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ac3dd-6c8f-4e05-b1e0-9b03bc853338 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:21.658376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:21.685015 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 457/885] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jul 21 22:17:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:21.689007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ac3dd-6c8f-4e05-b1e0-9b03bc853338 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:21.703364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 429/886] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:21.713300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:21.727328 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15457e5e-4848-4a0f-be28-669efc069743 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:21.795750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ac3dd-6c8f-4e05-b1e0-9b03bc853338 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:21.830431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15457e5e-4848-4a0f-be28-669efc069743 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:21.832623 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d363a-4385-4dfa-9f97-271dfffc35f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:21.833565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d363a-4385-4dfa-9f97-271dfffc35f0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:21.834072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d363a-4385-4dfa-9f97-271dfffc35f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:21.834550 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d363a-4385-4dfa-9f97-271dfffc35f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:21.867864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3add6-b2de-47e3-8385-3fb74e953297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:21.868660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3add6-b2de-47e3-8385-3fb74e953297 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:21.868956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3add6-b2de-47e3-8385-3fb74e953297 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:21.869250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3add6-b2de-47e3-8385-3fb74e953297 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:21.869912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3add6-b2de-47e3-8385-3fb74e953297 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:21.871342 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3add6-b2de-47e3-8385-3fb74e953297 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-e3b3add6-b2de-47e3-8385-3fb74e953297 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:21.883455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:21.884501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:21.885394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:21.885394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:21.885394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:21.885394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:21.885394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:21.885394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:21.885394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:21.885394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:21.885394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:21.885394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:21.885394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:21.885394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:21.885394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:17:21.885394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:21.885394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 430/887] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:17:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:21.890715 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3add6-b2de-47e3-8385-3fb74e953297 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:21.912908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d363a-4385-4dfa-9f97-271dfffc35f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:21.914648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d363a-4385-4dfa-9f97-271dfffc35f0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:21.932248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:21.933712 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:22.007702 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3add6-b2de-47e3-8385-3fb74e953297 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:22.021076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 458/888] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:17:21 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 22:17:22.027322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d363a-4385-4dfa-9f97-271dfffc35f0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:22.045207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79e7a6-2570-4275-8245-450f3846d56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:22.046217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79e7a6-2570-4275-8245-450f3846d56c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:22.046330 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79e7a6-2570-4275-8245-450f3846d56c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:22.046509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79e7a6-2570-4275-8245-450f3846d56c None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:22.047223 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79e7a6-2570-4275-8245-450f3846d56c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:22.047529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79e7a6-2570-4275-8245-450f3846d56c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:22.049024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79e7a6-2570-4275-8245-450f3846d56c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:22.056846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 431/889] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:17:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:22.065657 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79e7a6-2570-4275-8245-450f3846d56c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:22.151081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d363a-4385-4dfa-9f97-271dfffc35f0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:22.167618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:22.179395 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:22.184494 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79e7a6-2570-4275-8245-450f3846d56c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:22.185875 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dce7b-d814-4c65-899d-b58caddd8100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:22.186678 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dce7b-d814-4c65-899d-b58caddd8100 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:22.186963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dce7b-d814-4c65-899d-b58caddd8100 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:22.187248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dce7b-d814-4c65-899d-b58caddd8100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:22.197838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131dce7b-d814-4c65-899d-b58caddd8100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:22.199272 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131dce7b-d814-4c65-899d-b58caddd8100 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:22.216850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-131dce7b-d814-4c65-899d-b58caddd8100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:22.216850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:22.216850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:22.216850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:22.216850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:22.216850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:22.216850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:22.216850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:22.216850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:22.216850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:22.216850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:22.216850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:22.216850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:22.216850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:22.216850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:22.217769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:22.218659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:22.218659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:22.218659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:22.218659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:22.218659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 459/890] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:22.219243 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2970ca5-4d90-46ab-8b5d-44685b430cb3 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:22.219530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2970ca5-4d90-46ab-8b5d-44685b430cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:22.219806 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2970ca5-4d90-46ab-8b5d-44685b430cb3 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:22.221226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 460/891] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:22.224316 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2970ca5-4d90-46ab-8b5d-44685b430cb3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:22.229790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005da25d-0059-4727-b91e-358e40a6062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:22.230711 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da25d-0059-4727-b91e-358e40a6062c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:22.231180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da25d-0059-4727-b91e-358e40a6062c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:22.231637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da25d-0059-4727-b91e-358e40a6062c None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:22.232653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005da25d-0059-4727-b91e-358e40a6062c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:22.232999 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005da25d-0059-4727-b91e-358e40a6062c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:22.234487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005da25d-0059-4727-b91e-358e40a6062c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:22.244367 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 432/892] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:17:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:22.245785 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd3a6c-e172-46cf-8725-d0681a4038c4 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:22.246072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd3a6c-e172-46cf-8725-d0681a4038c4 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:22.246351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd3a6c-e172-46cf-8725-d0681a4038c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:22.263516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-4cfd3a6c-e172-46cf-8725-d0681a4038c4 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:22.264688 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4cfd3a6c-e172-46cf-8725-d0681a4038c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:22.327141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2970ca5-4d90-46ab-8b5d-44685b430cb3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:22.345195 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 433/893] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:22.345912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd3a6c-e172-46cf-8725-d0681a4038c4 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:22.363710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f577a-0902-4e55-a862-6bffd4175bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:22.364640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f577a-0902-4e55-a862-6bffd4175bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:22.365009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f577a-0902-4e55-a862-6bffd4175bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:22.365283 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f577a-0902-4e55-a862-6bffd4175bd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:22.365974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f577a-0902-4e55-a862-6bffd4175bd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:22.366287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f577a-0902-4e55-a862-6bffd4175bd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:22.367664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f577a-0902-4e55-a862-6bffd4175bd0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:22.385767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 461/894] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:22.385767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f577a-0902-4e55-a862-6bffd4175bd0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:22.414410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:22.445523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:22.456323 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd3a6c-e172-46cf-8725-d0681a4038c4 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:22.489683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f577a-0902-4e55-a862-6bffd4175bd0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:22.490564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb78a1-8869-4145-a922-3b850a0a1957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:22.491257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb78a1-8869-4145-a922-3b850a0a1957 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:22.491543 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb78a1-8869-4145-a922-3b850a0a1957 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:22.491797 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb78a1-8869-4145-a922-3b850a0a1957 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:22.492593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb78a1-8869-4145-a922-3b850a0a1957 None admin] RBAC: Adding query filter params (interface=public, service_id=afc6475230814af8b9a1c5c824c063ea, region_id=RegionOne) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:22.492942 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb78a1-8869-4145-a922-3b850a0a1957 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:22.494806 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb78a1-8869-4145-a922-3b850a0a1957 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:22.504099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 434/895] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jul 21 22:17:22 2022] GET /identity/v3/endpoints?service_id=afc6475230814af8b9a1c5c824c063ea&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:22.504099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb78a1-8869-4145-a922-3b850a0a1957 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:22.529932 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4f5bc-3cd0-4068-aec1-4f927ba195d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:22.530846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4f5bc-3cd0-4068-aec1-4f927ba195d6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:22.531201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4f5bc-3cd0-4068-aec1-4f927ba195d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:22.531548 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4f5bc-3cd0-4068-aec1-4f927ba195d6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:22.532293 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4f5bc-3cd0-4068-aec1-4f927ba195d6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:22.533768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4f5bc-3cd0-4068-aec1-4f927ba195d6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9fa4f5bc-3cd0-4068-aec1-4f927ba195d6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:22.546488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:22.547544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:22.548374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:22.548374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:22.548374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:22.548374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:22.548374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:22.548374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:22.548374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:22.548374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:22.548374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:22.548374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:22.548374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:22.548374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:22.548374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:17:22.548374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:22.548374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 462/896] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jul 21 22:17:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:22.549204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4f5bc-3cd0-4068-aec1-4f927ba195d6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:22.617653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb78a1-8869-4145-a922-3b850a0a1957 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:22.644749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:22.655392 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32b6c4-1b87-4bd3-b836-9f21b774565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:22.655729 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4f5bc-3cd0-4068-aec1-4f927ba195d6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:22.656202 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32b6c4-1b87-4bd3-b836-9f21b774565b None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:22.656492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32b6c4-1b87-4bd3-b836-9f21b774565b None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:22.656771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32b6c4-1b87-4bd3-b836-9f21b774565b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:22.666039 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32b6c4-1b87-4bd3-b836-9f21b774565b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:22.667807 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32b6c4-1b87-4bd3-b836-9f21b774565b None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:22.681788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-3e32b6c4-1b87-4bd3-b836-9f21b774565b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:22.681788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:22.681788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:22.681788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:22.681788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:22.681788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:22.681788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:22.681788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:22.681788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:22.681788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:22.681788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:22.681788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:22.681788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:22.681788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:22.681788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:22.682673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:22.683581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:22.683581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:22.683581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:22.683581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:22.683581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:22.683581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:22.683581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:22.683581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:22.683581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 435/897] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:22.684060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32b6c4-1b87-4bd3-b836-9f21b774565b None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:22.695516 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba2cd3-a1ad-41b1-9b36-ce7aa150d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:22.696208 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2cd3-a1ad-41b1-9b36-ce7aa150d6fb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:22.696499 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2cd3-a1ad-41b1-9b36-ce7aa150d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:22.696781 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba2cd3-a1ad-41b1-9b36-ce7aa150d6fb None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:22.697513 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba2cd3-a1ad-41b1-9b36-ce7aa150d6fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:22.698933 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba2cd3-a1ad-41b1-9b36-ce7aa150d6fb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:22.704492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:22.713142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 463/898] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jul 21 22:17:22 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:17:22.715279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba2cd3-a1ad-41b1-9b36-ce7aa150d6fb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:22.806622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32b6c4-1b87-4bd3-b836-9f21b774565b None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:22.846315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4089c1-92a0-41ec-8c54-95b10a7c744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:22.847055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4089c1-92a0-41ec-8c54-95b10a7c744f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:22.847339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4089c1-92a0-41ec-8c54-95b10a7c744f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:22.847625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4089c1-92a0-41ec-8c54-95b10a7c744f None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:22.848349 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4089c1-92a0-41ec-8c54-95b10a7c744f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:22.848658 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4089c1-92a0-41ec-8c54-95b10a7c744f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:22.850134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4089c1-92a0-41ec-8c54-95b10a7c744f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:22.855658 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 436/899] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jul 21 22:17:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:22.861273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4089c1-92a0-41ec-8c54-95b10a7c744f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:22.874710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba2cd3-a1ad-41b1-9b36-ce7aa150d6fb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:22.914059 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96877676-ff0e-477a-9ff6-c33f6890e9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:22.915129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96877676-ff0e-477a-9ff6-c33f6890e9ec None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:22.915617 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96877676-ff0e-477a-9ff6-c33f6890e9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:22.916095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96877676-ff0e-477a-9ff6-c33f6890e9ec None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:22.917216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96877676-ff0e-477a-9ff6-c33f6890e9ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:22.917729 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96877676-ff0e-477a-9ff6-c33f6890e9ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:22.919517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96877676-ff0e-477a-9ff6-c33f6890e9ec None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:22.932989 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 464/900] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:22.939080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96877676-ff0e-477a-9ff6-c33f6890e9ec None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:22.964269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:22.972118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:22.994162 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4089c1-92a0-41ec-8c54-95b10a7c744f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:23.031566 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539f30f-3c5d-4200-8948-86580d3d9128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:23.032241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539f30f-3c5d-4200-8948-86580d3d9128 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:23.032526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539f30f-3c5d-4200-8948-86580d3d9128 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:23.032806 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539f30f-3c5d-4200-8948-86580d3d9128 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:23.033547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539f30f-3c5d-4200-8948-86580d3d9128 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:23.033853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539f30f-3c5d-4200-8948-86580d3d9128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:23.035922 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539f30f-3c5d-4200-8948-86580d3d9128 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:23.040545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 437/901] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jul 21 22:17:22 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:23.068918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96877676-ff0e-477a-9ff6-c33f6890e9ec None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:23.108181 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91efb95-992d-4fe2-9238-7772f0a8e1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:23.108862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91efb95-992d-4fe2-9238-7772f0a8e1ec None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:23.109179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91efb95-992d-4fe2-9238-7772f0a8e1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:23.109458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91efb95-992d-4fe2-9238-7772f0a8e1ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:23.110319 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91efb95-992d-4fe2-9238-7772f0a8e1ec None admin] RBAC: Adding query filter params (role.id=7e4df69fe73e4323b8a543ee45b8c60c, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=9fd7af9bcff947afad3e7de1fe204472) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:23.110633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91efb95-992d-4fe2-9238-7772f0a8e1ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:23.112103 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91efb95-992d-4fe2-9238-7772f0a8e1ec None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:23.125183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 465/902] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:17:22 2022] GET /identity/v3/role_assignments?user.id=9fd7af9bcff947afad3e7de1fe204472&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=7e4df69fe73e4323b8a543ee45b8c60c => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:23.510388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95661250-fe92-4773-8238-50063ba074ff None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:23.510906 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95661250-fe92-4773-8238-50063ba074ff None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:23.511013 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95661250-fe92-4773-8238-50063ba074ff None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:23.512559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 438/903] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:23.517738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80ca6b-71e7-4f3a-be29-56669a305c3e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:23.518027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80ca6b-71e7-4f3a-be29-56669a305c3e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:23.518306 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80ca6b-71e7-4f3a-be29-56669a305c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:23.535224 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2a80ca6b-71e7-4f3a-be29-56669a305c3e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:23.536390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2a80ca6b-71e7-4f3a-be29-56669a305c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:23.603476 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 466/904] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:23.626166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95661250-fe92-4773-8238-50063ba074ff None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:23.729570 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95661250-fe92-4773-8238-50063ba074ff None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:23.765208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486492c-bdde-45ee-b92e-47bb4a3238b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:23.765941 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486492c-bdde-45ee-b92e-47bb4a3238b8 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:23.766238 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486492c-bdde-45ee-b92e-47bb4a3238b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:23.766507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486492c-bdde-45ee-b92e-47bb4a3238b8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:23.767155 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486492c-bdde-45ee-b92e-47bb4a3238b8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:23.768537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486492c-bdde-45ee-b92e-47bb4a3238b8 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-f486492c-bdde-45ee-b92e-47bb4a3238b8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:23.781481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:23.783521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:23.784607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 439/905] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Jul 21 22:17:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:23.788615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80ca6b-71e7-4f3a-be29-56669a305c3e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:23.807231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:23.900223 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80ca6b-71e7-4f3a-be29-56669a305c3e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:23.935515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec066396-0f09-463c-928f-19e2d0b495a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:23.936509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec066396-0f09-463c-928f-19e2d0b495a6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:23.937056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec066396-0f09-463c-928f-19e2d0b495a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:23.937536 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec066396-0f09-463c-928f-19e2d0b495a6 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:23.938434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec066396-0f09-463c-928f-19e2d0b495a6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:23.938971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec066396-0f09-463c-928f-19e2d0b495a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:23.940595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec066396-0f09-463c-928f-19e2d0b495a6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:23.945967 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 467/906] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jul 21 22:17:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:23.953982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486492c-bdde-45ee-b92e-47bb4a3238b8 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:23.966362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:24.059120 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486492c-bdde-45ee-b92e-47bb4a3238b8 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:24.094339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa697444-204e-4b06-b279-54b89fb25f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:24.095015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa697444-204e-4b06-b279-54b89fb25f58 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:24.095301 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa697444-204e-4b06-b279-54b89fb25f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:24.095580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa697444-204e-4b06-b279-54b89fb25f58 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:24.096284 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa697444-204e-4b06-b279-54b89fb25f58 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:24.096590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa697444-204e-4b06-b279-54b89fb25f58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:24.097975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa697444-204e-4b06-b279-54b89fb25f58 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:24.103831 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 440/907] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jul 21 22:17:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:24.110006 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec066396-0f09-463c-928f-19e2d0b495a6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:24.185261 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:24.209353 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec066396-0f09-463c-928f-19e2d0b495a6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:24.250025 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77120b-6666-40d6-a429-a66f816cdb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:24.250698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77120b-6666-40d6-a429-a66f816cdb8d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:24.250984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77120b-6666-40d6-a429-a66f816cdb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:24.251260 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77120b-6666-40d6-a429-a66f816cdb8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:24.252059 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77120b-6666-40d6-a429-a66f816cdb8d None admin] RBAC: Adding query filter params (interface=public, service_id=a49bbf0bd1f14a53a806c0d0ae4b4f01, region_id=RegionOne) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:24.252372 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77120b-6666-40d6-a429-a66f816cdb8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:24.253777 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77120b-6666-40d6-a429-a66f816cdb8d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:24.262533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 468/908] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jul 21 22:17:24 2022] GET /identity/v3/endpoints?service_id=a49bbf0bd1f14a53a806c0d0ae4b4f01&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:24.270023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa697444-204e-4b06-b279-54b89fb25f58 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:24.348767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:24.380383 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa697444-204e-4b06-b279-54b89fb25f58 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:24.416203 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50551698-6fbf-46c4-a81e-2ebb12c01b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:24.416906 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50551698-6fbf-46c4-a81e-2ebb12c01b6c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:24.417227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50551698-6fbf-46c4-a81e-2ebb12c01b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:24.417508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50551698-6fbf-46c4-a81e-2ebb12c01b6c None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:24.418193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50551698-6fbf-46c4-a81e-2ebb12c01b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:24.419557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50551698-6fbf-46c4-a81e-2ebb12c01b6c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:24.425823 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 441/909] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jul 21 22:17:24 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:17:24.839014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1ae69-e11d-41a7-8c50-a11b25a73125 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:24.839564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1ae69-e11d-41a7-8c50-a11b25a73125 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:24.839564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1ae69-e11d-41a7-8c50-a11b25a73125 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:24.841222 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 469/910] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:24.846379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a8cd3-d5f9-4717-bab5-4f504fb4913a None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:24.846775 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a8cd3-d5f9-4717-bab5-4f504fb4913a None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:24.846958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a8cd3-d5f9-4717-bab5-4f504fb4913a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:24.868207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-355a8cd3-d5f9-4717-bab5-4f504fb4913a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:24.869606 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-355a8cd3-d5f9-4717-bab5-4f504fb4913a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:24.942070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 442/911] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:24.965604 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1ae69-e11d-41a7-8c50-a11b25a73125 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:25.076243 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1ae69-e11d-41a7-8c50-a11b25a73125 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:25.120164 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85785c1d-e52e-497a-bdd1-2f6db0ae1cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:25.120899 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85785c1d-e52e-497a-bdd1-2f6db0ae1cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:25.121205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85785c1d-e52e-497a-bdd1-2f6db0ae1cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:25.121478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85785c1d-e52e-497a-bdd1-2f6db0ae1cb3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:25.122149 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85785c1d-e52e-497a-bdd1-2f6db0ae1cb3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:25.123585 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85785c1d-e52e-497a-bdd1-2f6db0ae1cb3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-85785c1d-e52e-497a-bdd1-2f6db0ae1cb3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:25.136575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:25.137703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:25.139209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:25.139209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:25.139209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:25.139209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:25.139209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:25.139209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:25.139209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:25.139209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:25.139209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:25.139209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:25.139209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:25.139209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:25.139209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 22:17:25.139209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:25.139209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 470/912] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:17:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:25.143705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a8cd3-d5f9-4717-bab5-4f504fb4913a None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:25.214375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:25.229108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b79e7-6194-4d44-a036-363afc28e611 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:25.229436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b79e7-6194-4d44-a036-363afc28e611 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:25.229677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b79e7-6194-4d44-a036-363afc28e611 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:25.231315 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 471/913] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:25.236142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83da6-a6c8-4dcc-a0d1-5b46a67042c4 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:25.236431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83da6-a6c8-4dcc-a0d1-5b46a67042c4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:25.236714 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83da6-a6c8-4dcc-a0d1-5b46a67042c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:25.243993 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:25.256268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a8cd3-d5f9-4717-bab5-4f504fb4913a None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:25.256439 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d2e83da6-a6c8-4dcc-a0d1-5b46a67042c4 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:25.257555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d2e83da6-a6c8-4dcc-a0d1-5b46a67042c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:25.291490 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c375df-75d7-442c-bd25-01f6e8df6229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:25.292159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c375df-75d7-442c-bd25-01f6e8df6229 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:25.292446 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c375df-75d7-442c-bd25-01f6e8df6229 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:25.292726 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c375df-75d7-442c-bd25-01f6e8df6229 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:25.293476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c375df-75d7-442c-bd25-01f6e8df6229 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:25.293773 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c375df-75d7-442c-bd25-01f6e8df6229 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:25.295134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c375df-75d7-442c-bd25-01f6e8df6229 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:25.299951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 443/914] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:17:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:25.300981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92261f4d-d9f9-46b6-9410-b7440f42fe85 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:25.301275 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92261f4d-d9f9-46b6-9410-b7440f42fe85 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:25.301555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92261f4d-d9f9-46b6-9410-b7440f42fe85 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:25.302923 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 444/915] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:25.307937 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92261f4d-d9f9-46b6-9410-b7440f42fe85 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:25.334557 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 472/916] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:25.335826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958f827-7f93-44de-a15a-e54b17d82003 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:25.336122 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958f827-7f93-44de-a15a-e54b17d82003 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:25.336404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958f827-7f93-44de-a15a-e54b17d82003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:25.360641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6958f827-7f93-44de-a15a-e54b17d82003 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:25.361879 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6958f827-7f93-44de-a15a-e54b17d82003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:25.418492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92261f4d-d9f9-46b6-9410-b7440f42fe85 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:25.430374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 473/917] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:25.431296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958f827-7f93-44de-a15a-e54b17d82003 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:25.456235 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:25.464349 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759aa45-2a86-40c1-b671-80fd49944759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:25.465057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759aa45-2a86-40c1-b671-80fd49944759 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:25.465349 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759aa45-2a86-40c1-b671-80fd49944759 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:25.465629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759aa45-2a86-40c1-b671-80fd49944759 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:25.466338 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759aa45-2a86-40c1-b671-80fd49944759 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:25.466648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759aa45-2a86-40c1-b671-80fd49944759 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:25.468022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759aa45-2a86-40c1-b671-80fd49944759 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:25.473212 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 445/918] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jul 21 22:17:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:25.478943 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759aa45-2a86-40c1-b671-80fd49944759 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:25.499025 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:25.549165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958f827-7f93-44de-a15a-e54b17d82003 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:25.583963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759aa45-2a86-40c1-b671-80fd49944759 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:25.587794 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00363583-ccad-4992-80c2-1a39f023f7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:25.588468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00363583-ccad-4992-80c2-1a39f023f7f6 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:25.588758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00363583-ccad-4992-80c2-1a39f023f7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:25.589068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00363583-ccad-4992-80c2-1a39f023f7f6 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:25.589796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00363583-ccad-4992-80c2-1a39f023f7f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:25.591173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00363583-ccad-4992-80c2-1a39f023f7f6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:25.605338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 474/919] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jul 21 22:17:25 2022] POST /identity/v3/services => generated 241 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:17:25.606135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00363583-ccad-4992-80c2-1a39f023f7f6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:25.642945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2e399-1779-492a-91f3-d97de3e72201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:25.644515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2e399-1779-492a-91f3-d97de3e72201 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:25.645018 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2e399-1779-492a-91f3-d97de3e72201 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:25.645545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2e399-1779-492a-91f3-d97de3e72201 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:25.662093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2e399-1779-492a-91f3-d97de3e72201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-aef2e399-1779-492a-91f3-d97de3e72201 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:25.671754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:25.672769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:25.673904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:25.673904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:25.673904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:25.673904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:25.673904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:25.673904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:25.673904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:25.673904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:25.673904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:25.673904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:25.673904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:17:25.673904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:25.673904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 446/920] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jul 21 22:17:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:25.679319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2e399-1779-492a-91f3-d97de3e72201 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:25.739050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00363583-ccad-4992-80c2-1a39f023f7f6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:25.756357 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:25.774742 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:25.805526 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e4e12-22f3-41db-ba67-8a881b21be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:25.807305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e4e12-22f3-41db-ba67-8a881b21be31 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:25.807305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e4e12-22f3-41db-ba67-8a881b21be31 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:25.807305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e4e12-22f3-41db-ba67-8a881b21be31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:25.808340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e4e12-22f3-41db-ba67-8a881b21be31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:25.809444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e4e12-22f3-41db-ba67-8a881b21be31 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:25.829966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2e399-1779-492a-91f3-d97de3e72201 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:25.832273 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 475/921] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jul 21 22:17:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:17:25.886403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf09ef4-ce71-48fd-9616-8bf02ae67c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:25.887118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf09ef4-ce71-48fd-9616-8bf02ae67c6e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:25.891622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf09ef4-ce71-48fd-9616-8bf02ae67c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:25.891622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf09ef4-ce71-48fd-9616-8bf02ae67c6e None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:25.891622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf09ef4-ce71-48fd-9616-8bf02ae67c6e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:25.891622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf09ef4-ce71-48fd-9616-8bf02ae67c6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:25.891622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf09ef4-ce71-48fd-9616-8bf02ae67c6e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:25.900306 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 447/922] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jul 21 22:17:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:25.905901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e4e12-22f3-41db-ba67-8a881b21be31 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:26.022873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e4e12-22f3-41db-ba67-8a881b21be31 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:26.065153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ea160-3b0c-4daf-8dd8-d89e7e6b2cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:26.066383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ea160-3b0c-4daf-8dd8-d89e7e6b2cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:26.066885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ea160-3b0c-4daf-8dd8-d89e7e6b2cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:26.067363 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ea160-3b0c-4daf-8dd8-d89e7e6b2cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:26.079433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ea160-3b0c-4daf-8dd8-d89e7e6b2cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:26.081068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ea160-3b0c-4daf-8dd8-d89e7e6b2cd3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:26.099776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-2d0ea160-3b0c-4daf-8dd8-d89e7e6b2cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:26.099776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:26.099776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:26.099776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:26.099776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:26.099776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:26.099776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:26.099776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:26.099776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:26.099776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:26.099776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:26.099776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:26.099776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:26.099776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:26.099776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:26.100827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:26.101978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:26.101978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:26.101978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:26.101978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:26.101978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 476/923] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:26.107367 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf09ef4-ce71-48fd-9616-8bf02ae67c6e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:26.213244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf09ef4-ce71-48fd-9616-8bf02ae67c6e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:26.226183 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:26.255555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49a92b-d750-4545-941c-59b4d86cf35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:26.256232 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49a92b-d750-4545-941c-59b4d86cf35f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:26.256523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49a92b-d750-4545-941c-59b4d86cf35f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:26.256800 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49a92b-d750-4545-941c-59b4d86cf35f None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:26.257585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49a92b-d750-4545-941c-59b4d86cf35f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:26.257894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49a92b-d750-4545-941c-59b4d86cf35f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:26.259302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49a92b-d750-4545-941c-59b4d86cf35f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:26.272467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 448/924] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:26.278680 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ea160-3b0c-4daf-8dd8-d89e7e6b2cd3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:26.315008 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:26.390230 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ea160-3b0c-4daf-8dd8-d89e7e6b2cd3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:26.426221 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ace8cc-dd34-4f4f-9b10-e8f6b96b5dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:26.427045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ace8cc-dd34-4f4f-9b10-e8f6b96b5dad None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:26.427329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ace8cc-dd34-4f4f-9b10-e8f6b96b5dad None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:26.427608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ace8cc-dd34-4f4f-9b10-e8f6b96b5dad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:26.435193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ace8cc-dd34-4f4f-9b10-e8f6b96b5dad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:26.436650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ace8cc-dd34-4f4f-9b10-e8f6b96b5dad None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-f2ace8cc-dd34-4f4f-9b10-e8f6b96b5dad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:26.452072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:26.453259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:26.454697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:26.454697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:26.454697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:26.454697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:26.454697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:26.454697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:26.454697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:26.454697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:26.454697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:17:26.454697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:26.454697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 477/925] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jul 21 22:17:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:26.462541 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49a92b-d750-4545-941c-59b4d86cf35f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:26.483192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ebd01-ed9a-4f19-a9e9-dfde2811c94a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:26.483501 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ebd01-ed9a-4f19-a9e9-dfde2811c94a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:26.483740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ebd01-ed9a-4f19-a9e9-dfde2811c94a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:26.485366 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 478/926] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:26.490159 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac47e0-50b9-4578-abf0-a07e23bd3636 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:26.490444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac47e0-50b9-4578-abf0-a07e23bd3636 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:26.490724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac47e0-50b9-4578-abf0-a07e23bd3636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:26.514086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-56ac47e0-50b9-4578-abf0-a07e23bd3636 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:26.515587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-56ac47e0-50b9-4578-abf0-a07e23bd3636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:26.569546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49a92b-d750-4545-941c-59b4d86cf35f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:26.602041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 479/927] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:26.615133 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb2f46-726f-4901-863a-1225514889ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:26.615814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb2f46-726f-4901-863a-1225514889ea None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:26.616099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb2f46-726f-4901-863a-1225514889ea None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:26.616383 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb2f46-726f-4901-863a-1225514889ea None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:26.617263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb2f46-726f-4901-863a-1225514889ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:26.617578 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb2f46-726f-4901-863a-1225514889ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:26.619079 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb2f46-726f-4901-863a-1225514889ea None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:26.624126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac47e0-50b9-4578-abf0-a07e23bd3636 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:26.640241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 449/928] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jul 21 22:17:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:26.646673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb2f46-726f-4901-863a-1225514889ea None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:26.662483 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:26.675486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:26.731340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac47e0-50b9-4578-abf0-a07e23bd3636 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:26.752621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb2f46-726f-4901-863a-1225514889ea None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:26.766170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae28f29-c8af-4515-b705-f40c4b24cb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:26.767251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae28f29-c8af-4515-b705-f40c4b24cb99 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:26.767740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae28f29-c8af-4515-b705-f40c4b24cb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:26.768233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae28f29-c8af-4515-b705-f40c4b24cb99 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:26.769115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae28f29-c8af-4515-b705-f40c4b24cb99 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:26.770670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae28f29-c8af-4515-b705-f40c4b24cb99 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-4ae28f29-c8af-4515-b705-f40c4b24cb99 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:26.783780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:26.784718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:26.785583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:26.785583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:26.785583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:26.785583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:26.785583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:26.785583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:26.785583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:26.785583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:26.785583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:26.785583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:26.785583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:26.785583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:26.785583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:26.785583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 22:17:26.785583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:26.792901 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871e4d1-6b13-4424-919e-cae421800225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:26.792901 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871e4d1-6b13-4424-919e-cae421800225 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:26.792901 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871e4d1-6b13-4424-919e-cae421800225 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:26.792901 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871e4d1-6b13-4424-919e-cae421800225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:26.793445 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 480/929] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Jul 21 22:17:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:26.794464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae28f29-c8af-4515-b705-f40c4b24cb99 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:26.802364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871e4d1-6b13-4424-919e-cae421800225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:26.804024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871e4d1-6b13-4424-919e-cae421800225 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:26.823022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-5871e4d1-6b13-4424-919e-cae421800225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:26.823022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:26.823022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:26.823022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:26.823022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:26.823022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:26.823022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:26.823022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:26.823022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:26.823022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:26.823022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:26.823022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:26.823022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:26.823022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:26.823022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:26.823921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:26.824802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:26.824802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:26.824802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:26.824802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:26.829120 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 450/930] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:26.830245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871e4d1-6b13-4424-919e-cae421800225 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:26.889353 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:26.901160 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae28f29-c8af-4515-b705-f40c4b24cb99 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:26.915578 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:26.937746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59130eb-2202-4ecb-ac81-e9673181083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:26.939076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59130eb-2202-4ecb-ac81-e9673181083c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:26.939328 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871e4d1-6b13-4424-919e-cae421800225 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:26.939775 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59130eb-2202-4ecb-ac81-e9673181083c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:26.940251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59130eb-2202-4ecb-ac81-e9673181083c None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:26.941186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59130eb-2202-4ecb-ac81-e9673181083c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:26.941704 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59130eb-2202-4ecb-ac81-e9673181083c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:26.943335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59130eb-2202-4ecb-ac81-e9673181083c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:26.953696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 481/931] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jul 21 22:17:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:26.954849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59130eb-2202-4ecb-ac81-e9673181083c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:26.975704 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a65a3-0634-45ab-b794-d9d49ed9455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:26.976396 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a65a3-0634-45ab-b794-d9d49ed9455c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:26.976661 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a65a3-0634-45ab-b794-d9d49ed9455c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:26.976982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a65a3-0634-45ab-b794-d9d49ed9455c None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:26.977723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a65a3-0634-45ab-b794-d9d49ed9455c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:26.978036 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a65a3-0634-45ab-b794-d9d49ed9455c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:26.979473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a65a3-0634-45ab-b794-d9d49ed9455c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:26.995986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 451/932] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:27.001064 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a65a3-0634-45ab-b794-d9d49ed9455c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:27.062349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59130eb-2202-4ecb-ac81-e9673181083c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:27.098467 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eada2cc-19dc-450d-ad9d-5bd519b7b023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:27.099130 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eada2cc-19dc-450d-ad9d-5bd519b7b023 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:27.099409 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eada2cc-19dc-450d-ad9d-5bd519b7b023 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:27.099684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eada2cc-19dc-450d-ad9d-5bd519b7b023 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:27.100383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eada2cc-19dc-450d-ad9d-5bd519b7b023 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:27.100686 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eada2cc-19dc-450d-ad9d-5bd519b7b023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:27.102084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eada2cc-19dc-450d-ad9d-5bd519b7b023 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:27.111788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 482/933] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jul 21 22:17:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:27.112759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eada2cc-19dc-450d-ad9d-5bd519b7b023 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:27.117964 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a65a3-0634-45ab-b794-d9d49ed9455c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:27.127433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:27.157596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e8286-bb6e-4f64-9c75-db234e504d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:27.158448 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e8286-bb6e-4f64-9c75-db234e504d79 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:27.158738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e8286-bb6e-4f64-9c75-db234e504d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:27.159043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e8286-bb6e-4f64-9c75-db234e504d79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:27.166583 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e8286-bb6e-4f64-9c75-db234e504d79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:27.168027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e8286-bb6e-4f64-9c75-db234e504d79 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:27.169919 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:27.184784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-309e8286-bb6e-4f64-9c75-db234e504d79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:27.184784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:27.184784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:27.184784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:27.184784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:27.184784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:27.184784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:27.184784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:27.184784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:27.184784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:27.184784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:27.184784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:27.184784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:27.184784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:27.184784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:27.185754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:27.186636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:27.186636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:27.186636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:27.186636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:27.186636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:27.186636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:27.186636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:27.186636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:27.190956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 452/934] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:27.191908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e8286-bb6e-4f64-9c75-db234e504d79 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:27.242279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eada2cc-19dc-450d-ad9d-5bd519b7b023 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:27.280257 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e42ce-f2f9-4f0e-b8d8-aee4a986bc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:27.280918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e42ce-f2f9-4f0e-b8d8-aee4a986bc84 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:27.281237 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e42ce-f2f9-4f0e-b8d8-aee4a986bc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:27.281516 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e42ce-f2f9-4f0e-b8d8-aee4a986bc84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:27.282357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e42ce-f2f9-4f0e-b8d8-aee4a986bc84 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:27.283838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e42ce-f2f9-4f0e-b8d8-aee4a986bc84 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:27.298414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e8286-bb6e-4f64-9c75-db234e504d79 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:27.313552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 483/935] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jul 21 22:17:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:17:27.343524 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22337d24-ffcd-40cc-bb65-f5b6fb0a0966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:27.344124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22337d24-ffcd-40cc-bb65-f5b6fb0a0966 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:27.344410 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22337d24-ffcd-40cc-bb65-f5b6fb0a0966 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:27.344688 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22337d24-ffcd-40cc-bb65-f5b6fb0a0966 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:27.345540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22337d24-ffcd-40cc-bb65-f5b6fb0a0966 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:27.345855 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22337d24-ffcd-40cc-bb65-f5b6fb0a0966 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:27.347381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22337d24-ffcd-40cc-bb65-f5b6fb0a0966 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:27.365258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 453/936] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:27.367324 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e42ce-f2f9-4f0e-b8d8-aee4a986bc84 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:27.439690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:27.480410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e42ce-f2f9-4f0e-b8d8-aee4a986bc84 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:27.519983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17c64c-19c5-48d7-b2de-95e3123c4fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:27.520970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17c64c-19c5-48d7-b2de-95e3123c4fd9 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:27.521300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17c64c-19c5-48d7-b2de-95e3123c4fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:27.521580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17c64c-19c5-48d7-b2de-95e3123c4fd9 None admin] PATH_INFO: `/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/9fd7af9bcff947afad3e7de1fe204472/roles/7e4df69fe73e4323b8a543ee45b8c60c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:27.523874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17c64c-19c5-48d7-b2de-95e3123c4fd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e77f9cc1c14e35b1d3e1874f107494, user_id=9fd7af9bcff947afad3e7de1fe204472, role_id=7e4df69fe73e4323b8a543ee45b8c60c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:27.525954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17c64c-19c5-48d7-b2de-95e3123c4fd9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:27.540757 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 484/937] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:17:27 2022] PUT /identity/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/9fd7af9bcff947afad3e7de1fe204472/roles/7e4df69fe73e4323b8a543ee45b8c60c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:17:27.888972 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c38f3-a583-4987-a098-15c5795cf686 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:27.888972 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c38f3-a583-4987-a098-15c5795cf686 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:27.888972 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c38f3-a583-4987-a098-15c5795cf686 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:27.890637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 454/938] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:27.896178 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46774d78-22e7-4a5f-bc45-67710254cee2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:27.896691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46774d78-22e7-4a5f-bc45-67710254cee2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:27.897211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46774d78-22e7-4a5f-bc45-67710254cee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:27.914726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-46774d78-22e7-4a5f-bc45-67710254cee2 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:27.916270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-46774d78-22e7-4a5f-bc45-67710254cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:27.986818 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 485/939] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:28.010524 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c38f3-a583-4987-a098-15c5795cf686 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:28.032702 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b0e85-5741-4ee9-b009-6414fcf97bde None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:28.033365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b0e85-5741-4ee9-b009-6414fcf97bde None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:28.033872 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b0e85-5741-4ee9-b009-6414fcf97bde None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:28.035726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 486/940] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:28.042778 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea21ba2-6e51-496c-be9d-bb601c5dcf3a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:28.043063 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea21ba2-6e51-496c-be9d-bb601c5dcf3a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:28.043346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea21ba2-6e51-496c-be9d-bb601c5dcf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:28.063384 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3ea21ba2-6e51-496c-be9d-bb601c5dcf3a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:28.064503 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3ea21ba2-6e51-496c-be9d-bb601c5dcf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:28.083376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:28.127574 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:28.143472 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c38f3-a583-4987-a098-15c5795cf686 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:28.153323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 487/941] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:28.172499 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea21ba2-6e51-496c-be9d-bb601c5dcf3a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:28.183751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ebc4a-2397-4a83-88ef-f6818a5fd5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:28.184567 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ebc4a-2397-4a83-88ef-f6818a5fd5bf None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:28.184893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ebc4a-2397-4a83-88ef-f6818a5fd5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:28.185200 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ebc4a-2397-4a83-88ef-f6818a5fd5bf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:28.186262 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ebc4a-2397-4a83-88ef-f6818a5fd5bf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:28.187687 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ebc4a-2397-4a83-88ef-f6818a5fd5bf None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-af4ebc4a-2397-4a83-88ef-f6818a5fd5bf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:28.203150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:28.204192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:28.205431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:28.205431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:28.205431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:28.205431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:28.205431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:28.205431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:28.205431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:28.205431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:28.205431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:28.205431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:28.205431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:28.205431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:28.205431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:17:28.205431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:28.205431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 455/942] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jul 21 22:17:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:28.210165 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ebc4a-2397-4a83-88ef-f6818a5fd5bf None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:28.289861 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea21ba2-6e51-496c-be9d-bb601c5dcf3a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:28.328330 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1183529-a5bf-4580-91b9-0ed18ca3291c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:28.329374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1183529-a5bf-4580-91b9-0ed18ca3291c None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:28.329896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1183529-a5bf-4580-91b9-0ed18ca3291c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:28.330382 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1183529-a5bf-4580-91b9-0ed18ca3291c None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:28.331290 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1183529-a5bf-4580-91b9-0ed18ca3291c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:28.333096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1183529-a5bf-4580-91b9-0ed18ca3291c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:28.334650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: WARNING keystone.server.flask.common [None req-d1183529-a5bf-4580-91b9-0ed18ca3291c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 22:17:28.346382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ebc4a-2397-4a83-88ef-f6818a5fd5bf None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:28.355142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.sql.core [None req-d1183529-a5bf-4580-91b9-0ed18ca3291c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 22:17:28.355142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 22:17:28.355142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [parameters: {'id': '218abad0a2a04657982bb978a0c05fcd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 22:17:28.355142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80106) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 22:17:28.363441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d1183529-a5bf-4580-91b9-0ed18ca3291c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 218abad0a2a04657982bb978a0c05fcd.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 218abad0a2a04657982bb978a0c05fcd. Jul 21 22:17:28.363441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:28.363441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 22:17:28.363441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 22:17:28.363441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 22:17:28.363441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 22:17:28.363441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 22:17:28.363441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 22:17:28.363441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 22:17:28.363441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application conn.query(q) Jul 21 22:17:28.363441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 22:17:28.363441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 22:17:28.363441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result.read() Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 22:17:28.364258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application next(self.gen) Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application yield resource Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application next(self.gen) Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise self.value Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application session.commit() Jul 21 22:17:28.365218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.session.flush() Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application compat.raise_( Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 22:17:28.366109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 22:17:28.367032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 22:17:28.367032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 22:17:28.367032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 22:17:28.367032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 22:17:28.367032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 22:17:28.367032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 22:17:28.367032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 22:17:28.367032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 22:17:28.367032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 22:17:28.367032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 22:17:28.367032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 22:17:28.367032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 22:17:28.367032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 22:17:28.367032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 22:17:28.367032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application conn.query(q) Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result.read() Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 22:17:28.367803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 22:17:28.368738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 22:17:28.368738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 22:17:28.368738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 22:17:28.368738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 22:17:28.368738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 22:17:28.368738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 22:17:28.368738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 22:17:28.368738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 22:17:28.368738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [parameters: {'id': '218abad0a2a04657982bb978a0c05fcd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 22:17:28.368738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 22:17:28.368738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:28.368738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:28.368738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:28.368738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:28.368738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:28.371698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:28.373836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:28.373836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 22:17:28.373836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 22:17:28.373836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:28.373836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:28.373836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 22:17:28.373836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 22:17:28.373836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 218abad0a2a04657982bb978a0c05fcd. Jul 21 22:17:28.373836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:28.374964 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:28.381463 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 488/943] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Jul 21 22:17:28 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:28.382765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1183529-a5bf-4580-91b9-0ed18ca3291c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:28.386171 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cac315-fb0c-4826-adf1-567804ce39d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:28.386854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cac315-fb0c-4826-adf1-567804ce39d1 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:28.387169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cac315-fb0c-4826-adf1-567804ce39d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:28.388156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cac315-fb0c-4826-adf1-567804ce39d1 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:28.388278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cac315-fb0c-4826-adf1-567804ce39d1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:28.388534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cac315-fb0c-4826-adf1-567804ce39d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:28.389976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cac315-fb0c-4826-adf1-567804ce39d1 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:28.400722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 456/944] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jul 21 22:17:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:28.401574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cac315-fb0c-4826-adf1-567804ce39d1 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:28.434981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:28.494097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1183529-a5bf-4580-91b9-0ed18ca3291c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:28.514736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cac315-fb0c-4826-adf1-567804ce39d1 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:28.530805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233db91-1fd9-4c84-99c0-efb2f1032a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:28.532115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233db91-1fd9-4c84-99c0-efb2f1032a86 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:28.532600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233db91-1fd9-4c84-99c0-efb2f1032a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:28.533148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233db91-1fd9-4c84-99c0-efb2f1032a86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:28.541963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233db91-1fd9-4c84-99c0-efb2f1032a86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:28.544110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233db91-1fd9-4c84-99c0-efb2f1032a86 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:28.554149 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4267e-13d8-4cef-b961-39dee31b7796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:28.554825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4267e-13d8-4cef-b961-39dee31b7796 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:28.555112 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4267e-13d8-4cef-b961-39dee31b7796 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:28.555393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4267e-13d8-4cef-b961-39dee31b7796 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:28.556149 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4267e-13d8-4cef-b961-39dee31b7796 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:28.556459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4267e-13d8-4cef-b961-39dee31b7796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:28.557912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4267e-13d8-4cef-b961-39dee31b7796 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:28.560838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-7233db91-1fd9-4c84-99c0-efb2f1032a86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:28.560838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:28.560838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:28.560838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:28.560838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:28.560838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:28.560838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:28.560838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:28.560838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:28.560838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:28.560838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:28.560838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:28.560838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:28.560838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:28.560838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:28.561701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:28.562552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:28.562552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:28.562552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:28.562552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:28.562552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:28.562552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:28.562552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:28.562552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:28.569325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 457/945] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jul 21 22:17:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:28.569325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4267e-13d8-4cef-b961-39dee31b7796 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:28.569901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 489/946] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:28.570999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233db91-1fd9-4c84-99c0-efb2f1032a86 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:28.619697 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:28.680591 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4267e-13d8-4cef-b961-39dee31b7796 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:28.683142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233db91-1fd9-4c84-99c0-efb2f1032a86 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:28.685771 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:28.719461 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044da66-d5b2-4b9e-8167-fbddb96f92ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:28.720489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044da66-d5b2-4b9e-8167-fbddb96f92ed None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:28.720960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044da66-d5b2-4b9e-8167-fbddb96f92ed None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:28.721074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59218591-ebc1-40be-8575-a41c10711765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:28.721496 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044da66-d5b2-4b9e-8167-fbddb96f92ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:28.721894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59218591-ebc1-40be-8575-a41c10711765 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:28.722269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59218591-ebc1-40be-8575-a41c10711765 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:28.722639 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59218591-ebc1-40be-8575-a41c10711765 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:28.722950 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044da66-d5b2-4b9e-8167-fbddb96f92ed None admin] RBAC: Adding query filter params (interface=public, service_id=a841d6f7906443888dbc9cd38042e651, region_id=RegionOne) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:28.723454 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044da66-d5b2-4b9e-8167-fbddb96f92ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:28.723664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59218591-ebc1-40be-8575-a41c10711765 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:28.724061 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59218591-ebc1-40be-8575-a41c10711765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:28.725376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044da66-d5b2-4b9e-8167-fbddb96f92ed None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:28.725676 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59218591-ebc1-40be-8575-a41c10711765 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:28.736416 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 458/947] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jul 21 22:17:28 2022] GET /identity/v3/endpoints?service_id=a841d6f7906443888dbc9cd38042e651&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:28.737594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044da66-d5b2-4b9e-8167-fbddb96f92ed None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:28.755938 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 490/948] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jul 21 22:17:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:28.849204 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044da66-d5b2-4b9e-8167-fbddb96f92ed None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:28.860735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:28.886001 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e98ce9-97e2-445a-8662-77ba0f3d7a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:28.886685 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e98ce9-97e2-445a-8662-77ba0f3d7a91 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:28.886968 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e98ce9-97e2-445a-8662-77ba0f3d7a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:28.887244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e98ce9-97e2-445a-8662-77ba0f3d7a91 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:28.888183 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e98ce9-97e2-445a-8662-77ba0f3d7a91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:28.889610 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e98ce9-97e2-445a-8662-77ba0f3d7a91 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:28.896718 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 459/949] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jul 21 22:17:28 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:17:29.480579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9377b2-7463-4a76-a7cc-c74fe6c6b9ae None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:29.481108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9377b2-7463-4a76-a7cc-c74fe6c6b9ae None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:29.481471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9377b2-7463-4a76-a7cc-c74fe6c6b9ae None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:29.483256 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 491/950] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:29.488648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9750f3-94fa-4ba0-8f41-9e1f2a505d6f None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:29.489135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9750f3-94fa-4ba0-8f41-9e1f2a505d6f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:29.489445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9750f3-94fa-4ba0-8f41-9e1f2a505d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:29.506701 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-6a9750f3-94fa-4ba0-8f41-9e1f2a505d6f None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:29.507894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6a9750f3-94fa-4ba0-8f41-9e1f2a505d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:29.579825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 460/951] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:29.602525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9377b2-7463-4a76-a7cc-c74fe6c6b9ae None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:29.643199 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e988018-5b7d-477a-a766-3c27e3e23ec3 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:29.643529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e988018-5b7d-477a-a766-3c27e3e23ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:29.643757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e988018-5b7d-477a-a766-3c27e3e23ec3 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:29.645395 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 461/952] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:29.650783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28581b55-a316-4280-bb8d-9def9bc92b71 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:29.651060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28581b55-a316-4280-bb8d-9def9bc92b71 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:29.651333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28581b55-a316-4280-bb8d-9def9bc92b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:29.670196 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-28581b55-a316-4280-bb8d-9def9bc92b71 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:29.671815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-28581b55-a316-4280-bb8d-9def9bc92b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:29.711914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9377b2-7463-4a76-a7cc-c74fe6c6b9ae None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:29.752215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1e4f7-dd06-4993-9059-7c4b972634c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:29.753111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1e4f7-dd06-4993-9059-7c4b972634c0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:29.753589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1e4f7-dd06-4993-9059-7c4b972634c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:29.754038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1e4f7-dd06-4993-9059-7c4b972634c0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:29.754785 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1e4f7-dd06-4993-9059-7c4b972634c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:29.755921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 462/953] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:29.756307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1e4f7-dd06-4993-9059-7c4b972634c0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-b4a1e4f7-dd06-4993-9059-7c4b972634c0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:29.768206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:29.769204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:29.770190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:29.770190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:29.770190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:29.770190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:29.770190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:29.770190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:29.770190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:29.770190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:29.770190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:29.770190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:29.770190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:29.770190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:29.770190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:17:29.770190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:29.770190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 492/954] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:29.775482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28581b55-a316-4280-bb8d-9def9bc92b71 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:29.778985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1e4f7-dd06-4993-9059-7c4b972634c0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:29.809387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:29.812499 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:29.892898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28581b55-a316-4280-bb8d-9def9bc92b71 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:29.898494 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1e4f7-dd06-4993-9059-7c4b972634c0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:29.935914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021499aa-2cd4-4333-a8e2-379ca00f364d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:29.936513 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec553f1f-0ac0-41fc-88a9-ff40e536b07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:29.937037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021499aa-2cd4-4333-a8e2-379ca00f364d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:29.937463 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021499aa-2cd4-4333-a8e2-379ca00f364d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:29.937631 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec553f1f-0ac0-41fc-88a9-ff40e536b07c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:29.938006 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec553f1f-0ac0-41fc-88a9-ff40e536b07c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:29.938200 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021499aa-2cd4-4333-a8e2-379ca00f364d None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:29.938457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec553f1f-0ac0-41fc-88a9-ff40e536b07c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:29.939192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021499aa-2cd4-4333-a8e2-379ca00f364d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:29.939637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021499aa-2cd4-4333-a8e2-379ca00f364d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:29.941354 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021499aa-2cd4-4333-a8e2-379ca00f364d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:29.950956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec553f1f-0ac0-41fc-88a9-ff40e536b07c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:29.951472 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 463/955] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jul 21 22:17:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:29.952507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021499aa-2cd4-4333-a8e2-379ca00f364d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ec553f1f-0ac0-41fc-88a9-ff40e536b07c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:29.965082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:29.966076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:29.966982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:29.966982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:29.966982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:29.966982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:29.966982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:29.966982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:29.966982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:29.966982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:29.966982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:29.966982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:29.966982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:17:29.966982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:29.968593 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 493/956] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jul 21 22:17:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:29.972152 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec553f1f-0ac0-41fc-88a9-ff40e536b07c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:30.079992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:30.080625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:30.088694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021499aa-2cd4-4333-a8e2-379ca00f364d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:30.101186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec553f1f-0ac0-41fc-88a9-ff40e536b07c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:30.134812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8906818-2ad4-4dbc-84eb-13c885e7ba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:30.135682 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8906818-2ad4-4dbc-84eb-13c885e7ba4d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:30.136126 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8906818-2ad4-4dbc-84eb-13c885e7ba4d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:30.136479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8906818-2ad4-4dbc-84eb-13c885e7ba4d None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:30.137292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8906818-2ad4-4dbc-84eb-13c885e7ba4d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:30.137604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8906818-2ad4-4dbc-84eb-13c885e7ba4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:30.138792 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c150223-521c-4ea3-87c1-0591fc872ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:30.139168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8906818-2ad4-4dbc-84eb-13c885e7ba4d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:30.139873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c150223-521c-4ea3-87c1-0591fc872ccf None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:30.140375 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c150223-521c-4ea3-87c1-0591fc872ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:30.140846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c150223-521c-4ea3-87c1-0591fc872ccf None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:30.141815 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c150223-521c-4ea3-87c1-0591fc872ccf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:30.142313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c150223-521c-4ea3-87c1-0591fc872ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:30.143848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c150223-521c-4ea3-87c1-0591fc872ccf None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:30.144176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 464/957] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jul 21 22:17:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:30.158214 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 494/958] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jul 21 22:17:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:30.164227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8906818-2ad4-4dbc-84eb-13c885e7ba4d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:30.276962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8906818-2ad4-4dbc-84eb-13c885e7ba4d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:30.314526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5aa027-87a2-4875-bb0b-b6663f6eb63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:30.315327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aa027-87a2-4875-bb0b-b6663f6eb63d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:30.315671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aa027-87a2-4875-bb0b-b6663f6eb63d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:30.315954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aa027-87a2-4875-bb0b-b6663f6eb63d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:30.326608 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5aa027-87a2-4875-bb0b-b6663f6eb63d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:30.327985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5aa027-87a2-4875-bb0b-b6663f6eb63d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:30.345997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-ec5aa027-87a2-4875-bb0b-b6663f6eb63d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:30.345997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:30.345997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:30.345997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:30.345997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:30.345997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:30.345997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:30.345997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:30.345997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:30.345997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:30.345997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:30.345997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:30.345997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:30.345997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:30.345997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:30.346909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:30.347798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:30.347798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:30.347798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:30.347798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:30.347798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 465/959] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:30.354732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c150223-521c-4ea3-87c1-0591fc872ccf None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:30.459486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c150223-521c-4ea3-87c1-0591fc872ccf None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:30.495905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde9a1f-9052-44ea-8b0f-e3341c74dec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:30.497413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde9a1f-9052-44ea-8b0f-e3341c74dec3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:30.497909 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde9a1f-9052-44ea-8b0f-e3341c74dec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:30.498408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde9a1f-9052-44ea-8b0f-e3341c74dec3 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:30.499343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde9a1f-9052-44ea-8b0f-e3341c74dec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:30.499845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde9a1f-9052-44ea-8b0f-e3341c74dec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:30.501448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde9a1f-9052-44ea-8b0f-e3341c74dec3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:30.514414 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 495/960] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:30.521989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5aa027-87a2-4875-bb0b-b6663f6eb63d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:30.539372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:30.629042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5aa027-87a2-4875-bb0b-b6663f6eb63d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:30.666976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0a369-100d-43be-92a2-57e3b535ab55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:30.668189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0a369-100d-43be-92a2-57e3b535ab55 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:30.668678 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0a369-100d-43be-92a2-57e3b535ab55 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:30.669177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0a369-100d-43be-92a2-57e3b535ab55 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:30.676847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0a369-100d-43be-92a2-57e3b535ab55 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:30.678547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0a369-100d-43be-92a2-57e3b535ab55 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-f0e0a369-100d-43be-92a2-57e3b535ab55 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:30.698103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:30.699093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:30.700015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:30.700015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:30.700015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:30.700015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:30.700015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:30.700015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:30.700015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:30.700015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:30.700015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 22:17:30.700015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:30.700015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 466/961] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jul 21 22:17:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:30.706529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde9a1f-9052-44ea-8b0f-e3341c74dec3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:30.720770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:30.816261 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde9a1f-9052-44ea-8b0f-e3341c74dec3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:30.856355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22957a97-8087-4f5b-8226-6c4ff0c8a9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:30.857442 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22957a97-8087-4f5b-8226-6c4ff0c8a9dd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:30.857952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22957a97-8087-4f5b-8226-6c4ff0c8a9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:30.858432 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22957a97-8087-4f5b-8226-6c4ff0c8a9dd None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:30.859462 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22957a97-8087-4f5b-8226-6c4ff0c8a9dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:30.859969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22957a97-8087-4f5b-8226-6c4ff0c8a9dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:30.861615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22957a97-8087-4f5b-8226-6c4ff0c8a9dd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:30.881388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 496/962] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jul 21 22:17:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:30.887814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0a369-100d-43be-92a2-57e3b535ab55 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:30.965698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125462a8-61b2-4996-9050-8642868d4e19 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:30.966051 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125462a8-61b2-4996-9050-8642868d4e19 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:30.966263 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125462a8-61b2-4996-9050-8642868d4e19 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:30.967892 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 497/963] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:30.968606 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:30.973808 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845cb14-b5d4-49ad-b076-534ab33c8b52 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:30.974097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845cb14-b5d4-49ad-b076-534ab33c8b52 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:30.974665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845cb14-b5d4-49ad-b076-534ab33c8b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:30.997667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3845cb14-b5d4-49ad-b076-534ab33c8b52 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:30.998234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0a369-100d-43be-92a2-57e3b535ab55 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:30.999165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3845cb14-b5d4-49ad-b076-534ab33c8b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:31.038980 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a991068-1a7c-4997-ad1a-9c09595b7868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:31.039628 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a991068-1a7c-4997-ad1a-9c09595b7868 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:31.039935 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a991068-1a7c-4997-ad1a-9c09595b7868 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:31.040377 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a991068-1a7c-4997-ad1a-9c09595b7868 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:31.066803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:31.073569 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 498/964] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:31.074896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd059be-2e02-401b-87f0-2c740e80a65d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:31.075186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd059be-2e02-401b-87f0-2c740e80a65d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:31.075465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd059be-2e02-401b-87f0-2c740e80a65d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:31.076854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 499/965] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:31.082163 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df66476-c395-40df-9c22-ae32ba5f039f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:31.082294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df66476-c395-40df-9c22-ae32ba5f039f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:31.082569 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df66476-c395-40df-9c22-ae32ba5f039f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:31.101795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3df66476-c395-40df-9c22-ae32ba5f039f None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:31.103177 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3df66476-c395-40df-9c22-ae32ba5f039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:31.129778 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a991068-1a7c-4997-ad1a-9c09595b7868 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:31.131212 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a991068-1a7c-4997-ad1a-9c09595b7868 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:31.178813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 500/966] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:31.180190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df66476-c395-40df-9c22-ae32ba5f039f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:31.218539 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:31.248377 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 467/967] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:17:30 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:17:31.248377 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a991068-1a7c-4997-ad1a-9c09595b7868 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:31.308492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df66476-c395-40df-9c22-ae32ba5f039f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:31.339253 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:31.348908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83336a62-e5fd-4deb-bedc-bf22ac3edc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:31.349905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83336a62-e5fd-4deb-bedc-bf22ac3edc0e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:31.350492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83336a62-e5fd-4deb-bedc-bf22ac3edc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:31.350819 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83336a62-e5fd-4deb-bedc-bf22ac3edc0e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:31.351419 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83336a62-e5fd-4deb-bedc-bf22ac3edc0e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:31.352869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83336a62-e5fd-4deb-bedc-bf22ac3edc0e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:31.352990 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a991068-1a7c-4997-ad1a-9c09595b7868 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-83336a62-e5fd-4deb-bedc-bf22ac3edc0e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:31.365710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:31.366739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:31.367583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:31.367583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:31.367583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:31.367583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:31.367583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:31.367583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:31.367583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:31.367583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:31.367583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:31.367583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:31.367583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:31.367583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:31.367583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:17:31.367583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:31.367583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 501/968] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jul 21 22:17:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:31.368909 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83336a62-e5fd-4deb-bedc-bf22ac3edc0e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:31.394155 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a448f-283c-47e1-9b91-3656c0d97169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:31.394830 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a448f-283c-47e1-9b91-3656c0d97169 None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:31.395114 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a448f-283c-47e1-9b91-3656c0d97169 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:31.395389 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a448f-283c-47e1-9b91-3656c0d97169 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:31.396078 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a448f-283c-47e1-9b91-3656c0d97169 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:31.397532 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a448f-283c-47e1-9b91-3656c0d97169 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:31.398840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: WARNING keystone.server.flask.common [None req-163a448f-283c-47e1-9b91-3656c0d97169 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 22:17:31.411099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.sql.core [None req-163a448f-283c-47e1-9b91-3656c0d97169 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 22:17:31.411099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 22:17:31.411099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [parameters: {'user_id': '3b33dd45f57143b2922e46f11a50dbc3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 22:17:31.411099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80107) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 22:17:31.427194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-163a448f-283c-47e1-9b91-3656c0d97169 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 22:17:31.427194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:31.427194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 22:17:31.427194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 22:17:31.427194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 22:17:31.427194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 22:17:31.427194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 22:17:31.427194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 22:17:31.427194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 22:17:31.427194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application conn.query(q) Jul 21 22:17:31.427194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 22:17:31.427194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 22:17:31.427194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 22:17:31.427194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application result.read() Jul 21 22:17:31.427194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 22:17:31.428116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application next(self.gen) Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application yield resource Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application next(self.gen) Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise self.value Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application session.commit() Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 22:17:31.429239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self.session.flush() Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application compat.raise_( Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 22:17:31.430121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 22:17:31.431546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application conn.query(q) Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application result.read() Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 22:17:31.432382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 22:17:31.434746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 22:17:31.434746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 22:17:31.434746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 22:17:31.434746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 22:17:31.434746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 22:17:31.434746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 22:17:31.434746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [parameters: {'user_id': '3b33dd45f57143b2922e46f11a50dbc3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 22:17:31.434746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 22:17:31.434746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:31.434746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:31.434746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:31.434746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:31.434746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:31.434746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:31.434746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 22:17:31.436429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 22:17:31.438432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 22:17:31.438432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 22:17:31.438432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 22:17:31.438432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 22:17:31.438432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 22:17:31.438432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:31.438432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 468/969] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Jul 21 22:17:31 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:31.438432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a448f-283c-47e1-9b91-3656c0d97169 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:31.472080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:31.486215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83336a62-e5fd-4deb-bedc-bf22ac3edc0e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:31.523218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a5978-2b29-4d02-86e0-4a4a7bc88df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:31.524801 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a5978-2b29-4d02-86e0-4a4a7bc88df9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:31.525196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a5978-2b29-4d02-86e0-4a4a7bc88df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:31.525543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a5978-2b29-4d02-86e0-4a4a7bc88df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:31.536560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a5978-2b29-4d02-86e0-4a4a7bc88df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:31.538033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a5978-2b29-4d02-86e0-4a4a7bc88df9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:31.543488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a448f-283c-47e1-9b91-3656c0d97169 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:31.556641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-411a5978-2b29-4d02-86e0-4a4a7bc88df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:31.556641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:31.556641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:31.556641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:31.556641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:31.556641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:31.556641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:31.556641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:31.556641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:31.556641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:31.556641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:31.556641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:31.556641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:31.556641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:31.556641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:31.557586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:31.558453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:31.558453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:31.558453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:31.558453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:31.558453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 502/970] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:31.558742 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a5978-2b29-4d02-86e0-4a4a7bc88df9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:31.583984 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be6ce3-9896-4f1d-9a1d-7f2d7429e0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:31.584815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be6ce3-9896-4f1d-9a1d-7f2d7429e0de None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:31.585241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be6ce3-9896-4f1d-9a1d-7f2d7429e0de None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:31.585613 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be6ce3-9896-4f1d-9a1d-7f2d7429e0de None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:31.586323 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be6ce3-9896-4f1d-9a1d-7f2d7429e0de None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:31.587127 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be6ce3-9896-4f1d-9a1d-7f2d7429e0de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:31.588696 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be6ce3-9896-4f1d-9a1d-7f2d7429e0de None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:31.596961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 469/971] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jul 21 22:17:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:31.597349 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be6ce3-9896-4f1d-9a1d-7f2d7429e0de None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:31.612906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:31.669217 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a5978-2b29-4d02-86e0-4a4a7bc88df9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:31.704403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:31.706802 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd15de-775a-438c-b36f-d1ee16d48323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:31.707599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd15de-775a-438c-b36f-d1ee16d48323 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:31.707875 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd15de-775a-438c-b36f-d1ee16d48323 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:31.708047 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be6ce3-9896-4f1d-9a1d-7f2d7429e0de None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:31.708148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd15de-775a-438c-b36f-d1ee16d48323 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:31.717690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd15de-775a-438c-b36f-d1ee16d48323 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:31.719647 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd15de-775a-438c-b36f-d1ee16d48323 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-e7dd15de-775a-438c-b36f-d1ee16d48323 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:31.734348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:31.735478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:31.741328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:31.741328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:31.741328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:31.741328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:31.741328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:31.741328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:31.741328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:31.741328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:31.741328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 22:17:31.741328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:31.741328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 503/972] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:17:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:31.741328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd15de-775a-438c-b36f-d1ee16d48323 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:31.752617 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2dec1-c0d4-4c81-ab59-52ebb308ce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:31.753415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2dec1-c0d4-4c81-ab59-52ebb308ce45 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:31.753699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2dec1-c0d4-4c81-ab59-52ebb308ce45 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:31.753975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2dec1-c0d4-4c81-ab59-52ebb308ce45 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:31.754699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2dec1-c0d4-4c81-ab59-52ebb308ce45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:31.755005 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2dec1-c0d4-4c81-ab59-52ebb308ce45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:31.756399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2dec1-c0d4-4c81-ab59-52ebb308ce45 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:31.773621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 470/973] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:31.773621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2dec1-c0d4-4c81-ab59-52ebb308ce45 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:31.846937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd15de-775a-438c-b36f-d1ee16d48323 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:31.850462 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:31.880731 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2dec1-c0d4-4c81-ab59-52ebb308ce45 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:31.886549 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b278f99-17f5-47a4-a2dc-a5eca73b1e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:31.887353 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b278f99-17f5-47a4-a2dc-a5eca73b1e57 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:31.887755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b278f99-17f5-47a4-a2dc-a5eca73b1e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:31.888135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b278f99-17f5-47a4-a2dc-a5eca73b1e57 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:31.888964 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b278f99-17f5-47a4-a2dc-a5eca73b1e57 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:31.889379 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b278f99-17f5-47a4-a2dc-a5eca73b1e57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:31.890860 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b278f99-17f5-47a4-a2dc-a5eca73b1e57 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:31.896063 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 504/974] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jul 21 22:17:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:31.896918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b278f99-17f5-47a4-a2dc-a5eca73b1e57 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:31.924022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48bf62-6509-4f7b-8992-bd71c4d9a28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:31.924705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48bf62-6509-4f7b-8992-bd71c4d9a28d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:31.925040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48bf62-6509-4f7b-8992-bd71c4d9a28d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:31.925323 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48bf62-6509-4f7b-8992-bd71c4d9a28d None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:31.926143 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48bf62-6509-4f7b-8992-bd71c4d9a28d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:31.926452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48bf62-6509-4f7b-8992-bd71c4d9a28d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:31.927883 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48bf62-6509-4f7b-8992-bd71c4d9a28d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:31.973043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 471/975] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jul 21 22:17:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:31.973043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48bf62-6509-4f7b-8992-bd71c4d9a28d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:31.993234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:32.035489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b278f99-17f5-47a4-a2dc-a5eca73b1e57 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:32.078858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b80ff-cb44-48d2-998c-d40f814bb2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:32.079826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b80ff-cb44-48d2-998c-d40f814bb2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:32.080216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b80ff-cb44-48d2-998c-d40f814bb2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:32.080596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b80ff-cb44-48d2-998c-d40f814bb2b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:32.089249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b80ff-cb44-48d2-998c-d40f814bb2b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:32.090950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b80ff-cb44-48d2-998c-d40f814bb2b2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:32.106768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c89b80ff-cb44-48d2-998c-d40f814bb2b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:32.106768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:32.106768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:32.106768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:32.106768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:32.106768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:32.106768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:32.106768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:32.106768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:32.106768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:32.106768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:32.106768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:32.106768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:32.106768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:32.106768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:32.107926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:32.109041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:32.109041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:32.109041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:32.109041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:32.109041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:32.109041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:32.109041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:32.109041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:32.111995 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48bf62-6509-4f7b-8992-bd71c4d9a28d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:32.115870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 505/976] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:32.116804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b80ff-cb44-48d2-998c-d40f814bb2b2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:32.158533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:32.162694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3179db0-6677-48ee-8d7a-3d3db4eb663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:32.164118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3179db0-6677-48ee-8d7a-3d3db4eb663d None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:32.164118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3179db0-6677-48ee-8d7a-3d3db4eb663d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:32.164118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3179db0-6677-48ee-8d7a-3d3db4eb663d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:32.165659 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3179db0-6677-48ee-8d7a-3d3db4eb663d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:32.167177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3179db0-6677-48ee-8d7a-3d3db4eb663d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:32.188032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 472/977] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jul 21 22:17:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:17:32.249475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b80ff-cb44-48d2-998c-d40f814bb2b2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:32.265493 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9fec1-c9ff-4936-a317-0a9db1bdb87e None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:32.265774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9fec1-c9ff-4936-a317-0a9db1bdb87e None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:32.266050 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9fec1-c9ff-4936-a317-0a9db1bdb87e None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:32.267479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 473/978] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:32.275088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc24d39-0702-454b-8aef-a1f106e8235c None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:32.275371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc24d39-0702-454b-8aef-a1f106e8235c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:32.275648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc24d39-0702-454b-8aef-a1f106e8235c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:32.293864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-0cc24d39-0702-454b-8aef-a1f106e8235c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:32.295420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0cc24d39-0702-454b-8aef-a1f106e8235c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:32.303581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7329cdc-413d-4182-9cae-820e49106a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:32.304260 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7329cdc-413d-4182-9cae-820e49106a01 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:32.304544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7329cdc-413d-4182-9cae-820e49106a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:32.304820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7329cdc-413d-4182-9cae-820e49106a01 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:32.305701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7329cdc-413d-4182-9cae-820e49106a01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:32.306014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7329cdc-413d-4182-9cae-820e49106a01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:32.307482 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7329cdc-413d-4182-9cae-820e49106a01 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:32.320761 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 506/979] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:32.326757 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7329cdc-413d-4182-9cae-820e49106a01 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:32.380725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 474/980] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:32.404909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc24d39-0702-454b-8aef-a1f106e8235c None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:32.408066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:32.426271 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:32.444204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7329cdc-413d-4182-9cae-820e49106a01 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:32.481321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b29901-e0e0-4fcf-ac05-1d1aacbc8fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:32.481986 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29901-e0e0-4fcf-ac05-1d1aacbc8fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:32.482268 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29901-e0e0-4fcf-ac05-1d1aacbc8fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:32.482555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29901-e0e0-4fcf-ac05-1d1aacbc8fe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:32.483385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b29901-e0e0-4fcf-ac05-1d1aacbc8fe8 None admin] RBAC: Adding query filter params (role.id=7e4df69fe73e4323b8a543ee45b8c60c, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=9fd7af9bcff947afad3e7de1fe204472) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:32.483700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b29901-e0e0-4fcf-ac05-1d1aacbc8fe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:32.485161 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b29901-e0e0-4fcf-ac05-1d1aacbc8fe8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:32.497150 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 507/981] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:17:32 2022] GET /identity/v3/role_assignments?user.id=9fd7af9bcff947afad3e7de1fe204472&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=7e4df69fe73e4323b8a543ee45b8c60c => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:32.515193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc24d39-0702-454b-8aef-a1f106e8235c None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:32.554096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc349b-a0ba-44d3-8205-748be6fabcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:32.554866 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc349b-a0ba-44d3-8205-748be6fabcab None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:32.555055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc349b-a0ba-44d3-8205-748be6fabcab None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:32.555330 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc349b-a0ba-44d3-8205-748be6fabcab None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:32.556153 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc349b-a0ba-44d3-8205-748be6fabcab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:32.557574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc349b-a0ba-44d3-8205-748be6fabcab None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:32.581253 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 475/982] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jul 21 22:17:32 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:17:34.259374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59687a3e-1025-4eb0-aa0b-b07d991242bd None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:34.259884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59687a3e-1025-4eb0-aa0b-b07d991242bd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:34.259960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59687a3e-1025-4eb0-aa0b-b07d991242bd None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:34.261452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 508/983] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:34.266569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4319c0-13dc-403c-8c85-dc22abadc83e None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:34.267009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4319c0-13dc-403c-8c85-dc22abadc83e None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:34.267154 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4319c0-13dc-403c-8c85-dc22abadc83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:34.286124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-cf4319c0-13dc-403c-8c85-dc22abadc83e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:34.287364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-cf4319c0-13dc-403c-8c85-dc22abadc83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:34.348493 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:34.368973 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 476/984] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:34.390873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59687a3e-1025-4eb0-aa0b-b07d991242bd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:34.493734 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59687a3e-1025-4eb0-aa0b-b07d991242bd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:34.528135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f2ecc-a8bf-4e75-9a85-aeee8264c662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:34.528960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f2ecc-a8bf-4e75-9a85-aeee8264c662 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:34.529343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f2ecc-a8bf-4e75-9a85-aeee8264c662 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:34.529625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f2ecc-a8bf-4e75-9a85-aeee8264c662 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:34.530279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f2ecc-a8bf-4e75-9a85-aeee8264c662 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:34.531643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f2ecc-a8bf-4e75-9a85-aeee8264c662 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-643f2ecc-a8bf-4e75-9a85-aeee8264c662 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:34.543788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:34.545173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:34.546014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:34.546014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:34.546014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:34.546014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:34.546014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:34.546014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:34.546014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:34.546014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:34.546014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:34.546014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:34.546014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:34.546014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:34.546014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:17:34.546014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:34.546754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18d3f3-3b8a-498e-8487-fd82f8cdbc02 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:34.546754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18d3f3-3b8a-498e-8487-fd82f8cdbc02 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:34.546881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18d3f3-3b8a-498e-8487-fd82f8cdbc02 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:34.547623 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 509/985] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jul 21 22:17:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:34.548973 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 477/986] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:34.553533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18d3f3-3b8a-498e-8487-fd82f8cdbc02 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:34.553650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcbd12-7e87-4292-a070-b31b4987f95e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:34.553820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcbd12-7e87-4292-a070-b31b4987f95e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:34.554209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcbd12-7e87-4292-a070-b31b4987f95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:34.571546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-41bcbd12-7e87-4292-a070-b31b4987f95e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:34.572693 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-41bcbd12-7e87-4292-a070-b31b4987f95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:34.580201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:34.639743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 510/987] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:34.641046 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225d099-2d5c-4353-8017-e7ee47e6981d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:34.641341 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225d099-2d5c-4353-8017-e7ee47e6981d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:34.641612 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225d099-2d5c-4353-8017-e7ee47e6981d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:34.643013 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 511/988] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:34.649509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08027d0c-401c-46a1-b1f3-c4d574bc3eca None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:34.649816 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08027d0c-401c-46a1-b1f3-c4d574bc3eca None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:34.650061 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08027d0c-401c-46a1-b1f3-c4d574bc3eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:34.657593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18d3f3-3b8a-498e-8487-fd82f8cdbc02 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:34.666139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-08027d0c-401c-46a1-b1f3-c4d574bc3eca None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:34.667313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-08027d0c-401c-46a1-b1f3-c4d574bc3eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:34.691037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d02d7c-db35-4b1a-bde5-329e3174ea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:34.691700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02d7c-db35-4b1a-bde5-329e3174ea90 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:34.691984 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02d7c-db35-4b1a-bde5-329e3174ea90 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:34.692262 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02d7c-db35-4b1a-bde5-329e3174ea90 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:34.692991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d02d7c-db35-4b1a-bde5-329e3174ea90 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:34.693302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d02d7c-db35-4b1a-bde5-329e3174ea90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:34.694658 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d02d7c-db35-4b1a-bde5-329e3174ea90 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:34.700007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 478/989] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jul 21 22:17:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:34.705426 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d02d7c-db35-4b1a-bde5-329e3174ea90 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:34.744973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 512/990] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:34.744973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08027d0c-401c-46a1-b1f3-c4d574bc3eca None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:34.760217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:34.804407 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d02d7c-db35-4b1a-bde5-329e3174ea90 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:34.814460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:34.839571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dc444-1503-4f89-a423-e97e1f603e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:34.840373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dc444-1503-4f89-a423-e97e1f603e54 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:34.840659 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dc444-1503-4f89-a423-e97e1f603e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:34.840947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dc444-1503-4f89-a423-e97e1f603e54 None admin] PATH_INFO: `/v3/services/image` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:34.841818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825dc444-1503-4f89-a423-e97e1f603e54 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:34.842972 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825dc444-1503-4f89-a423-e97e1f603e54 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:34.844298 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08027d0c-401c-46a1-b1f3-c4d574bc3eca None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-825dc444-1503-4f89-a423-e97e1f603e54 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:34.855083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:34.856102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:34.856977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:34.856977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:34.856977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:34.856977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:34.856977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:34.856977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:34.856977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:34.856977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:34.856977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:34.856977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:34.856977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:34.856977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:34.856977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:17:34.856977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:34.856977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 479/991] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Jul 21 22:17:34 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:34.857776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dc444-1503-4f89-a423-e97e1f603e54 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:34.881338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c543b6f-e53c-4797-95ec-eae4ab6d202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:34.882002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c543b6f-e53c-4797-95ec-eae4ab6d202d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:34.882280 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c543b6f-e53c-4797-95ec-eae4ab6d202d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:34.882556 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c543b6f-e53c-4797-95ec-eae4ab6d202d None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:34.883248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c543b6f-e53c-4797-95ec-eae4ab6d202d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:34.883574 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c543b6f-e53c-4797-95ec-eae4ab6d202d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:34.885109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c543b6f-e53c-4797-95ec-eae4ab6d202d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:34.889841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 513/992] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jul 21 22:17:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:34.890531 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c543b6f-e53c-4797-95ec-eae4ab6d202d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:34.955445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dc444-1503-4f89-a423-e97e1f603e54 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:34.971590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:34.988795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173316e-81ee-4ab8-993d-d7f442ba3b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:34.989598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c543b6f-e53c-4797-95ec-eae4ab6d202d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:34.989704 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173316e-81ee-4ab8-993d-d7f442ba3b62 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:34.989878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173316e-81ee-4ab8-993d-d7f442ba3b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:34.990154 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173316e-81ee-4ab8-993d-d7f442ba3b62 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:34.990821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173316e-81ee-4ab8-993d-d7f442ba3b62 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:34.992170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173316e-81ee-4ab8-993d-d7f442ba3b62 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-b173316e-81ee-4ab8-993d-d7f442ba3b62 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:35.004044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:35.005231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:35.006097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:35.006097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:35.006097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:35.006097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:35.006097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:35.006097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:35.006097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:35.006097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:35.006097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:35.006097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:35.006097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:35.006097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:35.006097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:17:35.006097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:35.006097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 480/993] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:35.006991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173316e-81ee-4ab8-993d-d7f442ba3b62 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:35.029377 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331de89-1169-4da4-9bc5-f761ef713cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:35.030030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331de89-1169-4da4-9bc5-f761ef713cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:35.030309 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331de89-1169-4da4-9bc5-f761ef713cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:35.030583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331de89-1169-4da4-9bc5-f761ef713cd6 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:35.031279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331de89-1169-4da4-9bc5-f761ef713cd6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:35.031581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331de89-1169-4da4-9bc5-f761ef713cd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:35.032938 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331de89-1169-4da4-9bc5-f761ef713cd6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:35.034621 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:35.043468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 514/994] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:35.044164 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331de89-1169-4da4-9bc5-f761ef713cd6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:35.108010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173316e-81ee-4ab8-993d-d7f442ba3b62 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:35.139436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4baf98-ce85-4da4-9deb-295de2327724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:35.140136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4baf98-ce85-4da4-9deb-295de2327724 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:35.140366 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4baf98-ce85-4da4-9deb-295de2327724 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:35.140641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4baf98-ce85-4da4-9deb-295de2327724 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:35.141461 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4baf98-ce85-4da4-9deb-295de2327724 None admin] RBAC: Adding query filter params (interface=admin, service_id=a841d6f7906443888dbc9cd38042e651, region_id=RegionOne) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:35.141771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4baf98-ce85-4da4-9deb-295de2327724 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:35.143116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4baf98-ce85-4da4-9deb-295de2327724 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:35.145591 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331de89-1169-4da4-9bc5-f761ef713cd6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:35.147996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 481/995] 10.222.0.43 () {56 vars in 1249 bytes} [Thu Jul 21 22:17:35 2022] GET /identity/v3/endpoints?service_id=a841d6f7906443888dbc9cd38042e651&interface=admin®ion_id=RegionOne => generated 193 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:35.148757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4baf98-ce85-4da4-9deb-295de2327724 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:35.179604 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ef0d1-533e-4378-a72a-c5224a7e3148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:35.180284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ef0d1-533e-4378-a72a-c5224a7e3148 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:35.180571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ef0d1-533e-4378-a72a-c5224a7e3148 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:35.180849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ef0d1-533e-4378-a72a-c5224a7e3148 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:35.181582 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ef0d1-533e-4378-a72a-c5224a7e3148 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:35.181892 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ef0d1-533e-4378-a72a-c5224a7e3148 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:35.183252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ef0d1-533e-4378-a72a-c5224a7e3148 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:35.188186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 515/996] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jul 21 22:17:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:35.189017 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ef0d1-533e-4378-a72a-c5224a7e3148 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:35.196400 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:35.248672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4baf98-ce85-4da4-9deb-295de2327724 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:35.250422 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:35.283086 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095904a-5b3d-4b02-b56c-764b911199e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:35.283753 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095904a-5b3d-4b02-b56c-764b911199e7 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:35.284035 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095904a-5b3d-4b02-b56c-764b911199e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:35.284308 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095904a-5b3d-4b02-b56c-764b911199e7 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:35.285043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095904a-5b3d-4b02-b56c-764b911199e7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:35.285350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095904a-5b3d-4b02-b56c-764b911199e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:35.286706 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095904a-5b3d-4b02-b56c-764b911199e7 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:35.291635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 482/997] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:35.292413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095904a-5b3d-4b02-b56c-764b911199e7 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:35.295056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ef0d1-533e-4378-a72a-c5224a7e3148 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:35.336015 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febb53e-e7bf-44c0-8bef-2dce86ff29ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:35.337231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febb53e-e7bf-44c0-8bef-2dce86ff29ec None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:35.337575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febb53e-e7bf-44c0-8bef-2dce86ff29ec None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:35.337881 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febb53e-e7bf-44c0-8bef-2dce86ff29ec None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:35.338586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febb53e-e7bf-44c0-8bef-2dce86ff29ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:35.340015 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febb53e-e7bf-44c0-8bef-2dce86ff29ec None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:35.347738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 516/998] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jul 21 22:17:35 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:17:35.420169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095904a-5b3d-4b02-b56c-764b911199e7 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:35.432452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:35.462879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020ccad-344c-47e8-a99d-5353b825d7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:35.463665 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020ccad-344c-47e8-a99d-5353b825d7fb None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:35.464037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020ccad-344c-47e8-a99d-5353b825d7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:35.464382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020ccad-344c-47e8-a99d-5353b825d7fb None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:35.465216 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020ccad-344c-47e8-a99d-5353b825d7fb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:35.465597 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020ccad-344c-47e8-a99d-5353b825d7fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:35.467070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020ccad-344c-47e8-a99d-5353b825d7fb None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:35.473022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 483/999] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jul 21 22:17:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:35.480754 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febb53e-e7bf-44c0-8bef-2dce86ff29ec None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:35.587856 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febb53e-e7bf-44c0-8bef-2dce86ff29ec None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:35.614138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:35.623523 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ce56f-333a-4bcb-b6c8-3f184ab01b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:35.624264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ce56f-333a-4bcb-b6c8-3f184ab01b10 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:35.624653 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ce56f-333a-4bcb-b6c8-3f184ab01b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:35.625031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ce56f-333a-4bcb-b6c8-3f184ab01b10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:35.625939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ce56f-333a-4bcb-b6c8-3f184ab01b10 None admin] RBAC: Adding query filter params (interface=public, service_id=c0e3cbdec5d8441f89d3706773d14ec0, region_id=RegionOne) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:35.626321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ce56f-333a-4bcb-b6c8-3f184ab01b10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:35.627752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ce56f-333a-4bcb-b6c8-3f184ab01b10 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:35.638123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 517/1000] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jul 21 22:17:35 2022] GET /identity/v3/endpoints?service_id=c0e3cbdec5d8441f89d3706773d14ec0&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:35.639745 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020ccad-344c-47e8-a99d-5353b825d7fb None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:35.742161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020ccad-344c-47e8-a99d-5353b825d7fb None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:35.776010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a470ac8-3b35-4b36-85c9-1e6479c0b82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:35.776684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470ac8-3b35-4b36-85c9-1e6479c0b82a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:35.776992 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470ac8-3b35-4b36-85c9-1e6479c0b82a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:35.777276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470ac8-3b35-4b36-85c9-1e6479c0b82a None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:35.778254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a470ac8-3b35-4b36-85c9-1e6479c0b82a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:35.781191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a470ac8-3b35-4b36-85c9-1e6479c0b82a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:35.787110 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 484/1001] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jul 21 22:17:35 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:17:37.370234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d99d0c-8a32-4b27-ad60-bb1f4da34a03 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:37.370723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d99d0c-8a32-4b27-ad60-bb1f4da34a03 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:37.370723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d99d0c-8a32-4b27-ad60-bb1f4da34a03 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:37.372124 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 518/1002] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:37.377199 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bef45-8643-421c-9b01-e3dc1d8f8afb None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:37.377579 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bef45-8643-421c-9b01-e3dc1d8f8afb None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:37.377764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bef45-8643-421c-9b01-e3dc1d8f8afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:37.394452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-dc9bef45-8643-421c-9b01-e3dc1d8f8afb None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:37.395634 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-dc9bef45-8643-421c-9b01-e3dc1d8f8afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:37.427236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:37.431046 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473cc98-7307-49eb-9ace-e94b508d3820 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:37.431337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473cc98-7307-49eb-9ace-e94b508d3820 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:37.431616 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473cc98-7307-49eb-9ace-e94b508d3820 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:37.433039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 519/1003] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:37.437865 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac749ee-720c-44d5-b9f6-94bba365ac71 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:37.438150 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac749ee-720c-44d5-b9f6-94bba365ac71 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:37.438426 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac749ee-720c-44d5-b9f6-94bba365ac71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:37.455300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cac749ee-720c-44d5-b9f6-94bba365ac71 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:37.456466 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cac749ee-720c-44d5-b9f6-94bba365ac71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:37.469317 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 485/1004] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:37.490160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bef45-8643-421c-9b01-e3dc1d8f8afb None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:37.529019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 520/1005] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:37.552741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac749ee-720c-44d5-b9f6-94bba365ac71 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:37.597633 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bef45-8643-421c-9b01-e3dc1d8f8afb None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:37.633637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31d1e7-8106-47e3-bc97-5b3bbccf9e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:37.634274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31d1e7-8106-47e3-bc97-5b3bbccf9e00 None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:37.634558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31d1e7-8106-47e3-bc97-5b3bbccf9e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:37.634836 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31d1e7-8106-47e3-bc97-5b3bbccf9e00 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:37.635563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31d1e7-8106-47e3-bc97-5b3bbccf9e00 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:37.636946 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31d1e7-8106-47e3-bc97-5b3bbccf9e00 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:37.653466 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 486/1006] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jul 21 22:17:37 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:17:37.670311 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac749ee-720c-44d5-b9f6-94bba365ac71 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:37.697946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:37.718826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5cedc-9b8c-44c0-88c7-eb6ec92b2ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:37.719655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5cedc-9b8c-44c0-88c7-eb6ec92b2ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:37.719945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5cedc-9b8c-44c0-88c7-eb6ec92b2ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:37.720222 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5cedc-9b8c-44c0-88c7-eb6ec92b2ef2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:37.720886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5cedc-9b8c-44c0-88c7-eb6ec92b2ef2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:37.722338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5cedc-9b8c-44c0-88c7-eb6ec92b2ef2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-0db5cedc-9b8c-44c0-88c7-eb6ec92b2ef2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:37.735873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:37.736917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:37.743047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:37.743047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:37.743047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:37.743047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:37.743047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:37.743047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:37.743047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:37.743047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:37.743047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:37.743047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:37.743047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:37.743047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:37.743047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 22:17:37.743047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:37.743047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 521/1007] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jul 21 22:17:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:37.743838 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31d1e7-8106-47e3-bc97-5b3bbccf9e00 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:37.776747 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:37.836319 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166bf93-59b6-4e65-9d76-06dd7f1b2ea8 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:37.837605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166bf93-59b6-4e65-9d76-06dd7f1b2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:37.837605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166bf93-59b6-4e65-9d76-06dd7f1b2ea8 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:37.838895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 522/1008] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:37.844429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6834be-3e2c-4820-88b6-32a4ccadf47b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:37.844785 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6834be-3e2c-4820-88b6-32a4ccadf47b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:37.845155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6834be-3e2c-4820-88b6-32a4ccadf47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:37.861979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31d1e7-8106-47e3-bc97-5b3bbccf9e00 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:37.862364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ff6834be-3e2c-4820-88b6-32a4ccadf47b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:37.863544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ff6834be-3e2c-4820-88b6-32a4ccadf47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:37.897501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a9891-9f9e-4704-bb87-1abab7306dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:37.898099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a9891-9f9e-4704-bb87-1abab7306dea None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:37.898384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a9891-9f9e-4704-bb87-1abab7306dea None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:37.898663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a9891-9f9e-4704-bb87-1abab7306dea None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:37.899977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a9891-9f9e-4704-bb87-1abab7306dea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:37.900292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a9891-9f9e-4704-bb87-1abab7306dea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:37.902131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a9891-9f9e-4704-bb87-1abab7306dea None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:37.907021 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 487/1009] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jul 21 22:17:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:37.912552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a9891-9f9e-4704-bb87-1abab7306dea None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:37.936670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 523/1010] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:37 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:37.959879 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6834be-3e2c-4820-88b6-32a4ccadf47b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:38.020013 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:38.031252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a9891-9f9e-4704-bb87-1abab7306dea None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:38.065646 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae92eb-8fc7-411c-a1ba-826782ad95e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:38.066492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae92eb-8fc7-411c-a1ba-826782ad95e8 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:38.066603 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae92eb-8fc7-411c-a1ba-826782ad95e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:38.066854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae92eb-8fc7-411c-a1ba-826782ad95e8 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:38.067563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae92eb-8fc7-411c-a1ba-826782ad95e8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:38.067869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae92eb-8fc7-411c-a1ba-826782ad95e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:38.069267 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae92eb-8fc7-411c-a1ba-826782ad95e8 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:38.079154 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 488/1011] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jul 21 22:17:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:38.079316 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6834be-3e2c-4820-88b6-32a4ccadf47b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:38.080768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae92eb-8fc7-411c-a1ba-826782ad95e8 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:38.095176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:38.117074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5338a-a60f-498d-a04f-5cb76ac12143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:38.118385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5338a-a60f-498d-a04f-5cb76ac12143 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:38.118665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5338a-a60f-498d-a04f-5cb76ac12143 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:38.118944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5338a-a60f-498d-a04f-5cb76ac12143 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:38.119593 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5338a-a60f-498d-a04f-5cb76ac12143 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:38.120970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5338a-a60f-498d-a04f-5cb76ac12143 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-fcf5338a-a60f-498d-a04f-5cb76ac12143 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:38.134069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:38.135109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:38.135970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:38.135970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:38.135970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:38.135970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:38.135970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:38.135970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:38.135970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:38.135970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:38.135970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:38.135970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:38.135970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:38.135970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:38.135970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 22:17:38.135970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:38.135970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 524/1012] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:38.141180 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5338a-a60f-498d-a04f-5cb76ac12143 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:38.191062 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae92eb-8fc7-411c-a1ba-826782ad95e8 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:38.232895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa90bc-3701-4390-be35-45b05be8692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:38.233845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa90bc-3701-4390-be35-45b05be8692d None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:38.234511 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa90bc-3701-4390-be35-45b05be8692d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:38.234800 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa90bc-3701-4390-be35-45b05be8692d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:38.235805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa90bc-3701-4390-be35-45b05be8692d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:38.237915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa90bc-3701-4390-be35-45b05be8692d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:38.244603 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5338a-a60f-498d-a04f-5cb76ac12143 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:38.254907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 489/1013] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jul 21 22:17:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:17:38.289715 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a97c11-bca6-495f-b5a7-77e8a785aa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:38.290450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a97c11-bca6-495f-b5a7-77e8a785aa46 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:38.290789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a97c11-bca6-495f-b5a7-77e8a785aa46 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:38.291073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a97c11-bca6-495f-b5a7-77e8a785aa46 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:38.291805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a97c11-bca6-495f-b5a7-77e8a785aa46 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:38.292121 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a97c11-bca6-495f-b5a7-77e8a785aa46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:38.293613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a97c11-bca6-495f-b5a7-77e8a785aa46 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:38.304375 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 525/1014] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jul 21 22:17:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:38.306397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa90bc-3701-4390-be35-45b05be8692d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:38.327101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:38.418920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa90bc-3701-4390-be35-45b05be8692d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:38.454141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba932f5-17ef-479b-9428-d3c57c35bc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:38.454792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba932f5-17ef-479b-9428-d3c57c35bc8b None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:38.455083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba932f5-17ef-479b-9428-d3c57c35bc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:38.455360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba932f5-17ef-479b-9428-d3c57c35bc8b None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:38.456075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba932f5-17ef-479b-9428-d3c57c35bc8b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:38.456384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba932f5-17ef-479b-9428-d3c57c35bc8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:38.457783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba932f5-17ef-479b-9428-d3c57c35bc8b None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:38.463251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 490/1015] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jul 21 22:17:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:38.468771 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a97c11-bca6-495f-b5a7-77e8a785aa46 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:38.506495 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:38.572776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a97c11-bca6-495f-b5a7-77e8a785aa46 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:38.607124 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc7992-9935-478d-aaf3-a7c7b03f1232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:38.607782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc7992-9935-478d-aaf3-a7c7b03f1232 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:38.608070 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc7992-9935-478d-aaf3-a7c7b03f1232 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:38.608350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc7992-9935-478d-aaf3-a7c7b03f1232 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:38.609146 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc7992-9935-478d-aaf3-a7c7b03f1232 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:38.610516 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc7992-9935-478d-aaf3-a7c7b03f1232 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:38.636965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 526/1016] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jul 21 22:17:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:17:39.735976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01191c36-6137-48bb-b60f-24381cbc261c None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:39.736523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01191c36-6137-48bb-b60f-24381cbc261c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:39.736523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01191c36-6137-48bb-b60f-24381cbc261c None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:39.737980 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 491/1017] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:39.743210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d83bc9-6e70-465f-b2db-cc49bd20c288 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:39.743652 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d83bc9-6e70-465f-b2db-cc49bd20c288 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:39.743798 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d83bc9-6e70-465f-b2db-cc49bd20c288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:39.760426 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-81d83bc9-6e70-465f-b2db-cc49bd20c288 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:39.761616 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-81d83bc9-6e70-465f-b2db-cc49bd20c288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:39.842399 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 527/1018] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:39.866243 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01191c36-6137-48bb-b60f-24381cbc261c None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:39.945093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:39.966690 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01191c36-6137-48bb-b60f-24381cbc261c None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:40.001146 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1f192-272a-4660-9e36-ede61c031028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:40.002210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1f192-272a-4660-9e36-ede61c031028 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:40.002687 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1f192-272a-4660-9e36-ede61c031028 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:40.003159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1f192-272a-4660-9e36-ede61c031028 None admin] PATH_INFO: `/v3/services/image` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:40.003981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1f192-272a-4660-9e36-ede61c031028 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:40.005531 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1f192-272a-4660-9e36-ede61c031028 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-aac1f192-272a-4660-9e36-ede61c031028 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:40.018858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:40.019864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:40.020712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:40.020712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:40.020712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:40.020712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:40.020712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:40.020712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:40.020712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:40.020712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:40.020712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:40.020712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:40.020712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:40.020712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:40.020712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:17:40.020712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:40.022423 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 492/1019] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Jul 21 22:17:39 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:40.029039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d83bc9-6e70-465f-b2db-cc49bd20c288 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:40.047798 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:40.141838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d83bc9-6e70-465f-b2db-cc49bd20c288 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:40.176156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01b436-46ac-4cf4-9228-90d4a1fb33c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:40.176822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01b436-46ac-4cf4-9228-90d4a1fb33c6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:40.177126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01b436-46ac-4cf4-9228-90d4a1fb33c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:40.177405 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01b436-46ac-4cf4-9228-90d4a1fb33c6 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:40.178108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01b436-46ac-4cf4-9228-90d4a1fb33c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:40.178410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01b436-46ac-4cf4-9228-90d4a1fb33c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:40.179765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01b436-46ac-4cf4-9228-90d4a1fb33c6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:40.189547 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 528/1020] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:40.190781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1f192-272a-4660-9e36-ede61c031028 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:40.294096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1f192-272a-4660-9e36-ede61c031028 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:40.312954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3a934-ad03-4fb8-9a8e-37b041c1fb1e None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:40.313247 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3a934-ad03-4fb8-9a8e-37b041c1fb1e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:40.313521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3a934-ad03-4fb8-9a8e-37b041c1fb1e None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:40.315010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 529/1021] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:40.319888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c2899-ecf3-4f8c-933a-4d2a9a8b5a92 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:40.320366 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c2899-ecf3-4f8c-933a-4d2a9a8b5a92 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:40.321201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c2899-ecf3-4f8c-933a-4d2a9a8b5a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:40.330022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a222d2-dd52-42d9-8ce6-0936d73694c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:40.330698 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a222d2-dd52-42d9-8ce6-0936d73694c5 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:40.330984 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a222d2-dd52-42d9-8ce6-0936d73694c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:40.331263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a222d2-dd52-42d9-8ce6-0936d73694c5 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:40.331975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a222d2-dd52-42d9-8ce6-0936d73694c5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:40.332715 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a222d2-dd52-42d9-8ce6-0936d73694c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:40.334140 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a222d2-dd52-42d9-8ce6-0936d73694c5 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:40.338465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7a9c2899-ecf3-4f8c-933a-4d2a9a8b5a92 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:40.339801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 493/1022] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:40.339904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7a9c2899-ecf3-4f8c-933a-4d2a9a8b5a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:40.345705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a222d2-dd52-42d9-8ce6-0936d73694c5 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:40.357071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:40.414690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 530/1023] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:40.438048 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c2899-ecf3-4f8c-933a-4d2a9a8b5a92 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:40.452210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a222d2-dd52-42d9-8ce6-0936d73694c5 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:40.454095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:40.488667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98704c-1cd5-48eb-a016-3a8079624dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:40.489361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98704c-1cd5-48eb-a016-3a8079624dcb None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:40.489647 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98704c-1cd5-48eb-a016-3a8079624dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:40.489927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98704c-1cd5-48eb-a016-3a8079624dcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:40.490737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98704c-1cd5-48eb-a016-3a8079624dcb None admin] RBAC: Adding query filter params (interface=public, service_id=d4667240cea34f18ad0008b4b39c1873, region_id=RegionOne) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:40.491037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98704c-1cd5-48eb-a016-3a8079624dcb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:40.492404 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98704c-1cd5-48eb-a016-3a8079624dcb None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:40.498507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 494/1024] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jul 21 22:17:40 2022] GET /identity/v3/endpoints?service_id=d4667240cea34f18ad0008b4b39c1873&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:40.503733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98704c-1cd5-48eb-a016-3a8079624dcb None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:40.543252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c2899-ecf3-4f8c-933a-4d2a9a8b5a92 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:40.577565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:40.577887 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa747c-c5cc-4865-993a-04e224670eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:40.578679 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa747c-c5cc-4865-993a-04e224670eae None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:40.578962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa747c-c5cc-4865-993a-04e224670eae None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:40.579238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa747c-c5cc-4865-993a-04e224670eae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:40.580531 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa747c-c5cc-4865-993a-04e224670eae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:40.581969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa747c-c5cc-4865-993a-04e224670eae None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:40.583743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 531/1025] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:40.589168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa747c-c5cc-4865-993a-04e224670eae None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:40.611865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98704c-1cd5-48eb-a016-3a8079624dcb None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:40.647429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231e741-04e1-4ad5-a9b3-d0cf781ff7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:40.648099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231e741-04e1-4ad5-a9b3-d0cf781ff7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:40.648387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231e741-04e1-4ad5-a9b3-d0cf781ff7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:40.648662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231e741-04e1-4ad5-a9b3-d0cf781ff7e8 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:40.649406 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231e741-04e1-4ad5-a9b3-d0cf781ff7e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:40.650767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231e741-04e1-4ad5-a9b3-d0cf781ff7e8 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:40.664040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 495/1026] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jul 21 22:17:40 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:17:40.676999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:40.700565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa747c-c5cc-4865-993a-04e224670eae None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:40.738624 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b2092-8b03-4156-832f-1967a3fc88c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:40.739296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b2092-8b03-4156-832f-1967a3fc88c9 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:40.739579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b2092-8b03-4156-832f-1967a3fc88c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:40.739853 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b2092-8b03-4156-832f-1967a3fc88c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:40.740576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b2092-8b03-4156-832f-1967a3fc88c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:40.742187 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b2092-8b03-4156-832f-1967a3fc88c9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:40.772947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73393db6-3908-40c7-a5f3-1f67bb230b3b None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:40.773514 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73393db6-3908-40c7-a5f3-1f67bb230b3b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:40.773514 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73393db6-3908-40c7-a5f3-1f67bb230b3b None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:40.775839 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 496/1027] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:40.776644 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 532/1028] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jul 21 22:17:40 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:17:40.782964 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2048f-44cc-460e-8dd1-0d31bcfc9d61 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:40.783270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2048f-44cc-460e-8dd1-0d31bcfc9d61 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:40.783705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2048f-44cc-460e-8dd1-0d31bcfc9d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:40.802157 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-b5b2048f-44cc-460e-8dd1-0d31bcfc9d61 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:40.803526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b5b2048f-44cc-460e-8dd1-0d31bcfc9d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:40.885146 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 497/1029] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:40.907373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b2092-8b03-4156-832f-1967a3fc88c9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:41.013709 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b2092-8b03-4156-832f-1967a3fc88c9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:41.043394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:41.050479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08641f0-584d-4da7-93a4-f32f7b5a7577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:41.051738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08641f0-584d-4da7-93a4-f32f7b5a7577 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:41.052376 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08641f0-584d-4da7-93a4-f32f7b5a7577 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:41.053043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08641f0-584d-4da7-93a4-f32f7b5a7577 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:41.068630 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08641f0-584d-4da7-93a4-f32f7b5a7577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d08641f0-584d-4da7-93a4-f32f7b5a7577 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:41.077885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:41.078814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:41.079632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:41.079632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:41.079632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:41.079632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:41.079632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:41.079632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:41.079632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:41.079632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:41.079632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:41.079632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:41.079632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:17:41.079632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:41.080858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 533/1030] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jul 21 22:17:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:41.085498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2048f-44cc-460e-8dd1-0d31bcfc9d61 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:41.155695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:41.191435 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2048f-44cc-460e-8dd1-0d31bcfc9d61 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:41.225090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14152854-7c40-4712-bfce-30a615e9623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:41.225845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14152854-7c40-4712-bfce-30a615e9623c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:41.226128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14152854-7c40-4712-bfce-30a615e9623c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:41.226402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14152854-7c40-4712-bfce-30a615e9623c None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:41.227168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14152854-7c40-4712-bfce-30a615e9623c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:41.227471 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14152854-7c40-4712-bfce-30a615e9623c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:41.228821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14152854-7c40-4712-bfce-30a615e9623c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:41.241367 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 498/1031] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jul 21 22:17:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:41.243427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08641f0-584d-4da7-93a4-f32f7b5a7577 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:41.347687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08641f0-584d-4da7-93a4-f32f7b5a7577 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:41.381370 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a2c6-abad-4a6c-a7aa-cc9cb183907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:41.382163 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a2c6-abad-4a6c-a7aa-cc9cb183907c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:41.382445 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a2c6-abad-4a6c-a7aa-cc9cb183907c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:41.382718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a2c6-abad-4a6c-a7aa-cc9cb183907c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:41.394123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4a2c6-abad-4a6c-a7aa-cc9cb183907c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:41.395565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4a2c6-abad-4a6c-a7aa-cc9cb183907c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:41.412885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-79c4a2c6-abad-4a6c-a7aa-cc9cb183907c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:41.412885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:41.412885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:41.412885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:41.412885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:41.412885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:41.412885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:41.412885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:41.412885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:41.412885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:41.412885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:41.412885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:41.412885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:41.412885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:41.412885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:41.413838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:41.414745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:41.414745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:41.414745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:41.414745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:41.417257 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 534/1032] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:41.419991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14152854-7c40-4712-bfce-30a615e9623c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:41.522955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14152854-7c40-4712-bfce-30a615e9623c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:41.549053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:41.558620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d53b78-302c-4601-b178-8f4b434a6d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:41.559540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d53b78-302c-4601-b178-8f4b434a6d1d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:41.560007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d53b78-302c-4601-b178-8f4b434a6d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:41.560464 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d53b78-302c-4601-b178-8f4b434a6d1d None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:41.561409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d53b78-302c-4601-b178-8f4b434a6d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:41.561919 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d53b78-302c-4601-b178-8f4b434a6d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:41.563458 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d53b78-302c-4601-b178-8f4b434a6d1d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:41.579783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 499/1033] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:41.581504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a2c6-abad-4a6c-a7aa-cc9cb183907c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:41.628115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:41.683786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a2c6-abad-4a6c-a7aa-cc9cb183907c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:41.716284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3d047-2b67-456c-9c3a-76afed9b3ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:41.717346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3d047-2b67-456c-9c3a-76afed9b3ccd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:41.717814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3d047-2b67-456c-9c3a-76afed9b3ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:41.718293 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3d047-2b67-456c-9c3a-76afed9b3ccd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:41.725785 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3d047-2b67-456c-9c3a-76afed9b3ccd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:41.727941 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3d047-2b67-456c-9c3a-76afed9b3ccd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-80b3d047-2b67-456c-9c3a-76afed9b3ccd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:41.742030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:41.743611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:41.744571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:41.744571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:41.744571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:41.744571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:41.744571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:41.744571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:41.744571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:41.744571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:41.744571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:17:41.744571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:41.751206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 535/1034] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jul 21 22:17:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:41.752710 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d53b78-302c-4601-b178-8f4b434a6d1d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:41.854916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d53b78-302c-4601-b178-8f4b434a6d1d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:41.888648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99081f75-1a47-4eb0-b486-007743993b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:41.889654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99081f75-1a47-4eb0-b486-007743993b11 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:41.890148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99081f75-1a47-4eb0-b486-007743993b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:41.890659 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99081f75-1a47-4eb0-b486-007743993b11 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:41.891704 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99081f75-1a47-4eb0-b486-007743993b11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:41.892221 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99081f75-1a47-4eb0-b486-007743993b11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:41.893861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99081f75-1a47-4eb0-b486-007743993b11 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:41.917148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 500/1035] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jul 21 22:17:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:41.918968 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3d047-2b67-456c-9c3a-76afed9b3ccd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:42.019050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3d047-2b67-456c-9c3a-76afed9b3ccd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:42.021786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:42.054934 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1aec6-a560-449d-8c10-7413c19feb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:42.055910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1aec6-a560-449d-8c10-7413c19feb4a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:42.056404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1aec6-a560-449d-8c10-7413c19feb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:42.056904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1aec6-a560-449d-8c10-7413c19feb4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:42.128290 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1aec6-a560-449d-8c10-7413c19feb4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:42.129766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1aec6-a560-449d-8c10-7413c19feb4a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:42.229111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 536/1036] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:17:41 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 22:17:42.231941 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99081f75-1a47-4eb0-b486-007743993b11 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:42.278803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:42.331938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99081f75-1a47-4eb0-b486-007743993b11 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:42.366884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e8d91-2999-44a3-81ae-099353d61549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:42.367711 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e8d91-2999-44a3-81ae-099353d61549 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:42.367995 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e8d91-2999-44a3-81ae-099353d61549 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:42.368279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e8d91-2999-44a3-81ae-099353d61549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:42.378170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e8d91-2999-44a3-81ae-099353d61549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:42.379598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e8d91-2999-44a3-81ae-099353d61549 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:42.397327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-032e8d91-2999-44a3-81ae-099353d61549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:42.397327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:42.397327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:42.397327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:42.397327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:42.397327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:42.397327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:42.397327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:42.397327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:42.397327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:42.397327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:42.397327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:42.397327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:42.397327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:42.397327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:42.398248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:42.399729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:42.399729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:42.399729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:42.399729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:42.401252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 501/1037] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:42.405155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1aec6-a560-449d-8c10-7413c19feb4a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:42.408369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:42.504645 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1aec6-a560-449d-8c10-7413c19feb4a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:42.539434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593d021-f718-4f7b-8660-24b47411981b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:42.540361 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593d021-f718-4f7b-8660-24b47411981b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:42.540824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593d021-f718-4f7b-8660-24b47411981b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:42.541308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593d021-f718-4f7b-8660-24b47411981b None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:42.542200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593d021-f718-4f7b-8660-24b47411981b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:42.542719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593d021-f718-4f7b-8660-24b47411981b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:42.544256 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593d021-f718-4f7b-8660-24b47411981b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:42.560051 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 537/1038] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:42.561809 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e8d91-2999-44a3-81ae-099353d61549 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:42.658428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:42.662904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e8d91-2999-44a3-81ae-099353d61549 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:42.696970 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000f003-e607-4136-990c-536d5fbf46ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:42.698048 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000f003-e607-4136-990c-536d5fbf46ea None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:42.698511 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000f003-e607-4136-990c-536d5fbf46ea None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:42.698967 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000f003-e607-4136-990c-536d5fbf46ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:42.705846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000f003-e607-4136-990c-536d5fbf46ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:42.707478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000f003-e607-4136-990c-536d5fbf46ea None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:42.721766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-f000f003-e607-4136-990c-536d5fbf46ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:42.721766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:42.721766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:42.721766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:42.721766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:42.721766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:42.721766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:42.721766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:42.721766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:42.721766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:42.721766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:42.721766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:42.721766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:42.721766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:42.721766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:42.722663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:42.723652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:42.723652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:42.723652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:42.723652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:42.723652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:42.723652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:42.723652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:42.723652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:42.729773 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 502/1039] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:42.731446 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000f003-e607-4136-990c-536d5fbf46ea None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:42.731579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b35323-40dc-418d-bcb3-1dd9b456b246 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:42.731743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b35323-40dc-418d-bcb3-1dd9b456b246 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:42.732029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b35323-40dc-418d-bcb3-1dd9b456b246 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:42.733443 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 538/1040] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:42.738476 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef9819-9c62-4d8e-9de9-7e7bf2c1eef1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:42.738761 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef9819-9c62-4d8e-9de9-7e7bf2c1eef1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:42.739042 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef9819-9c62-4d8e-9de9-7e7bf2c1eef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:42.757688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b6ef9819-9c62-4d8e-9de9-7e7bf2c1eef1 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:42.760013 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b6ef9819-9c62-4d8e-9de9-7e7bf2c1eef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:42.823168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:42.832779 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 539/1041] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:42.852773 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000f003-e607-4136-990c-536d5fbf46ea None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:42.855044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef9819-9c62-4d8e-9de9-7e7bf2c1eef1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:42.889737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f518a36-1300-43d8-971c-37ba6d06655c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:42.890972 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f518a36-1300-43d8-971c-37ba6d06655c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:42.891425 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f518a36-1300-43d8-971c-37ba6d06655c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:42.891709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f518a36-1300-43d8-971c-37ba6d06655c None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:42.892502 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f518a36-1300-43d8-971c-37ba6d06655c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:42.892816 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f518a36-1300-43d8-971c-37ba6d06655c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:42.894277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f518a36-1300-43d8-971c-37ba6d06655c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:42.906250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 503/1042] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:42.910613 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa886f3-5287-468d-b829-dcbd617644bd None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:42.910908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa886f3-5287-468d-b829-dcbd617644bd None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:42.911374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa886f3-5287-468d-b829-dcbd617644bd None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:42.912649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 504/1043] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:42.913375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa886f3-5287-468d-b829-dcbd617644bd None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:42.933167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:42.963147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef9819-9c62-4d8e-9de9-7e7bf2c1eef1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:42.996911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11de03b-3937-4f90-9e86-e5ab21a9abee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:42.997757 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11de03b-3937-4f90-9e86-e5ab21a9abee None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:42.998044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11de03b-3937-4f90-9e86-e5ab21a9abee None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:42.998327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11de03b-3937-4f90-9e86-e5ab21a9abee None admin] PATH_INFO: `/v3/services/image` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:42.998980 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11de03b-3937-4f90-9e86-e5ab21a9abee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:43.000345 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11de03b-3937-4f90-9e86-e5ab21a9abee None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a11de03b-3937-4f90-9e86-e5ab21a9abee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:43.011725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:43.012691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:43.018713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:43.018713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:43.018713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:43.018713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:43.018713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:43.018713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:43.018713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:43.018713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:43.018713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:43.018713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:43.018713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:17:43.018713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:17:43.018713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 22:17:43.018713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:43.018713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 540/1044] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Jul 21 22:17:42 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:43.019553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa886f3-5287-468d-b829-dcbd617644bd None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:43.019640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d898507-a09e-4d9d-918d-991213609988 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:43.019640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d898507-a09e-4d9d-918d-991213609988 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:43.019640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d898507-a09e-4d9d-918d-991213609988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:43.030879 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7d898507-a09e-4d9d-918d-991213609988 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:43.032062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7d898507-a09e-4d9d-918d-991213609988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:43.047105 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea908e5-3ef5-48dd-8766-77cadfcc8298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:43.047673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea908e5-3ef5-48dd-8766-77cadfcc8298 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:43.047954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea908e5-3ef5-48dd-8766-77cadfcc8298 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:43.048228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea908e5-3ef5-48dd-8766-77cadfcc8298 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:43.049083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea908e5-3ef5-48dd-8766-77cadfcc8298 None admin] RBAC: Adding query filter params (role.id=7e4df69fe73e4323b8a543ee45b8c60c, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=2c04dc3ee4484afaab388cbb306974af) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:43.049399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea908e5-3ef5-48dd-8766-77cadfcc8298 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:43.050804 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea908e5-3ef5-48dd-8766-77cadfcc8298 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:43.056728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 505/1045] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:17:42 2022] GET /identity/v3/role_assignments?user.id=2c04dc3ee4484afaab388cbb306974af&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=7e4df69fe73e4323b8a543ee45b8c60c => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:43.058093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea908e5-3ef5-48dd-8766-77cadfcc8298 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:43.100023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:43.116720 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 541/1046] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:43.141596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d898507-a09e-4d9d-918d-991213609988 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:43.169574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:43.192507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea908e5-3ef5-48dd-8766-77cadfcc8298 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:43.239628 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af01c3-3ff3-4cb1-bec7-c8162b93adc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:43.240342 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af01c3-3ff3-4cb1-bec7-c8162b93adc7 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:43.240635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af01c3-3ff3-4cb1-bec7-c8162b93adc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:43.240919 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af01c3-3ff3-4cb1-bec7-c8162b93adc7 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:43.241665 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af01c3-3ff3-4cb1-bec7-c8162b93adc7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:43.241977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af01c3-3ff3-4cb1-bec7-c8162b93adc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:43.243913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af01c3-3ff3-4cb1-bec7-c8162b93adc7 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:43.253647 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 506/1047] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:43.254651 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af01c3-3ff3-4cb1-bec7-c8162b93adc7 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:43.261444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d898507-a09e-4d9d-918d-991213609988 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:43.296204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673532f9-2d6a-4ba4-aacb-bc199994b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:43.297061 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673532f9-2d6a-4ba4-aacb-bc199994b641 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:43.297347 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673532f9-2d6a-4ba4-aacb-bc199994b641 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:43.297628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673532f9-2d6a-4ba4-aacb-bc199994b641 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:43.298797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673532f9-2d6a-4ba4-aacb-bc199994b641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:43.300227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673532f9-2d6a-4ba4-aacb-bc199994b641 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:43.302180 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 542/1048] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:43.308010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673532f9-2d6a-4ba4-aacb-bc199994b641 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:43.365545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af01c3-3ff3-4cb1-bec7-c8162b93adc7 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:43.373124 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:43.402868 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149ce1-eaa7-458e-a12d-dbc1d84ebe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:43.403547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149ce1-eaa7-458e-a12d-dbc1d84ebe2f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:43.403834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149ce1-eaa7-458e-a12d-dbc1d84ebe2f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:43.404108 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149ce1-eaa7-458e-a12d-dbc1d84ebe2f None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:43.404814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e149ce1-eaa7-458e-a12d-dbc1d84ebe2f None admin] RBAC: Adding query filter params (type=image) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:43.405151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e149ce1-eaa7-458e-a12d-dbc1d84ebe2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:43.406507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e149ce1-eaa7-458e-a12d-dbc1d84ebe2f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:43.411498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 507/1049] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:43.417542 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149ce1-eaa7-458e-a12d-dbc1d84ebe2f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:43.427213 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673532f9-2d6a-4ba4-aacb-bc199994b641 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:43.429930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:43.465365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e71784-ca32-4a34-8a78-e24cc87b33b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:43.466044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e71784-ca32-4a34-8a78-e24cc87b33b9 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:43.466332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e71784-ca32-4a34-8a78-e24cc87b33b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:43.466609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e71784-ca32-4a34-8a78-e24cc87b33b9 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:43.467331 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e71784-ca32-4a34-8a78-e24cc87b33b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:43.468766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e71784-ca32-4a34-8a78-e24cc87b33b9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:43.491068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 543/1050] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:17:43 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:17:43.535117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149ce1-eaa7-458e-a12d-dbc1d84ebe2f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:43.572842 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805e937-134c-4b6a-bd6b-353848f309b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:43.573561 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805e937-134c-4b6a-bd6b-353848f309b1 None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:43.573847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805e937-134c-4b6a-bd6b-353848f309b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:43.574128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805e937-134c-4b6a-bd6b-353848f309b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:43.574902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805e937-134c-4b6a-bd6b-353848f309b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:43.576298 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805e937-134c-4b6a-bd6b-353848f309b1 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:43.597266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 508/1051] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jul 21 22:17:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:17:45.093935 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a8eba-8dff-4881-b6e7-f84e53bad259 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:45.094390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a8eba-8dff-4881-b6e7-f84e53bad259 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:45.094504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a8eba-8dff-4881-b6e7-f84e53bad259 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:45.096019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 544/1052] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:45.101128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19037f0-09d6-48cf-9d26-db59248af451 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:45.101506 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19037f0-09d6-48cf-9d26-db59248af451 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:45.101693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19037f0-09d6-48cf-9d26-db59248af451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:45.118717 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-f19037f0-09d6-48cf-9d26-db59248af451 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:45.119894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f19037f0-09d6-48cf-9d26-db59248af451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:45.179054 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:45.193545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 509/1053] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:45.216551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a8eba-8dff-4881-b6e7-f84e53bad259 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:45.321679 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a8eba-8dff-4881-b6e7-f84e53bad259 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:45.335086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:45.362689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033354f2-9131-4a18-8dfe-d02d49c63533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:45.363561 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033354f2-9131-4a18-8dfe-d02d49c63533 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:45.363852 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033354f2-9131-4a18-8dfe-d02d49c63533 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:45.364131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033354f2-9131-4a18-8dfe-d02d49c63533 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:45.374343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033354f2-9131-4a18-8dfe-d02d49c63533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-033354f2-9131-4a18-8dfe-d02d49c63533 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:45.382520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:45.384023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:45.384874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:45.384874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:45.384874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:45.384874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:45.384874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:45.384874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:45.384874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:45.384874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:45.384874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:45.384874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:45.384874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:17:45.384874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:45.388996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 545/1054] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jul 21 22:17:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:45.390530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19037f0-09d6-48cf-9d26-db59248af451 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:45.488046 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19037f0-09d6-48cf-9d26-db59248af451 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:45.521538 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae778fe-7c25-4393-a4fa-4c71f302b451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:45.522217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae778fe-7c25-4393-a4fa-4c71f302b451 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:45.522499 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae778fe-7c25-4393-a4fa-4c71f302b451 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:45.522776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae778fe-7c25-4393-a4fa-4c71f302b451 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:45.523524 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae778fe-7c25-4393-a4fa-4c71f302b451 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:45.524409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae778fe-7c25-4393-a4fa-4c71f302b451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:45.525884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae778fe-7c25-4393-a4fa-4c71f302b451 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:45.539141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 510/1055] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jul 21 22:17:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:45.540609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033354f2-9131-4a18-8dfe-d02d49c63533 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:45.622685 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08088b-0f08-4a12-bc3b-9f8e7e667b03 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:45.622888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08088b-0f08-4a12-bc3b-9f8e7e667b03 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:45.623158 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08088b-0f08-4a12-bc3b-9f8e7e667b03 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:45.624675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 511/1056] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:45.629298 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3fdaa-a24e-4aa9-adcf-ef341f5864ce None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:45.629581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3fdaa-a24e-4aa9-adcf-ef341f5864ce None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:45.629856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3fdaa-a24e-4aa9-adcf-ef341f5864ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:45.645902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033354f2-9131-4a18-8dfe-d02d49c63533 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:45.646421 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-fde3fdaa-a24e-4aa9-adcf-ef341f5864ce None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:45.647633 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-fde3fdaa-a24e-4aa9-adcf-ef341f5864ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:45.680491 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d4de3-68ba-45d2-aad1-b745389f5406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:45.681312 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d4de3-68ba-45d2-aad1-b745389f5406 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:45.681599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d4de3-68ba-45d2-aad1-b745389f5406 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:45.681880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d4de3-68ba-45d2-aad1-b745389f5406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:45.692169 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d4de3-68ba-45d2-aad1-b745389f5406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:45.693640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d4de3-68ba-45d2-aad1-b745389f5406 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:45.700803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:45.710988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ef5d4de3-68ba-45d2-aad1-b745389f5406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:45.710988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:45.710988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:45.710988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:45.710988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:45.710988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:45.710988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:45.710988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:45.710988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:45.710988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:45.710988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:45.710988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:45.710988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:45.710988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:45.710988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:45.712039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:45.713101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:45.713101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:45.713101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:45.713101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:45.713101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 546/1057] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:45.713497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d6b5-064e-4196-80d3-9dac28cbc937 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:45.713737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d6b5-064e-4196-80d3-9dac28cbc937 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:45.714015 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d6b5-064e-4196-80d3-9dac28cbc937 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:45.715411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 547/1058] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:45.718032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d6b5-064e-4196-80d3-9dac28cbc937 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:45.722126 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 512/1059] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:45.723383 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b768a9e-7f77-4f54-ab6f-e63f227460af None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:45.723674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b768a9e-7f77-4f54-ab6f-e63f227460af None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:45.723957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b768a9e-7f77-4f54-ab6f-e63f227460af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:45.739487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-3b768a9e-7f77-4f54-ab6f-e63f227460af None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:45.740669 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-3b768a9e-7f77-4f54-ab6f-e63f227460af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:45.748795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:45.806940 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 513/1060] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:45.807764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b768a9e-7f77-4f54-ab6f-e63f227460af None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:45.824942 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d6b5-064e-4196-80d3-9dac28cbc937 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:45.860123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761dacf-8387-42b1-9233-3fe4a00a158c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:45.860790 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761dacf-8387-42b1-9233-3fe4a00a158c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:45.861126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761dacf-8387-42b1-9233-3fe4a00a158c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:45.861390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761dacf-8387-42b1-9233-3fe4a00a158c None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:45.862117 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761dacf-8387-42b1-9233-3fe4a00a158c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:45.862426 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761dacf-8387-42b1-9233-3fe4a00a158c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:45.863795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761dacf-8387-42b1-9233-3fe4a00a158c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:45.875744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 548/1061] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:45.876472 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761dacf-8387-42b1-9233-3fe4a00a158c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:45.923573 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b768a9e-7f77-4f54-ab6f-e63f227460af None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:45.937695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:45.958345 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd2dfe-6dec-4088-a2a8-007981a08e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:45.959139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd2dfe-6dec-4088-a2a8-007981a08e03 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:45.959423 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd2dfe-6dec-4088-a2a8-007981a08e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:45.959707 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd2dfe-6dec-4088-a2a8-007981a08e03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:45.960028 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:45.972329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd2dfe-6dec-4088-a2a8-007981a08e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:45.976564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761dacf-8387-42b1-9233-3fe4a00a158c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-4cfd2dfe-6dec-4088-a2a8-007981a08e03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:45.980537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:45.981513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:45.982351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:45.982351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:45.982351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:45.982351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:45.982351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:45.982351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:45.982351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:45.982351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:45.982351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:45.982351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:45.982351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:45.982351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:45.982351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 514/1062] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:17:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:45.983041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd2dfe-6dec-4088-a2a8-007981a08e03 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:46.010352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba12c-1676-44fb-9edd-9b89ea547a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:46.011005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba12c-1676-44fb-9edd-9b89ea547a75 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:46.011294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba12c-1676-44fb-9edd-9b89ea547a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:46.011576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba12c-1676-44fb-9edd-9b89ea547a75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:46.081869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ba12c-1676-44fb-9edd-9b89ea547a75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:46.083334 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ba12c-1676-44fb-9edd-9b89ea547a75 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:46.087533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd2dfe-6dec-4088-a2a8-007981a08e03 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:46.120853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7558701-735a-49dd-b543-01ef1db5420c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:46.121690 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7558701-735a-49dd-b543-01ef1db5420c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:46.121972 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7558701-735a-49dd-b543-01ef1db5420c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:46.122248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7558701-735a-49dd-b543-01ef1db5420c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:46.129562 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7558701-735a-49dd-b543-01ef1db5420c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:46.130932 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7558701-735a-49dd-b543-01ef1db5420c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-a7558701-735a-49dd-b543-01ef1db5420c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:46.144738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:46.145787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:46.146760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:46.146760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:46.146760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:46.146760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:46.146760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:46.146760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:46.146760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:46.146760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:46.146760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:17:46.146760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:46.146760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 515/1063] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jul 21 22:17:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:46.146760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7558701-735a-49dd-b543-01ef1db5420c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:46.170151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:46.181206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:46.188174 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 549/1064] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:17:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:17:46.189017 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba12c-1676-44fb-9edd-9b89ea547a75 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:46.246858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7558701-735a-49dd-b543-01ef1db5420c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:46.278805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5c860-a373-4d01-ace5-d089e068024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:46.279480 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5c860-a373-4d01-ace5-d089e068024a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:46.279765 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5c860-a373-4d01-ace5-d089e068024a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:46.280043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5c860-a373-4d01-ace5-d089e068024a None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:46.280783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5c860-a373-4d01-ace5-d089e068024a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:46.281136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5c860-a373-4d01-ace5-d089e068024a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:46.282501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5c860-a373-4d01-ace5-d089e068024a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:46.287608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba12c-1676-44fb-9edd-9b89ea547a75 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:46.290881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 516/1065] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:17:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:46.291657 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5c860-a373-4d01-ace5-d089e068024a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:46.322956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22570e7f-340e-4a62-b730-8eac2fae28c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:46.323615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22570e7f-340e-4a62-b730-8eac2fae28c2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:46.323895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22570e7f-340e-4a62-b730-8eac2fae28c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:46.324169 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22570e7f-340e-4a62-b730-8eac2fae28c2 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:46.325021 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22570e7f-340e-4a62-b730-8eac2fae28c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:46.325328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22570e7f-340e-4a62-b730-8eac2fae28c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:46.326732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22570e7f-340e-4a62-b730-8eac2fae28c2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:46.344141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 550/1066] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jul 21 22:17:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:46.344759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22570e7f-340e-4a62-b730-8eac2fae28c2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:46.384556 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:46.387275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:46.390745 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5c860-a373-4d01-ace5-d089e068024a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:46.426065 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a2677-347a-4c2c-ad17-06899177f58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:46.426856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a2677-347a-4c2c-ad17-06899177f58b None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:46.427144 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a2677-347a-4c2c-ad17-06899177f58b None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:46.427425 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a2677-347a-4c2c-ad17-06899177f58b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:46.437693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a2677-347a-4c2c-ad17-06899177f58b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:46.439131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a2677-347a-4c2c-ad17-06899177f58b None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:46.443396 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22570e7f-340e-4a62-b730-8eac2fae28c2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:46.455903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-8b2a2677-347a-4c2c-ad17-06899177f58b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:46.455903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:46.455903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:46.455903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:46.455903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:46.455903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:46.455903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:46.455903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:46.455903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:46.455903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:46.455903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:46.455903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:46.455903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:46.455903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:46.455903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:46.456790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:46.457741 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:46.457741 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:46.457741 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:46.457741 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:46.461563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 517/1067] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:46.462695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a2677-347a-4c2c-ad17-06899177f58b None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:46.477622 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5aa832-1f95-4673-bdbf-8ffe00cfb169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:46.478488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5aa832-1f95-4673-bdbf-8ffe00cfb169 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:46.478766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5aa832-1f95-4673-bdbf-8ffe00cfb169 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:46.479035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5aa832-1f95-4673-bdbf-8ffe00cfb169 None admin] PATH_INFO: `/v3/users/d35c6cf402f041daa5bd8e144e948419` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:46.491895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5aa832-1f95-4673-bdbf-8ffe00cfb169 None admin] RBAC: Authorizing `identity:get_user(user_id=d35c6cf402f041daa5bd8e144e948419)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:46.493402 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5aa832-1f95-4673-bdbf-8ffe00cfb169 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:46.495072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 551/1068] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:17:46 2022] GET /identity/v3/users/d35c6cf402f041daa5bd8e144e948419 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:46.495827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5aa832-1f95-4673-bdbf-8ffe00cfb169 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:46.561981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a2677-347a-4c2c-ad17-06899177f58b None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:46.590028 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:46.592993 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5aa832-1f95-4673-bdbf-8ffe00cfb169 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:46.595254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9822e8-3a53-4c12-a917-cfa0fc54fad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:46.596044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9822e8-3a53-4c12-a917-cfa0fc54fad8 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:46.596325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9822e8-3a53-4c12-a917-cfa0fc54fad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:46.596593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9822e8-3a53-4c12-a917-cfa0fc54fad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:46.607999 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9822e8-3a53-4c12-a917-cfa0fc54fad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:46.609473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9822e8-3a53-4c12-a917-cfa0fc54fad8 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:46.617016 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:46.626571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71be7d8-907a-4287-a81e-be94824b9097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:46.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-9f9822e8-3a53-4c12-a917-cfa0fc54fad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:46.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:46.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:46.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:46.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:46.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:46.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:46.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:46.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:46.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:46.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:46.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:46.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:46.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:46.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:46.627880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:46.628777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:46.628777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:46.628777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:46.628777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:46.629330 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71be7d8-907a-4287-a81e-be94824b9097 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:46.629330 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71be7d8-907a-4287-a81e-be94824b9097 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:46.629330 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71be7d8-907a-4287-a81e-be94824b9097 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:46.629573 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 518/1069] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:46.629657 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71be7d8-907a-4287-a81e-be94824b9097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:46.629657 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71be7d8-907a-4287-a81e-be94824b9097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:46.629812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9822e8-3a53-4c12-a917-cfa0fc54fad8 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:46.630303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71be7d8-907a-4287-a81e-be94824b9097 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:46.643059 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 552/1070] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:46.644036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71be7d8-907a-4287-a81e-be94824b9097 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:46.747665 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9822e8-3a53-4c12-a917-cfa0fc54fad8 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:46.757852 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71be7d8-907a-4287-a81e-be94824b9097 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:46.786039 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa732c-48eb-4f85-b234-30f23a2f1785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:46.786700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa732c-48eb-4f85-b234-30f23a2f1785 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:46.786989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa732c-48eb-4f85-b234-30f23a2f1785 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:46.787267 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa732c-48eb-4f85-b234-30f23a2f1785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:46.796826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816d94c-470f-44ba-a822-2a217daeec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:46.797509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816d94c-470f-44ba-a822-2a217daeec0e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:46.798509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816d94c-470f-44ba-a822-2a217daeec0e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:46.798509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816d94c-470f-44ba-a822-2a217daeec0e None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:46.798773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816d94c-470f-44ba-a822-2a217daeec0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:46.799078 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816d94c-470f-44ba-a822-2a217daeec0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:46.800444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816d94c-470f-44ba-a822-2a217daeec0e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:46.814346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 553/1071] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:46.820153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816d94c-470f-44ba-a822-2a217daeec0e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:46.844672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:46.871451 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:46.874351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa732c-48eb-4f85-b234-30f23a2f1785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:46.876015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa732c-48eb-4f85-b234-30f23a2f1785 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:46.937474 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816d94c-470f-44ba-a822-2a217daeec0e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:46.971048 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0454d-d779-463b-97a7-e2aa58581f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:46.971846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0454d-d779-463b-97a7-e2aa58581f52 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:46.972127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0454d-d779-463b-97a7-e2aa58581f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:46.972403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0454d-d779-463b-97a7-e2aa58581f52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:46.979223 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0454d-d779-463b-97a7-e2aa58581f52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:46.980658 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0454d-d779-463b-97a7-e2aa58581f52 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:46.981982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 519/1072] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:17:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:17:46.987885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa732c-48eb-4f85-b234-30f23a2f1785 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:46.994232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-70a0454d-d779-463b-97a7-e2aa58581f52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:46.994232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:46.994232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:46.994232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:46.994232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:46.994232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:46.994232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:46.994232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:46.994232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:46.994232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:46.994232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:46.994232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:46.994232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:46.994232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:46.994232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:46.995308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:47.001404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:47.001404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:47.001404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:47.001404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:47.001404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:47.001404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:47.001404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:47.001404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:47.001404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 554/1073] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:47.001404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0454d-d779-463b-97a7-e2aa58581f52 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:47.084643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:47.091597 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:47.094584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa732c-48eb-4f85-b234-30f23a2f1785 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:47.105218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0454d-d779-463b-97a7-e2aa58581f52 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:47.127703 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722380a-643b-4655-b712-188df43465b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:47.128561 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722380a-643b-4655-b712-188df43465b8 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:47.128843 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722380a-643b-4655-b712-188df43465b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:47.129151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722380a-643b-4655-b712-188df43465b8 None admin] PATH_INFO: `/v3/projects/77deaca694ab4ba68fd4576e65220b05` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:47.130314 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722380a-643b-4655-b712-188df43465b8 None admin] RBAC: Authorizing `identity:get_project(project_id=77deaca694ab4ba68fd4576e65220b05)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:47.131724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722380a-643b-4655-b712-188df43465b8 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:47.134239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 520/1074] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:17:46 2022] GET /identity/v3/projects/77deaca694ab4ba68fd4576e65220b05 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:47.138480 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a088b-713d-486b-94a7-19d0f949c59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:47.139137 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a088b-713d-486b-94a7-19d0f949c59f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:47.139423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a088b-713d-486b-94a7-19d0f949c59f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:47.139698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a088b-713d-486b-94a7-19d0f949c59f None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:47.140043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722380a-643b-4655-b712-188df43465b8 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:47.140478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a088b-713d-486b-94a7-19d0f949c59f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:47.140785 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a088b-713d-486b-94a7-19d0f949c59f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:47.142242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a088b-713d-486b-94a7-19d0f949c59f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:47.154907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 555/1075] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:47.160456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a088b-713d-486b-94a7-19d0f949c59f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:47.237346 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722380a-643b-4655-b712-188df43465b8 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:47.256860 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a088b-713d-486b-94a7-19d0f949c59f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:47.270536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b648cd-a862-4299-b0c8-ecb0b88b70d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:47.271185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b648cd-a862-4299-b0c8-ecb0b88b70d4 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:47.271469 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b648cd-a862-4299-b0c8-ecb0b88b70d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:47.271757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b648cd-a862-4299-b0c8-ecb0b88b70d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:47.272572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b648cd-a862-4299-b0c8-ecb0b88b70d4 None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=77deaca694ab4ba68fd4576e65220b05, user.id=d35c6cf402f041daa5bd8e144e948419) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:47.272880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b648cd-a862-4299-b0c8-ecb0b88b70d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:47.274355 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b648cd-a862-4299-b0c8-ecb0b88b70d4 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:47.279837 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 521/1076] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:17:47 2022] GET /identity/v3/role_assignments?user.id=d35c6cf402f041daa5bd8e144e948419&scope.project.id=77deaca694ab4ba68fd4576e65220b05&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:47.290706 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5049c-96d2-4140-bf23-dfa82fc3a71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:47.291624 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5049c-96d2-4140-bf23-dfa82fc3a71f None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:47.291909 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5049c-96d2-4140-bf23-dfa82fc3a71f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:47.292190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5049c-96d2-4140-bf23-dfa82fc3a71f None admin] PATH_INFO: `/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/2c04dc3ee4484afaab388cbb306974af/roles/7e4df69fe73e4323b8a543ee45b8c60c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:47.294570 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5049c-96d2-4140-bf23-dfa82fc3a71f None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e77f9cc1c14e35b1d3e1874f107494, user_id=2c04dc3ee4484afaab388cbb306974af, role_id=7e4df69fe73e4323b8a543ee45b8c60c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:47.296058 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5049c-96d2-4140-bf23-dfa82fc3a71f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:47.306507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:47.312125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 556/1077] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:17:47 2022] PUT /identity/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/2c04dc3ee4484afaab388cbb306974af/roles/7e4df69fe73e4323b8a543ee45b8c60c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:17:49.295029 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3d89d-53e7-4667-a0ca-e7ecd58bdd10 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:49.295585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3d89d-53e7-4667-a0ca-e7ecd58bdd10 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:49.295585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3d89d-53e7-4667-a0ca-e7ecd58bdd10 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:49.296975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 522/1078] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:49.302234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0ba2-80c7-4440-a341-8628f82b443b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:49.302670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0ba2-80c7-4440-a341-8628f82b443b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:49.302792 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0ba2-80c7-4440-a341-8628f82b443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:49.319624 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-223a0ba2-80c7-4440-a341-8628f82b443b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:49.320622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c53cc-a76f-4303-8a4d-fccbcaea0a80 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:49.320793 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-223a0ba2-80c7-4440-a341-8628f82b443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:49.320910 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c53cc-a76f-4303-8a4d-fccbcaea0a80 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:49.321207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c53cc-a76f-4303-8a4d-fccbcaea0a80 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:49.322553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 523/1079] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:17:49.327506 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3cfd5-7e76-437d-aee3-8b35218c088f None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:49.327735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3cfd5-7e76-437d-aee3-8b35218c088f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:49.328017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3cfd5-7e76-437d-aee3-8b35218c088f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:49.345804 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-bcd3cfd5-7e76-437d-aee3-8b35218c088f None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:49.346966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-bcd3cfd5-7e76-437d-aee3-8b35218c088f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:49.372989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:49.390541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 557/1080] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:49.414690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a0ba2-80c7-4440-a341-8628f82b443b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:49.416188 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 524/1081] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:17:49.439085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3cfd5-7e76-437d-aee3-8b35218c088f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:49.510407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a0ba2-80c7-4440-a341-8628f82b443b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:49.534494 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3cfd5-7e76-437d-aee3-8b35218c088f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:49.538113 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:49.544450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2eae57-d264-4f5a-9d39-9aa08d1fce29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:49.545262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2eae57-d264-4f5a-9d39-9aa08d1fce29 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:49.545550 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2eae57-d264-4f5a-9d39-9aa08d1fce29 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:49.545827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2eae57-d264-4f5a-9d39-9aa08d1fce29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:49.555716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2eae57-d264-4f5a-9d39-9aa08d1fce29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3b2eae57-d264-4f5a-9d39-9aa08d1fce29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:49.563430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:49.564457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:49.565339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:49.565339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:49.565339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:49.565339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:49.565339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:49.565339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:49.565339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:49.565339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:49.565339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:49.565339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:49.565339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:49.565339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:49.567813 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47029409-b74f-42d6-9934-2c8a27b2841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:49.568637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47029409-b74f-42d6-9934-2c8a27b2841c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:49.568942 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47029409-b74f-42d6-9934-2c8a27b2841c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:49.569231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47029409-b74f-42d6-9934-2c8a27b2841c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:49.569670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 558/1082] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:17:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:49.570591 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2eae57-d264-4f5a-9d39-9aa08d1fce29 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:49.579688 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47029409-b74f-42d6-9934-2c8a27b2841c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-47029409-b74f-42d6-9934-2c8a27b2841c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:49.588420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:49.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:49.590569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:49.590569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:49.590569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:49.590569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:49.590569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:49.590569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:49.590569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:49.590569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:49.590569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:49.590569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:49.590569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 22:17:49.590569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:49.590569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 525/1083] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jul 21 22:17:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:49.595492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47029409-b74f-42d6-9934-2c8a27b2841c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:49.619715 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:49.672507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2eae57-d264-4f5a-9d39-9aa08d1fce29 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:49.692678 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47029409-b74f-42d6-9934-2c8a27b2841c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:49.704559 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6a50c-4ab9-4108-bb06-5eda8dff02cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:49.705260 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6a50c-4ab9-4108-bb06-5eda8dff02cd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:49.705543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6a50c-4ab9-4108-bb06-5eda8dff02cd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:49.705826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6a50c-4ab9-4108-bb06-5eda8dff02cd None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:49.706576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6a50c-4ab9-4108-bb06-5eda8dff02cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:49.706886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6a50c-4ab9-4108-bb06-5eda8dff02cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:49.708251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6a50c-4ab9-4108-bb06-5eda8dff02cd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:49.716698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 559/1084] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:17:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:49.722483 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6a50c-4ab9-4108-bb06-5eda8dff02cd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:49.724517 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c06976-c667-4a4b-8263-2168c5cde05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:49.725212 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c06976-c667-4a4b-8263-2168c5cde05e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:49.725497 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c06976-c667-4a4b-8263-2168c5cde05e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:49.725774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c06976-c667-4a4b-8263-2168c5cde05e None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:49.726514 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c06976-c667-4a4b-8263-2168c5cde05e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:49.727437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c06976-c667-4a4b-8263-2168c5cde05e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:49.728785 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c06976-c667-4a4b-8263-2168c5cde05e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:49.736619 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 526/1085] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jul 21 22:17:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:49.742125 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c06976-c667-4a4b-8263-2168c5cde05e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:49.776080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:49.824403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6a50c-4ab9-4108-bb06-5eda8dff02cd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:49.824912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:49.841235 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c06976-c667-4a4b-8263-2168c5cde05e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:49.858386 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bce9c4-4817-49d7-968b-f20541f14b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:49.859254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bce9c4-4817-49d7-968b-f20541f14b93 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:49.859540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bce9c4-4817-49d7-968b-f20541f14b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:49.859817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bce9c4-4817-49d7-968b-f20541f14b93 None admin] PATH_INFO: `/v3/users/d35c6cf402f041daa5bd8e144e948419` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:49.861046 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bce9c4-4817-49d7-968b-f20541f14b93 None admin] RBAC: Authorizing `identity:get_user(user_id=d35c6cf402f041daa5bd8e144e948419)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:49.862478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bce9c4-4817-49d7-968b-f20541f14b93 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:49.868868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 560/1086] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:17:49 2022] GET /identity/v3/users/d35c6cf402f041daa5bd8e144e948419 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:49.869826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bce9c4-4817-49d7-968b-f20541f14b93 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:49.873860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3481f8e-66a5-4071-8c68-041add58f62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:49.874657 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3481f8e-66a5-4071-8c68-041add58f62c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:49.874942 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3481f8e-66a5-4071-8c68-041add58f62c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:49.875222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3481f8e-66a5-4071-8c68-041add58f62c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:49.886435 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3481f8e-66a5-4071-8c68-041add58f62c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:49.887872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3481f8e-66a5-4071-8c68-041add58f62c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:49.905394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-b3481f8e-66a5-4071-8c68-041add58f62c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:49.905394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:49.905394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:49.905394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:49.905394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:49.905394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:49.905394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:49.905394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:49.905394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:49.905394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:49.905394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:49.905394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:49.905394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:49.905394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:49.905394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:49.906304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:49.907257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:49.907257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:49.907257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:49.907257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:49.907257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 527/1087] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:49.912245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3481f8e-66a5-4071-8c68-041add58f62c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:49.968081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bce9c4-4817-49d7-968b-f20541f14b93 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:49.986904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:50.001828 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbe15f-cf95-46b5-b1c2-5d676d2ce757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:50.002683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbe15f-cf95-46b5-b1c2-5d676d2ce757 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:50.002968 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbe15f-cf95-46b5-b1c2-5d676d2ce757 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:50.003246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbe15f-cf95-46b5-b1c2-5d676d2ce757 None admin] PATH_INFO: `/v3/projects/77deaca694ab4ba68fd4576e65220b05` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:50.004418 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbe15f-cf95-46b5-b1c2-5d676d2ce757 None admin] RBAC: Authorizing `identity:get_project(project_id=77deaca694ab4ba68fd4576e65220b05)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:50.005899 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbe15f-cf95-46b5-b1c2-5d676d2ce757 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:50.007701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 561/1088] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:17:49 2022] GET /identity/v3/projects/77deaca694ab4ba68fd4576e65220b05 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:50.008576 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3481f8e-66a5-4071-8c68-041add58f62c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:50.014014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbe15f-cf95-46b5-b1c2-5d676d2ce757 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:50.045127 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd9482-b13a-41cf-99c8-98572ac71519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:50.045781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd9482-b13a-41cf-99c8-98572ac71519 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:50.046058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd9482-b13a-41cf-99c8-98572ac71519 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:50.046332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd9482-b13a-41cf-99c8-98572ac71519 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:50.047042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd9482-b13a-41cf-99c8-98572ac71519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:50.047350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd9482-b13a-41cf-99c8-98572ac71519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:50.048693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd9482-b13a-41cf-99c8-98572ac71519 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:50.050913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:50.063799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 528/1089] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:17:50.069132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd9482-b13a-41cf-99c8-98572ac71519 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:50.114098 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbe15f-cf95-46b5-b1c2-5d676d2ce757 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:50.147093 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f710d-1a7f-48db-b8ce-be18354361a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:50.147976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f710d-1a7f-48db-b8ce-be18354361a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:50.148260 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f710d-1a7f-48db-b8ce-be18354361a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:50.148561 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f710d-1a7f-48db-b8ce-be18354361a1 None admin] PATH_INFO: `/v3/projects/77deaca694ab4ba68fd4576e65220b05/users/d35c6cf402f041daa5bd8e144e948419/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:50.150564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f710d-1a7f-48db-b8ce-be18354361a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=77deaca694ab4ba68fd4576e65220b05, user_id=d35c6cf402f041daa5bd8e144e948419, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:50.152002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f710d-1a7f-48db-b8ce-be18354361a1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:50.166936 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd9482-b13a-41cf-99c8-98572ac71519 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:50.167361 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 562/1090] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:17:50 2022] PUT /identity/v3/projects/77deaca694ab4ba68fd4576e65220b05/users/d35c6cf402f041daa5bd8e144e948419/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:17:50.203904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a3f69-b6ac-4afd-9d61-6335c4482b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:50.204719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a3f69-b6ac-4afd-9d61-6335c4482b3f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:50.205034 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a3f69-b6ac-4afd-9d61-6335c4482b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:50.205312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a3f69-b6ac-4afd-9d61-6335c4482b3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:50.213406 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a3f69-b6ac-4afd-9d61-6335c4482b3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:50.214885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a3f69-b6ac-4afd-9d61-6335c4482b3f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-da6a3f69-b6ac-4afd-9d61-6335c4482b3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:17:50.231501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:50.232694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:50.233723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:50.233723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:50.233723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:17:50.233723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:17:50.233723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:17:50.233723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:17:50.233723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:17:50.233723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:17:50.233723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 22:17:50.233723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:50.237120 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 529/1091] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jul 21 22:17:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:50.238712 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f710d-1a7f-48db-b8ce-be18354361a1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:50.290094 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:50.344123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f710d-1a7f-48db-b8ce-be18354361a1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:50.377003 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab85be-81e4-4472-b3e5-2ec4d4fe0439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:50.377605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab85be-81e4-4472-b3e5-2ec4d4fe0439 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:50.377886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab85be-81e4-4472-b3e5-2ec4d4fe0439 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:50.378157 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab85be-81e4-4472-b3e5-2ec4d4fe0439 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:50.378984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab85be-81e4-4472-b3e5-2ec4d4fe0439 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:50.379290 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab85be-81e4-4472-b3e5-2ec4d4fe0439 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:50.380756 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab85be-81e4-4472-b3e5-2ec4d4fe0439 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:50.397250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 563/1092] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jul 21 22:17:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:50.403648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a3f69-b6ac-4afd-9d61-6335c4482b3f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:50.457986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:50.500709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a3f69-b6ac-4afd-9d61-6335c4482b3f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:50.534527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e6e25-740d-4f75-b3b1-077e6a737bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:50.535171 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e6e25-740d-4f75-b3b1-077e6a737bba None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:50.535450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e6e25-740d-4f75-b3b1-077e6a737bba None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:50.535724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e6e25-740d-4f75-b3b1-077e6a737bba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:50.600336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e6e25-740d-4f75-b3b1-077e6a737bba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:50.601825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e6e25-740d-4f75-b3b1-077e6a737bba None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:50.654678 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:50.698057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 530/1093] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:17:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:17:50.703736 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab85be-81e4-4472-b3e5-2ec4d4fe0439 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:50.799771 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab85be-81e4-4472-b3e5-2ec4d4fe0439 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:50.807554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:50.835576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e44f21-1282-42c3-92ac-1e0ac660d2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:50.836984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e44f21-1282-42c3-92ac-1e0ac660d2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:50.837273 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e44f21-1282-42c3-92ac-1e0ac660d2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:50.837550 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e44f21-1282-42c3-92ac-1e0ac660d2e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:50.848820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e44f21-1282-42c3-92ac-1e0ac660d2e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:50.850296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e44f21-1282-42c3-92ac-1e0ac660d2e3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:50.868010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-f5e44f21-1282-42c3-92ac-1e0ac660d2e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:50.868010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:50.868010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:50.868010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:50.868010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:50.868010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:50.868010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:50.868010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:50.868010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:50.868010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:50.868010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:50.868010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:50.868010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:17:50.868010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:17:50.868010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:50.868894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:50.869971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:17:50.869971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:17:50.869971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:17:50.869971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:50.869971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 564/1094] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:17:50.874950 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e6e25-740d-4f75-b3b1-077e6a737bba None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:50.969752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e6e25-740d-4f75-b3b1-077e6a737bba None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:51.002155 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49f452-e39f-46c0-9639-e4dca6eabac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:51.002808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49f452-e39f-46c0-9639-e4dca6eabac1 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:51.003095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49f452-e39f-46c0-9639-e4dca6eabac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:51.003371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49f452-e39f-46c0-9639-e4dca6eabac1 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:51.004087 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49f452-e39f-46c0-9639-e4dca6eabac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:51.004395 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49f452-e39f-46c0-9639-e4dca6eabac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:51.005779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49f452-e39f-46c0-9639-e4dca6eabac1 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:51.017220 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 531/1095] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:51.022746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e44f21-1282-42c3-92ac-1e0ac660d2e3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:51.121385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e44f21-1282-42c3-92ac-1e0ac660d2e3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:51.154750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78065b45-087b-4604-bda6-6c178cbb9ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:51.155534 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78065b45-087b-4604-bda6-6c178cbb9ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:51.155817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78065b45-087b-4604-bda6-6c178cbb9ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:51.156095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78065b45-087b-4604-bda6-6c178cbb9ff0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:51.162609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78065b45-087b-4604-bda6-6c178cbb9ff0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:51.164112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78065b45-087b-4604-bda6-6c178cbb9ff0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:51.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-78065b45-087b-4604-bda6-6c178cbb9ff0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:51.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:51.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:51.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:51.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:51.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:51.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:51.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:51.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:51.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:51.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:51.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:51.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:17:51.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:17:51.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:51.178615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:51.179543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:17:51.179543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:17:51.179543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:17:51.179543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:17:51.179543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:17:51.179543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:17:51.179543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:17:51.179543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:17:51.179543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 565/1096] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:17:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:51.185125 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49f452-e39f-46c0-9639-e4dca6eabac1 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:51.204032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:51.285856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49f452-e39f-46c0-9639-e4dca6eabac1 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:51.318808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd24b58-f4e4-466b-9d11-53c72359efde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:51.319577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd24b58-f4e4-466b-9d11-53c72359efde None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:51.319868 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd24b58-f4e4-466b-9d11-53c72359efde None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:51.320149 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd24b58-f4e4-466b-9d11-53c72359efde None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:51.320991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd24b58-f4e4-466b-9d11-53c72359efde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:51.321306 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd24b58-f4e4-466b-9d11-53c72359efde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:51.322743 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd24b58-f4e4-466b-9d11-53c72359efde None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:51.334407 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 532/1097] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:17:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:51.340461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78065b45-087b-4604-bda6-6c178cbb9ff0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:51.360094 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:51.442226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78065b45-087b-4604-bda6-6c178cbb9ff0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:51.474515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65915dad-363e-4dee-82fe-cada3e4573a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:51.475176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65915dad-363e-4dee-82fe-cada3e4573a8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:51.475457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65915dad-363e-4dee-82fe-cada3e4573a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:51.475737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65915dad-363e-4dee-82fe-cada3e4573a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:51.477113 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65915dad-363e-4dee-82fe-cada3e4573a8 None admin] RBAC: Adding query filter params (role.id=7e4df69fe73e4323b8a543ee45b8c60c, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=2c04dc3ee4484afaab388cbb306974af) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:51.477429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65915dad-363e-4dee-82fe-cada3e4573a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:51.478857 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65915dad-363e-4dee-82fe-cada3e4573a8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:51.484691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 566/1098] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:17:51 2022] GET /identity/v3/role_assignments?user.id=2c04dc3ee4484afaab388cbb306974af&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=7e4df69fe73e4323b8a543ee45b8c60c => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:52.169938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef361e2-6b94-4d8a-843e-6442f3efef99 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:52.170444 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef361e2-6b94-4d8a-843e-6442f3efef99 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:52.170532 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef361e2-6b94-4d8a-843e-6442f3efef99 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:52.171853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 533/1099] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:52.177604 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceff4c-54b4-44e1-87f8-db0b576fba86 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:52.177897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceff4c-54b4-44e1-87f8-db0b576fba86 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:52.178182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceff4c-54b4-44e1-87f8-db0b576fba86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:52.195543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1aceff4c-54b4-44e1-87f8-db0b576fba86 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:52.196711 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1aceff4c-54b4-44e1-87f8-db0b576fba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:52.264421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 567/1100] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:52.288231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef361e2-6b94-4d8a-843e-6442f3efef99 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:52.363424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:52.385827 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef361e2-6b94-4d8a-843e-6442f3efef99 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:52.419216 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f644048-1a7d-4e18-88b5-fd2578def7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:52.419993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f644048-1a7d-4e18-88b5-fd2578def7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:52.420274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f644048-1a7d-4e18-88b5-fd2578def7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:52.420547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f644048-1a7d-4e18-88b5-fd2578def7e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:52.430172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f644048-1a7d-4e18-88b5-fd2578def7e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-1f644048-1a7d-4e18-88b5-fd2578def7e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:17:52.437645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:17:52.438729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:17:52.439787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:17:52.439787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:17:52.439787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:17:52.439787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:17:52.439787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:17:52.439787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:17:52.439787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:17:52.439787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:17:52.439787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:17:52.439787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:17:52.439787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:17:52.439787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:17:52.439787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 534/1101] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:17:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:17:52.444886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceff4c-54b4-44e1-87f8-db0b576fba86 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:52.458464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:52.539740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceff4c-54b4-44e1-87f8-db0b576fba86 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:52.571177 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26c4af-8896-47e0-8ffc-4c803cb55676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:52.571822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26c4af-8896-47e0-8ffc-4c803cb55676 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:52.572102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26c4af-8896-47e0-8ffc-4c803cb55676 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:52.572377 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26c4af-8896-47e0-8ffc-4c803cb55676 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:52.573133 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26c4af-8896-47e0-8ffc-4c803cb55676 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:52.573455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26c4af-8896-47e0-8ffc-4c803cb55676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:52.574783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26c4af-8896-47e0-8ffc-4c803cb55676 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:52.582456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 568/1102] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:17:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:52.588786 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f644048-1a7d-4e18-88b5-fd2578def7e2 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:52.684208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f644048-1a7d-4e18-88b5-fd2578def7e2 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:52.716003 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b5403-9fc4-43e3-abb2-79b3a2551804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:52.716858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b5403-9fc4-43e3-abb2-79b3a2551804 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:52.717172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b5403-9fc4-43e3-abb2-79b3a2551804 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:52.717454 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b5403-9fc4-43e3-abb2-79b3a2551804 None admin] PATH_INFO: `/v3/users/d35c6cf402f041daa5bd8e144e948419` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:52.718631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b5403-9fc4-43e3-abb2-79b3a2551804 None admin] RBAC: Authorizing `identity:get_user(user_id=d35c6cf402f041daa5bd8e144e948419)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:52.720055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b5403-9fc4-43e3-abb2-79b3a2551804 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:52.721685 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 535/1103] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:17:52 2022] GET /identity/v3/users/d35c6cf402f041daa5bd8e144e948419 => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:52.727794 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26c4af-8896-47e0-8ffc-4c803cb55676 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:52.799228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:52.823541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26c4af-8896-47e0-8ffc-4c803cb55676 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:52.855517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748380f-0dca-4874-b34c-7aa659291bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:52.856148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748380f-0dca-4874-b34c-7aa659291bad None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:52.856428 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748380f-0dca-4874-b34c-7aa659291bad None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:52.856701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748380f-0dca-4874-b34c-7aa659291bad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:52.920603 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748380f-0dca-4874-b34c-7aa659291bad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:52.922062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748380f-0dca-4874-b34c-7aa659291bad None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:52.990100 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:53.014185 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 569/1104] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:17:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 22:17:53.020076 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b5403-9fc4-43e3-abb2-79b3a2551804 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:53.024374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:53.117855 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b5403-9fc4-43e3-abb2-79b3a2551804 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:53.149307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd3cbb-c9e8-48fb-ba2b-1ab1e0c33757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:53.150155 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd3cbb-c9e8-48fb-ba2b-1ab1e0c33757 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:53.150433 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd3cbb-c9e8-48fb-ba2b-1ab1e0c33757 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:53.150702 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd3cbb-c9e8-48fb-ba2b-1ab1e0c33757 None admin] PATH_INFO: `/v3/projects/77deaca694ab4ba68fd4576e65220b05` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:53.151842 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd3cbb-c9e8-48fb-ba2b-1ab1e0c33757 None admin] RBAC: Authorizing `identity:get_project(project_id=77deaca694ab4ba68fd4576e65220b05)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:53.153546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd3cbb-c9e8-48fb-ba2b-1ab1e0c33757 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:53.155204 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 536/1105] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:17:53 2022] GET /identity/v3/projects/77deaca694ab4ba68fd4576e65220b05 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:53.161288 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748380f-0dca-4874-b34c-7aa659291bad None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:53.255461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748380f-0dca-4874-b34c-7aa659291bad None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:53.287649 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30194fe6-2c79-4f29-95c4-bdb3ffe8d27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:53.288278 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30194fe6-2c79-4f29-95c4-bdb3ffe8d27a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:53.288559 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30194fe6-2c79-4f29-95c4-bdb3ffe8d27a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:53.288836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30194fe6-2c79-4f29-95c4-bdb3ffe8d27a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:53.289701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30194fe6-2c79-4f29-95c4-bdb3ffe8d27a None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=77deaca694ab4ba68fd4576e65220b05, user.id=d35c6cf402f041daa5bd8e144e948419) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:53.290011 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30194fe6-2c79-4f29-95c4-bdb3ffe8d27a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:53.291410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30194fe6-2c79-4f29-95c4-bdb3ffe8d27a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:53.296937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 570/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:17:53 2022] GET /identity/v3/role_assignments?user.id=d35c6cf402f041daa5bd8e144e948419&scope.project.id=77deaca694ab4ba68fd4576e65220b05&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:55.332029 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f8838-0eeb-422e-bf07-4170481bb28b None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:55.332543 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f8838-0eeb-422e-bf07-4170481bb28b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:55.332543 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f8838-0eeb-422e-bf07-4170481bb28b None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:55.333908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 537/1107] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:55.339676 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ef15e-1877-4071-b210-0f42dd3c96d4 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:55.340042 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ef15e-1877-4071-b210-0f42dd3c96d4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:55.340228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ef15e-1877-4071-b210-0f42dd3c96d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:55.356316 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c59ef15e-1877-4071-b210-0f42dd3c96d4 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:55.357501 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c59ef15e-1877-4071-b210-0f42dd3c96d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:55.386574 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:55.422622 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 571/1108] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:55.447850 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f8838-0eeb-422e-bf07-4170481bb28b None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:55.516011 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:55.545892 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f8838-0eeb-422e-bf07-4170481bb28b None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:55.578961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72421d89-6385-4555-9a1d-18e16282a64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:55.579744 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72421d89-6385-4555-9a1d-18e16282a64b None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:55.580031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72421d89-6385-4555-9a1d-18e16282a64b None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:55.580311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72421d89-6385-4555-9a1d-18e16282a64b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:55.581503 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72421d89-6385-4555-9a1d-18e16282a64b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:55.582974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72421d89-6385-4555-9a1d-18e16282a64b None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:55.584554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 538/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:17:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:55.590142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ef15e-1877-4071-b210-0f42dd3c96d4 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:55.683894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ef15e-1877-4071-b210-0f42dd3c96d4 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:55.716353 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5e1c4-62ae-4d12-a57e-ee156ae5654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:55.717034 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5e1c4-62ae-4d12-a57e-ee156ae5654b None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:55.717321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5e1c4-62ae-4d12-a57e-ee156ae5654b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:55.717599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5e1c4-62ae-4d12-a57e-ee156ae5654b None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:55.718293 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5e1c4-62ae-4d12-a57e-ee156ae5654b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:55.719709 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5e1c4-62ae-4d12-a57e-ee156ae5654b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:55.739085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 572/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:17:55 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:17:57.794355 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c7d58-59f9-4cd0-a41d-8e3d5eed1013 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:57.794938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c7d58-59f9-4cd0-a41d-8e3d5eed1013 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:57.794938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c7d58-59f9-4cd0-a41d-8e3d5eed1013 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:57.796264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 539/1111] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:17:57.801444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ec044-a307-4290-801f-0d868cd9aa63 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:57.801849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ec044-a307-4290-801f-0d868cd9aa63 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:57.802005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ec044-a307-4290-801f-0d868cd9aa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:57.818184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ae5ec044-a307-4290-801f-0d868cd9aa63 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:17:57.819222 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ae5ec044-a307-4290-801f-0d868cd9aa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:17:57.836222 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:57.883005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 573/1112] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:17:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:17:57.906413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c7d58-59f9-4cd0-a41d-8e3d5eed1013 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:58.002084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c7d58-59f9-4cd0-a41d-8e3d5eed1013 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:58.035197 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb790d5f-e5f9-4912-b676-d1252a453480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:58.036030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790d5f-e5f9-4912-b676-d1252a453480 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:58.036310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790d5f-e5f9-4912-b676-d1252a453480 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:58.036581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790d5f-e5f9-4912-b676-d1252a453480 None admin] PATH_INFO: `/v3/roles/ffad03b6b6d1473dba5d5b7296943f18` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:58.038053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb790d5f-e5f9-4912-b676-d1252a453480 None admin] RBAC: Authorizing `identity:get_role(role_id=ffad03b6b6d1473dba5d5b7296943f18)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:58.039435 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb790d5f-e5f9-4912-b676-d1252a453480 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:58.040772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 540/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:17:57 2022] GET /identity/v3/roles/ffad03b6b6d1473dba5d5b7296943f18 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:58.046318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ec044-a307-4290-801f-0d868cd9aa63 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:58.140212 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ec044-a307-4290-801f-0d868cd9aa63 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:58.173096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e5c3c-ea59-4e4f-a733-7b160f38bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:58.173952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e5c3c-ea59-4e4f-a733-7b160f38bfda None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:58.174231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e5c3c-ea59-4e4f-a733-7b160f38bfda None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:58.174504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e5c3c-ea59-4e4f-a733-7b160f38bfda None admin] PATH_INFO: `/v3/users/049e80b25f1f4b31aedcda915164d915` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:58.186795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e5c3c-ea59-4e4f-a733-7b160f38bfda None admin] RBAC: Authorizing `identity:get_user(user_id=049e80b25f1f4b31aedcda915164d915)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:58.188214 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e5c3c-ea59-4e4f-a733-7b160f38bfda None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:58.189857 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 574/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:17:58 2022] GET /identity/v3/users/049e80b25f1f4b31aedcda915164d915 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:58.196072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb790d5f-e5f9-4912-b676-d1252a453480 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:58.206461 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:58.293898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb790d5f-e5f9-4912-b676-d1252a453480 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:58.326293 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830a1b3-9cb2-43ee-b9ef-992810870a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:58.326874 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830a1b3-9cb2-43ee-b9ef-992810870a8c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:58.327160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830a1b3-9cb2-43ee-b9ef-992810870a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:58.327435 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830a1b3-9cb2-43ee-b9ef-992810870a8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:58.395171 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830a1b3-9cb2-43ee-b9ef-992810870a8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:58.396600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830a1b3-9cb2-43ee-b9ef-992810870a8c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:58.405975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:58.492322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 541/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:17:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:17:58.498177 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e5c3c-ea59-4e4f-a733-7b160f38bfda None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:58.512961 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:58.594585 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e5c3c-ea59-4e4f-a733-7b160f38bfda None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:58.626855 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3f63a-6398-476e-8fce-307cac7d0169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:58.627712 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3f63a-6398-476e-8fce-307cac7d0169 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:58.628006 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3f63a-6398-476e-8fce-307cac7d0169 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:58.628281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3f63a-6398-476e-8fce-307cac7d0169 None admin] PATH_INFO: `/v3/projects/77deaca694ab4ba68fd4576e65220b05` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:58.629471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3f63a-6398-476e-8fce-307cac7d0169 None admin] RBAC: Authorizing `identity:get_project(project_id=77deaca694ab4ba68fd4576e65220b05)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:58.630890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3f63a-6398-476e-8fce-307cac7d0169 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:58.633101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 575/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:17:58 2022] GET /identity/v3/projects/77deaca694ab4ba68fd4576e65220b05 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:17:58.639133 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830a1b3-9cb2-43ee-b9ef-992810870a8c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:17:58.733369 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830a1b3-9cb2-43ee-b9ef-992810870a8c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:17:58.742666 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:17:58.766384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6923544-4e79-484e-898e-47f2aa1a8be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:17:58.767022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6923544-4e79-484e-898e-47f2aa1a8be6 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:17:58.767305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6923544-4e79-484e-898e-47f2aa1a8be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:17:58.767581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6923544-4e79-484e-898e-47f2aa1a8be6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:17:58.768402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6923544-4e79-484e-898e-47f2aa1a8be6 None admin] RBAC: Adding query filter params (role.id=ffad03b6b6d1473dba5d5b7296943f18, scope.project.id=77deaca694ab4ba68fd4576e65220b05, user.id=049e80b25f1f4b31aedcda915164d915) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:17:58.768715 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6923544-4e79-484e-898e-47f2aa1a8be6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:17:58.770154 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6923544-4e79-484e-898e-47f2aa1a8be6 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:17:58.775361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 542/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:17:58 2022] GET /identity/v3/role_assignments?user.id=049e80b25f1f4b31aedcda915164d915&scope.project.id=77deaca694ab4ba68fd4576e65220b05&role.id=ffad03b6b6d1473dba5d5b7296943f18 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:00.764855 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cfc34-a398-48db-ad1c-07845d296fd1 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:00.765415 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cfc34-a398-48db-ad1c-07845d296fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:00.765513 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cfc34-a398-48db-ad1c-07845d296fd1 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:00.766826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 576/1118] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:18:00.771997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259af854-6717-40e4-8123-04d257230dc2 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:00.772370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259af854-6717-40e4-8123-04d257230dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:00.772558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259af854-6717-40e4-8123-04d257230dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:00.789052 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-259af854-6717-40e4-8123-04d257230dc2 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:18:00.790222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-259af854-6717-40e4-8123-04d257230dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:18:00.853220 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 543/1119] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:18:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:18:00.876113 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cfc34-a398-48db-ad1c-07845d296fd1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:00.958408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:00.978432 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cfc34-a398-48db-ad1c-07845d296fd1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:01.010528 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058be4c-4e9b-4302-aec1-9511843b988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:01.011367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058be4c-4e9b-4302-aec1-9511843b988a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:01.011649 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058be4c-4e9b-4302-aec1-9511843b988a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:01.011925 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058be4c-4e9b-4302-aec1-9511843b988a None admin] PATH_INFO: `/v3/roles/ffad03b6b6d1473dba5d5b7296943f18` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:01.013390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058be4c-4e9b-4302-aec1-9511843b988a None admin] RBAC: Authorizing `identity:get_role(role_id=ffad03b6b6d1473dba5d5b7296943f18)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:01.014749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058be4c-4e9b-4302-aec1-9511843b988a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:01.016252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 577/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:18:00 2022] GET /identity/v3/roles/ffad03b6b6d1473dba5d5b7296943f18 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:01.022019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259af854-6717-40e4-8123-04d257230dc2 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:01.116236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259af854-6717-40e4-8123-04d257230dc2 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:01.118395 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:01.150624 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757be6cb-78b2-4b38-9796-b6927bcc7356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:01.151492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757be6cb-78b2-4b38-9796-b6927bcc7356 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:01.151781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757be6cb-78b2-4b38-9796-b6927bcc7356 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:01.152060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757be6cb-78b2-4b38-9796-b6927bcc7356 None admin] PATH_INFO: `/v3/users/049e80b25f1f4b31aedcda915164d915` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:01.153534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757be6cb-78b2-4b38-9796-b6927bcc7356 None admin] RBAC: Authorizing `identity:get_user(user_id=049e80b25f1f4b31aedcda915164d915)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:01.154965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757be6cb-78b2-4b38-9796-b6927bcc7356 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:01.156593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 544/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:18:01 2022] GET /identity/v3/users/049e80b25f1f4b31aedcda915164d915 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:18:01.162274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058be4c-4e9b-4302-aec1-9511843b988a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:01.257250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058be4c-4e9b-4302-aec1-9511843b988a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:01.290269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055b917-8c2a-4f9b-b782-50dbf3c2401e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:01.291058 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055b917-8c2a-4f9b-b782-50dbf3c2401e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:01.291341 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055b917-8c2a-4f9b-b782-50dbf3c2401e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:01.291614 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055b917-8c2a-4f9b-b782-50dbf3c2401e None admin] PATH_INFO: `/v3/projects/77deaca694ab4ba68fd4576e65220b05` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:01.292772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055b917-8c2a-4f9b-b782-50dbf3c2401e None admin] RBAC: Authorizing `identity:get_project(project_id=77deaca694ab4ba68fd4576e65220b05)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:01.294212 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055b917-8c2a-4f9b-b782-50dbf3c2401e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:01.295866 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 578/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:18:01 2022] GET /identity/v3/projects/77deaca694ab4ba68fd4576e65220b05 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:01.301800 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757be6cb-78b2-4b38-9796-b6927bcc7356 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:01.395981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757be6cb-78b2-4b38-9796-b6927bcc7356 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:01.428906 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2d9cb-f3f0-4366-9a27-7a3fcb09d3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:01.429804 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2d9cb-f3f0-4366-9a27-7a3fcb09d3c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:01.430088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2d9cb-f3f0-4366-9a27-7a3fcb09d3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:01.430369 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2d9cb-f3f0-4366-9a27-7a3fcb09d3c4 None admin] PATH_INFO: `/v3/projects/77deaca694ab4ba68fd4576e65220b05/users/049e80b25f1f4b31aedcda915164d915/roles/ffad03b6b6d1473dba5d5b7296943f18` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:01.432526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2d9cb-f3f0-4366-9a27-7a3fcb09d3c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=77deaca694ab4ba68fd4576e65220b05, user_id=049e80b25f1f4b31aedcda915164d915, role_id=ffad03b6b6d1473dba5d5b7296943f18)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:01.433963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2d9cb-f3f0-4366-9a27-7a3fcb09d3c4 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:01.447420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 545/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:18:01 2022] PUT /identity/v3/projects/77deaca694ab4ba68fd4576e65220b05/users/049e80b25f1f4b31aedcda915164d915/roles/ffad03b6b6d1473dba5d5b7296943f18 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:18:03.430930 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810b412-a3cd-411c-b9ba-6ece0022ce32 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:03.431435 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810b412-a3cd-411c-b9ba-6ece0022ce32 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:03.431435 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810b412-a3cd-411c-b9ba-6ece0022ce32 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:03.432776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 579/1124] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:18:03.438036 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd1afa-e3d4-4a0a-a031-47b6ac9ad3d1 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:03.438470 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd1afa-e3d4-4a0a-a031-47b6ac9ad3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:03.438592 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd1afa-e3d4-4a0a-a031-47b6ac9ad3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:03.456553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-67cd1afa-e3d4-4a0a-a031-47b6ac9ad3d1 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:18:03.458614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-67cd1afa-e3d4-4a0a-a031-47b6ac9ad3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:18:03.483298 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:03.526396 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 546/1125] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:18:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 22:18:03.549865 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810b412-a3cd-411c-b9ba-6ece0022ce32 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:03.567166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:03.647872 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810b412-a3cd-411c-b9ba-6ece0022ce32 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:03.680328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e953e-b825-4718-b7e6-63830633ab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:03.681236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e953e-b825-4718-b7e6-63830633ab31 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:03.681467 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e953e-b825-4718-b7e6-63830633ab31 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:03.681739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e953e-b825-4718-b7e6-63830633ab31 None admin] PATH_INFO: `/v3/roles/ffad03b6b6d1473dba5d5b7296943f18` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:03.683178 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e953e-b825-4718-b7e6-63830633ab31 None admin] RBAC: Authorizing `identity:get_role(role_id=ffad03b6b6d1473dba5d5b7296943f18)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:03.684537 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e953e-b825-4718-b7e6-63830633ab31 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:03.685907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 580/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:18:03 2022] GET /identity/v3/roles/ffad03b6b6d1473dba5d5b7296943f18 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:03.691531 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd1afa-e3d4-4a0a-a031-47b6ac9ad3d1 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:03.784580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd1afa-e3d4-4a0a-a031-47b6ac9ad3d1 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:03.816246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323381a-7d33-4e9a-8970-f6d34fa609a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:03.817129 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323381a-7d33-4e9a-8970-f6d34fa609a1 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:03.817409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323381a-7d33-4e9a-8970-f6d34fa609a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:03.817680 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323381a-7d33-4e9a-8970-f6d34fa609a1 None admin] PATH_INFO: `/v3/users/049e80b25f1f4b31aedcda915164d915` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:03.819221 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323381a-7d33-4e9a-8970-f6d34fa609a1 None admin] RBAC: Authorizing `identity:get_user(user_id=049e80b25f1f4b31aedcda915164d915)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:03.821764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323381a-7d33-4e9a-8970-f6d34fa609a1 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:03.823364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 547/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:18:03 2022] GET /identity/v3/users/049e80b25f1f4b31aedcda915164d915 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:03.828995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e953e-b825-4718-b7e6-63830633ab31 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:03.908398 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:03.923883 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e953e-b825-4718-b7e6-63830633ab31 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:03.956440 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4906d6-79f8-45d9-b220-15410f08fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:03.957038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4906d6-79f8-45d9-b220-15410f08fea7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:03.957320 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4906d6-79f8-45d9-b220-15410f08fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:03.957591 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4906d6-79f8-45d9-b220-15410f08fea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:04.021334 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4906d6-79f8-45d9-b220-15410f08fea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:04.022748 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4906d6-79f8-45d9-b220-15410f08fea7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:04.100768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:04.118405 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 581/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:18:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:18:04.124231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323381a-7d33-4e9a-8970-f6d34fa609a1 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:04.150705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:04.218853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323381a-7d33-4e9a-8970-f6d34fa609a1 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:04.251559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b9962-b8cc-4c04-83df-d499a9644089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:04.252402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b9962-b8cc-4c04-83df-d499a9644089 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:04.252683 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b9962-b8cc-4c04-83df-d499a9644089 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:04.252977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b9962-b8cc-4c04-83df-d499a9644089 None admin] PATH_INFO: `/v3/projects/77deaca694ab4ba68fd4576e65220b05` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:04.254128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b9962-b8cc-4c04-83df-d499a9644089 None admin] RBAC: Authorizing `identity:get_project(project_id=77deaca694ab4ba68fd4576e65220b05)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:04.255536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b9962-b8cc-4c04-83df-d499a9644089 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:04.257239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 548/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:18:04 2022] GET /identity/v3/projects/77deaca694ab4ba68fd4576e65220b05 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:04.263352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4906d6-79f8-45d9-b220-15410f08fea7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:04.358608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4906d6-79f8-45d9-b220-15410f08fea7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:04.390697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e4021-c868-4402-a7b8-ebfd7252ee5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:04.391336 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e4021-c868-4402-a7b8-ebfd7252ee5a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:04.391624 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e4021-c868-4402-a7b8-ebfd7252ee5a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:04.391905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e4021-c868-4402-a7b8-ebfd7252ee5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:04.392732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e4021-c868-4402-a7b8-ebfd7252ee5a None admin] RBAC: Adding query filter params (role.id=ffad03b6b6d1473dba5d5b7296943f18, scope.project.id=77deaca694ab4ba68fd4576e65220b05, user.id=049e80b25f1f4b31aedcda915164d915) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:18:04.393078 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e4021-c868-4402-a7b8-ebfd7252ee5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:04.394496 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e4021-c868-4402-a7b8-ebfd7252ee5a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:04.400639 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 582/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:18:04 2022] GET /identity/v3/role_assignments?user.id=049e80b25f1f4b31aedcda915164d915&scope.project.id=77deaca694ab4ba68fd4576e65220b05&role.id=ffad03b6b6d1473dba5d5b7296943f18 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:06.427578 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca0a89-152c-4a2b-9c7e-a0fd41b52a97 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:06.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca0a89-152c-4a2b-9c7e-a0fd41b52a97 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:06.428088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca0a89-152c-4a2b-9c7e-a0fd41b52a97 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:06.430061 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 549/1131] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:18:06.435220 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312800e-1078-4a73-a871-716209d2de7e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:06.435622 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312800e-1078-4a73-a871-716209d2de7e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:06.435780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312800e-1078-4a73-a871-716209d2de7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:06.452006 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4312800e-1078-4a73-a871-716209d2de7e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:18:06.453202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4312800e-1078-4a73-a871-716209d2de7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:18:06.495368 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:06.518498 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 583/1132] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:18:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:18:06.542261 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca0a89-152c-4a2b-9c7e-a0fd41b52a97 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:06.632777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:06.639520 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca0a89-152c-4a2b-9c7e-a0fd41b52a97 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:06.671334 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd06acd-1867-4fe5-a620-8019110454e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:06.672110 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd06acd-1867-4fe5-a620-8019110454e0 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:06.672391 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd06acd-1867-4fe5-a620-8019110454e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:06.672664 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd06acd-1867-4fe5-a620-8019110454e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:06.673834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd06acd-1867-4fe5-a620-8019110454e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:06.675254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd06acd-1867-4fe5-a620-8019110454e0 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:06.676837 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 550/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:18:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:06.682963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312800e-1078-4a73-a871-716209d2de7e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:06.776800 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312800e-1078-4a73-a871-716209d2de7e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:06.809431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7921da5-62e6-4646-ae46-ecbd068cdfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:06.810071 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7921da5-62e6-4646-ae46-ecbd068cdfaa None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:06.810354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7921da5-62e6-4646-ae46-ecbd068cdfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:06.810630 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7921da5-62e6-4646-ae46-ecbd068cdfaa None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:06.811326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7921da5-62e6-4646-ae46-ecbd068cdfaa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:06.812749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7921da5-62e6-4646-ae46-ecbd068cdfaa None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:06.837270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 584/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jul 21 22:18:06 2022] POST /identity/v3/projects => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:18:08.866785 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f03f2-48e1-4be5-aa7b-2272c351aba3 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:08.867338 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f03f2-48e1-4be5-aa7b-2272c351aba3 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:08.867338 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f03f2-48e1-4be5-aa7b-2272c351aba3 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:08.868703 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 551/1135] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:18:08.873824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ab4a3-bd4e-4d25-bc35-606c822b3db9 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:08.874189 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ab4a3-bd4e-4d25-bc35-606c822b3db9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:08.874384 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ab4a3-bd4e-4d25-bc35-606c822b3db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:08.890752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6f3ab4a3-bd4e-4d25-bc35-606c822b3db9 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:18:08.891922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6f3ab4a3-bd4e-4d25-bc35-606c822b3db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:18:08.915953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:08.957850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 585/1136] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:18:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:18:08.982795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f03f2-48e1-4be5-aa7b-2272c351aba3 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:09.080621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f03f2-48e1-4be5-aa7b-2272c351aba3 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:09.113765 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9549ba-9bd7-44e8-a67a-eabf89522f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:09.114548 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9549ba-9bd7-44e8-a67a-eabf89522f16 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:09.114836 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9549ba-9bd7-44e8-a67a-eabf89522f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:09.115115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9549ba-9bd7-44e8-a67a-eabf89522f16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:09.116279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9549ba-9bd7-44e8-a67a-eabf89522f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:09.117839 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9549ba-9bd7-44e8-a67a-eabf89522f16 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:09.119387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 552/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:18:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:09.125093 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ab4a3-bd4e-4d25-bc35-606c822b3db9 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:09.218815 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ab4a3-bd4e-4d25-bc35-606c822b3db9 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:09.252126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799e795-9d46-4fa1-bed7-1e8a5a08bd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:09.252774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799e795-9d46-4fa1-bed7-1e8a5a08bd1e None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:09.253086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799e795-9d46-4fa1-bed7-1e8a5a08bd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:09.253362 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799e795-9d46-4fa1-bed7-1e8a5a08bd1e None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:09.254065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799e795-9d46-4fa1-bed7-1e8a5a08bd1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:09.255468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799e795-9d46-4fa1-bed7-1e8a5a08bd1e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:09.275012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 586/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:18:09 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:18:11.327415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38256d-4b71-4ba8-bfd3-7cc8ee4e216c None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:11.327934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38256d-4b71-4ba8-bfd3-7cc8ee4e216c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:11.327934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38256d-4b71-4ba8-bfd3-7cc8ee4e216c None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:11.329297 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 553/1139] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:18:11.334561 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0508b0c-644d-454e-ada8-06acb9cc7104 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:11.334982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0508b0c-644d-454e-ada8-06acb9cc7104 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:11.335610 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0508b0c-644d-454e-ada8-06acb9cc7104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:11.353104 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a0508b0c-644d-454e-ada8-06acb9cc7104 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:18:11.354269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a0508b0c-644d-454e-ada8-06acb9cc7104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:18:11.364502 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:11.420099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 587/1140] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:18:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:18:11.443093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38256d-4b71-4ba8-bfd3-7cc8ee4e216c None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:11.473242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:11.550678 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38256d-4b71-4ba8-bfd3-7cc8ee4e216c None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:11.583148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866319e-3221-460f-9fc7-83e5016ad5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:11.583867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866319e-3221-460f-9fc7-83e5016ad5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:11.584158 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866319e-3221-460f-9fc7-83e5016ad5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:11.584436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866319e-3221-460f-9fc7-83e5016ad5d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:11.594894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866319e-3221-460f-9fc7-83e5016ad5d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-a866319e-3221-460f-9fc7-83e5016ad5d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:18:11.602441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:18:11.603630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:18:11.604759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:18:11.604759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:18:11.604759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:18:11.604759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:18:11.604759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:18:11.604759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:18:11.604759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:18:11.604759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:18:11.604759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:18:11.604759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:18:11.604759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:18:11.604759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:18:11.604759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 554/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:18:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:18:11.609627 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0508b0c-644d-454e-ada8-06acb9cc7104 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:11.705360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0508b0c-644d-454e-ada8-06acb9cc7104 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:11.737892 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bbe43-099e-40a0-be34-022e7949b403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:11.738555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bbe43-099e-40a0-be34-022e7949b403 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:11.738841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bbe43-099e-40a0-be34-022e7949b403 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:11.739118 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bbe43-099e-40a0-be34-022e7949b403 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:11.739869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bbe43-099e-40a0-be34-022e7949b403 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:18:11.740179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bbe43-099e-40a0-be34-022e7949b403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:11.741618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bbe43-099e-40a0-be34-022e7949b403 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:11.749415 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 588/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:18:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:11.755191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866319e-3221-460f-9fc7-83e5016ad5d3 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:11.843363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:11.851943 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866319e-3221-460f-9fc7-83e5016ad5d3 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:11.884476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cd8e1-a6f7-4f2d-8854-17bcd4e5e993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:11.885365 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cd8e1-a6f7-4f2d-8854-17bcd4e5e993 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:11.885652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cd8e1-a6f7-4f2d-8854-17bcd4e5e993 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:11.885923 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cd8e1-a6f7-4f2d-8854-17bcd4e5e993 None admin] PATH_INFO: `/v3/users/1d31ec1ede884a4282dee0164ba5ed3b` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:11.898293 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cd8e1-a6f7-4f2d-8854-17bcd4e5e993 None admin] RBAC: Authorizing `identity:get_user(user_id=1d31ec1ede884a4282dee0164ba5ed3b)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:11.899723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cd8e1-a6f7-4f2d-8854-17bcd4e5e993 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:11.901371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 555/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:18:11 2022] GET /identity/v3/users/1d31ec1ede884a4282dee0164ba5ed3b => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:11.907255 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bbe43-099e-40a0-be34-022e7949b403 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:11.918139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:12.005802 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bbe43-099e-40a0-be34-022e7949b403 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:12.037997 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc838dc7-d295-4347-9c87-34b6b330879b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:12.038630 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc838dc7-d295-4347-9c87-34b6b330879b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:12.038911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc838dc7-d295-4347-9c87-34b6b330879b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:12.039187 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc838dc7-d295-4347-9c87-34b6b330879b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:12.105239 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc838dc7-d295-4347-9c87-34b6b330879b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:12.106630 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc838dc7-d295-4347-9c87-34b6b330879b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:12.115621 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:12.200508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 589/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:18:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:18:12.206354 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cd8e1-a6f7-4f2d-8854-17bcd4e5e993 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:12.299822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cd8e1-a6f7-4f2d-8854-17bcd4e5e993 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:12.331669 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb2fb3-ccc5-46be-9754-4b0eb0b7260d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:12.332512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb2fb3-ccc5-46be-9754-4b0eb0b7260d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:12.332794 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb2fb3-ccc5-46be-9754-4b0eb0b7260d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:12.333097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb2fb3-ccc5-46be-9754-4b0eb0b7260d None admin] PATH_INFO: `/v3/projects/5c8c579ad92f452cb4bbf4751a9b8e78` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:12.334247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb2fb3-ccc5-46be-9754-4b0eb0b7260d None admin] RBAC: Authorizing `identity:get_project(project_id=5c8c579ad92f452cb4bbf4751a9b8e78)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:12.335671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb2fb3-ccc5-46be-9754-4b0eb0b7260d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:12.337347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 556/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:18:12 2022] GET /identity/v3/projects/5c8c579ad92f452cb4bbf4751a9b8e78 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:18:12.343148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc838dc7-d295-4347-9c87-34b6b330879b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:12.437213 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc838dc7-d295-4347-9c87-34b6b330879b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:12.445835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:12.469409 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167e843-86f8-49e7-850e-41a898fd1c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:12.470042 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167e843-86f8-49e7-850e-41a898fd1c7a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:12.470322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167e843-86f8-49e7-850e-41a898fd1c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:12.470597 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167e843-86f8-49e7-850e-41a898fd1c7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:12.471408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167e843-86f8-49e7-850e-41a898fd1c7a None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=5c8c579ad92f452cb4bbf4751a9b8e78, user.id=1d31ec1ede884a4282dee0164ba5ed3b) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:18:12.471716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167e843-86f8-49e7-850e-41a898fd1c7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:12.473152 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167e843-86f8-49e7-850e-41a898fd1c7a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:12.478836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 590/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:18:12 2022] GET /identity/v3/role_assignments?user.id=1d31ec1ede884a4282dee0164ba5ed3b&scope.project.id=5c8c579ad92f452cb4bbf4751a9b8e78&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:14.469325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ecea6-dd72-47f1-8422-3b1803dc6861 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:14.469832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ecea6-dd72-47f1-8422-3b1803dc6861 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:14.469832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ecea6-dd72-47f1-8422-3b1803dc6861 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:14.471161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 557/1147] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:18:14.476738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0751e5a-247e-4bf4-bfaa-1a391f9d5d3d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:14.477141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0751e5a-247e-4bf4-bfaa-1a391f9d5d3d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:14.477338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0751e5a-247e-4bf4-bfaa-1a391f9d5d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:14.494911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b0751e5a-247e-4bf4-bfaa-1a391f9d5d3d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:18:14.496085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b0751e5a-247e-4bf4-bfaa-1a391f9d5d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:18:14.559602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 591/1148] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:18:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:18:14.582008 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ecea6-dd72-47f1-8422-3b1803dc6861 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:14.600058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:14.679927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ecea6-dd72-47f1-8422-3b1803dc6861 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:14.711579 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6967f61-f97d-48ab-a2c7-a8c5470f674c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:14.712358 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6967f61-f97d-48ab-a2c7-a8c5470f674c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:14.712641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6967f61-f97d-48ab-a2c7-a8c5470f674c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:14.712918 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6967f61-f97d-48ab-a2c7-a8c5470f674c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:14.722780 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6967f61-f97d-48ab-a2c7-a8c5470f674c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-b6967f61-f97d-48ab-a2c7-a8c5470f674c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:18:14.730792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:18:14.731845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:18:14.732862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:18:14.732862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:18:14.732862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:18:14.732862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:18:14.732862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:18:14.732862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:18:14.732862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:18:14.732862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:18:14.732862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:18:14.732862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:18:14.732862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:18:14.732862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:18:14.732862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 558/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:18:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:18:14.737747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0751e5a-247e-4bf4-bfaa-1a391f9d5d3d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:14.830933 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0751e5a-247e-4bf4-bfaa-1a391f9d5d3d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:14.832393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:14.865009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef212590-8e2b-43a4-98b7-e5fdd6903e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:14.865659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef212590-8e2b-43a4-98b7-e5fdd6903e62 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:14.865940 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef212590-8e2b-43a4-98b7-e5fdd6903e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:14.866213 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef212590-8e2b-43a4-98b7-e5fdd6903e62 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:14.866948 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef212590-8e2b-43a4-98b7-e5fdd6903e62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:18:14.867249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef212590-8e2b-43a4-98b7-e5fdd6903e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:14.868593 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef212590-8e2b-43a4-98b7-e5fdd6903e62 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:14.876284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 592/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:18:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:14.882121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6967f61-f97d-48ab-a2c7-a8c5470f674c None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:14.955474 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:14.977193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6967f61-f97d-48ab-a2c7-a8c5470f674c None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:15.008323 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7ede4-5e79-4218-9948-c69b6d0daddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:15.009327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7ede4-5e79-4218-9948-c69b6d0daddd None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:15.009632 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7ede4-5e79-4218-9948-c69b6d0daddd None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:15.009905 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7ede4-5e79-4218-9948-c69b6d0daddd None admin] PATH_INFO: `/v3/users/1d31ec1ede884a4282dee0164ba5ed3b` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:15.011058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7ede4-5e79-4218-9948-c69b6d0daddd None admin] RBAC: Authorizing `identity:get_user(user_id=1d31ec1ede884a4282dee0164ba5ed3b)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:15.012469 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7ede4-5e79-4218-9948-c69b6d0daddd None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:15.014109 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 559/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:18:14 2022] GET /identity/v3/users/1d31ec1ede884a4282dee0164ba5ed3b => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:15.019901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef212590-8e2b-43a4-98b7-e5fdd6903e62 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:15.119822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef212590-8e2b-43a4-98b7-e5fdd6903e62 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:15.151998 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb9615-d408-4965-97a0-4e951a6ee858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:15.153133 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb9615-d408-4965-97a0-4e951a6ee858 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:15.153416 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb9615-d408-4965-97a0-4e951a6ee858 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:15.153691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb9615-d408-4965-97a0-4e951a6ee858 None admin] PATH_INFO: `/v3/projects/5c8c579ad92f452cb4bbf4751a9b8e78` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:15.154870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb9615-d408-4965-97a0-4e951a6ee858 None admin] RBAC: Authorizing `identity:get_project(project_id=5c8c579ad92f452cb4bbf4751a9b8e78)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:15.156308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb9615-d408-4965-97a0-4e951a6ee858 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:15.158030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 593/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:18:15 2022] GET /identity/v3/projects/5c8c579ad92f452cb4bbf4751a9b8e78 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:15.164635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7ede4-5e79-4218-9948-c69b6d0daddd None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:15.277898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7ede4-5e79-4218-9948-c69b6d0daddd None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:15.314353 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa979b3-2c56-4001-9b50-1b8b9bc2b3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:15.315245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa979b3-2c56-4001-9b50-1b8b9bc2b3a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:15.315530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa979b3-2c56-4001-9b50-1b8b9bc2b3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:15.315809 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa979b3-2c56-4001-9b50-1b8b9bc2b3a7 None admin] PATH_INFO: `/v3/projects/5c8c579ad92f452cb4bbf4751a9b8e78/users/1d31ec1ede884a4282dee0164ba5ed3b/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:15.317952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa979b3-2c56-4001-9b50-1b8b9bc2b3a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c8c579ad92f452cb4bbf4751a9b8e78, user_id=1d31ec1ede884a4282dee0164ba5ed3b, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:15.319930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa979b3-2c56-4001-9b50-1b8b9bc2b3a7 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:15.333043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 560/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:18:15 2022] PUT /identity/v3/projects/5c8c579ad92f452cb4bbf4751a9b8e78/users/1d31ec1ede884a4282dee0164ba5ed3b/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:18:17.342253 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1775c26-3a94-43fc-9b48-3c4bb68e35f5 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:17.342758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1775c26-3a94-43fc-9b48-3c4bb68e35f5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:17.342758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1775c26-3a94-43fc-9b48-3c4bb68e35f5 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:17.344098 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 594/1154] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:18:17.349333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e135a9d-38e3-4fc2-ab22-434743b00057 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:17.349697 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e135a9d-38e3-4fc2-ab22-434743b00057 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:17.349889 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e135a9d-38e3-4fc2-ab22-434743b00057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:17.361940 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:17.367319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-9e135a9d-38e3-4fc2-ab22-434743b00057 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:18:17.368703 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9e135a9d-38e3-4fc2-ab22-434743b00057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:18:17.435200 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 561/1155] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:18:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:18:17.458366 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1775c26-3a94-43fc-9b48-3c4bb68e35f5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:17.489445 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:17.557461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1775c26-3a94-43fc-9b48-3c4bb68e35f5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:17.591084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf49c2-9225-4c23-a10e-670d7c1671b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:17.591862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf49c2-9225-4c23-a10e-670d7c1671b1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:17.592145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf49c2-9225-4c23-a10e-670d7c1671b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:17.592465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf49c2-9225-4c23-a10e-670d7c1671b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:17.602064 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf49c2-9225-4c23-a10e-670d7c1671b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a2cf49c2-9225-4c23-a10e-670d7c1671b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:18:17.609558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:18:17.610669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:18:17.611697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:18:17.611697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:18:17.611697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:18:17.611697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:18:17.611697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:18:17.611697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:18:17.611697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:18:17.611697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:18:17.611697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:18:17.611697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:18:17.611697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:18:17.611697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:18:17.611697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 595/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:18:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:18:17.619128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e135a9d-38e3-4fc2-ab22-434743b00057 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:17.717057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e135a9d-38e3-4fc2-ab22-434743b00057 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:17.748639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fb991-1f77-48b3-b7e2-f62f72d99b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:17.749324 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb991-1f77-48b3-b7e2-f62f72d99b54 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:17.749608 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb991-1f77-48b3-b7e2-f62f72d99b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:17.749884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb991-1f77-48b3-b7e2-f62f72d99b54 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:17.750629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fb991-1f77-48b3-b7e2-f62f72d99b54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:18:17.750934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fb991-1f77-48b3-b7e2-f62f72d99b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:17.752286 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fb991-1f77-48b3-b7e2-f62f72d99b54 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:17.754399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:17.761264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 562/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:18:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:17.767080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf49c2-9225-4c23-a10e-670d7c1671b1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:17.856327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:17.864724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf49c2-9225-4c23-a10e-670d7c1671b1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:17.896953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871f387-017b-4793-a150-0db775eaa5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:17.897822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871f387-017b-4793-a150-0db775eaa5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:17.898101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871f387-017b-4793-a150-0db775eaa5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:17.898372 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871f387-017b-4793-a150-0db775eaa5b3 None admin] PATH_INFO: `/v3/users/1d31ec1ede884a4282dee0164ba5ed3b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:17.899524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871f387-017b-4793-a150-0db775eaa5b3 None admin] RBAC: Authorizing `identity:get_user(user_id=1d31ec1ede884a4282dee0164ba5ed3b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:17.900963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871f387-017b-4793-a150-0db775eaa5b3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:17.902828 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 596/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:18:17 2022] GET /identity/v3/users/1d31ec1ede884a4282dee0164ba5ed3b => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:17.908512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fb991-1f77-48b3-b7e2-f62f72d99b54 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:18.004700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fb991-1f77-48b3-b7e2-f62f72d99b54 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:18.036490 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173e7db-62d4-461f-88cc-594ee83b2da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:18.037161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173e7db-62d4-461f-88cc-594ee83b2da4 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:18.037441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173e7db-62d4-461f-88cc-594ee83b2da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:18.037714 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173e7db-62d4-461f-88cc-594ee83b2da4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:18.098395 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:18.102590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173e7db-62d4-461f-88cc-594ee83b2da4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:18.104026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173e7db-62d4-461f-88cc-594ee83b2da4 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:18.196886 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 563/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:18:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:18:18.202687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871f387-017b-4793-a150-0db775eaa5b3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:18.297688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871f387-017b-4793-a150-0db775eaa5b3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:18.329165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252efb4d-f661-4aea-b2bb-6c27a2083b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:18.330004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252efb4d-f661-4aea-b2bb-6c27a2083b69 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:18.330281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252efb4d-f661-4aea-b2bb-6c27a2083b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:18.330551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252efb4d-f661-4aea-b2bb-6c27a2083b69 None admin] PATH_INFO: `/v3/projects/5c8c579ad92f452cb4bbf4751a9b8e78` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:18.331698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252efb4d-f661-4aea-b2bb-6c27a2083b69 None admin] RBAC: Authorizing `identity:get_project(project_id=5c8c579ad92f452cb4bbf4751a9b8e78)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:18.333126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252efb4d-f661-4aea-b2bb-6c27a2083b69 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:18.334938 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 597/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:18:18 2022] GET /identity/v3/projects/5c8c579ad92f452cb4bbf4751a9b8e78 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:18.340675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173e7db-62d4-461f-88cc-594ee83b2da4 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:18.433123 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:18.437249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173e7db-62d4-461f-88cc-594ee83b2da4 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:18.469319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe025287-05d4-4638-8f42-80fd3967aa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:18.469903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe025287-05d4-4638-8f42-80fd3967aa91 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:18.470189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe025287-05d4-4638-8f42-80fd3967aa91 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:18.470466 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe025287-05d4-4638-8f42-80fd3967aa91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:18.471289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe025287-05d4-4638-8f42-80fd3967aa91 None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=5c8c579ad92f452cb4bbf4751a9b8e78, user.id=1d31ec1ede884a4282dee0164ba5ed3b) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:18:18.471599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe025287-05d4-4638-8f42-80fd3967aa91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:18.473036 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe025287-05d4-4638-8f42-80fd3967aa91 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:18.479156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 564/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:18:18 2022] GET /identity/v3/role_assignments?user.id=1d31ec1ede884a4282dee0164ba5ed3b&scope.project.id=5c8c579ad92f452cb4bbf4751a9b8e78&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:20.476551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4e222-0ee6-4bfa-88a6-9fe3cc0a3a6c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:20.477086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4e222-0ee6-4bfa-88a6-9fe3cc0a3a6c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:20.477086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4e222-0ee6-4bfa-88a6-9fe3cc0a3a6c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:20.478437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 598/1162] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:18:20.483672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9245d-a0d4-431a-8fd6-db06db50796b None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:20.484068 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9245d-a0d4-431a-8fd6-db06db50796b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:20.484234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9245d-a0d4-431a-8fd6-db06db50796b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:20.500362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-34f9245d-a0d4-431a-8fd6-db06db50796b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:18:20.501564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-34f9245d-a0d4-431a-8fd6-db06db50796b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:18:20.565069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 565/1163] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:18:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:18:20.587861 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4e222-0ee6-4bfa-88a6-9fe3cc0a3a6c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:20.615503 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:20.685938 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4e222-0ee6-4bfa-88a6-9fe3cc0a3a6c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:20.718823 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d71cd-a020-4cfa-9437-6a344b6a877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:20.719458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d71cd-a020-4cfa-9437-6a344b6a877a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:20.719741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d71cd-a020-4cfa-9437-6a344b6a877a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:20.720019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d71cd-a020-4cfa-9437-6a344b6a877a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:20.783568 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d71cd-a020-4cfa-9437-6a344b6a877a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:20.785044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d71cd-a020-4cfa-9437-6a344b6a877a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:20.810511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:20.879732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 599/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:18:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:18:20.886063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9245d-a0d4-431a-8fd6-db06db50796b None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:20.976533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:20.985097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9245d-a0d4-431a-8fd6-db06db50796b None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:21.019798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ddf4a-6879-4778-be48-4f02785952d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:21.020588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ddf4a-6879-4778-be48-4f02785952d7 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:21.020872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ddf4a-6879-4778-be48-4f02785952d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:21.021177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ddf4a-6879-4778-be48-4f02785952d7 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:21.027992 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ddf4a-6879-4778-be48-4f02785952d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:21.029465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ddf4a-6879-4778-be48-4f02785952d7 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-782ddf4a-6879-4778-be48-4f02785952d7 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:18:21.043360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:18:21.044560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:18:21.045627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:18:21.045627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:18:21.045627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:18:21.045627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:18:21.045627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:18:21.045627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:18:21.045627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:18:21.045627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:18:21.045627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:18:21.045627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:18:21.045627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 22:18:21.045627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:18:21.045627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 22:18:21.045627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:18:21.045627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 566/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jul 21 22:18:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:18:21.050317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d71cd-a020-4cfa-9437-6a344b6a877a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:21.145140 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d71cd-a020-4cfa-9437-6a344b6a877a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:21.169881 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:21.177957 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610af7c-bcd8-4c88-b691-b752d9a0eaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:21.179199 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610af7c-bcd8-4c88-b691-b752d9a0eaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:21.179479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610af7c-bcd8-4c88-b691-b752d9a0eaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:21.179754 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610af7c-bcd8-4c88-b691-b752d9a0eaf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:21.180463 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610af7c-bcd8-4c88-b691-b752d9a0eaf4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:18:21.180767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610af7c-bcd8-4c88-b691-b752d9a0eaf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:21.182150 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610af7c-bcd8-4c88-b691-b752d9a0eaf4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:21.188995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 600/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jul 21 22:18:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:23.188030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a87cc-1fbb-42c2-ad2e-0ce3f4607461 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:23.188572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a87cc-1fbb-42c2-ad2e-0ce3f4607461 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:23.188572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a87cc-1fbb-42c2-ad2e-0ce3f4607461 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:23.189998 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 567/1167] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:18:23.195679 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555c539-3cb3-4ec6-aa80-27e6a7b05f67 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:23.196085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555c539-3cb3-4ec6-aa80-27e6a7b05f67 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:23.196239 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555c539-3cb3-4ec6-aa80-27e6a7b05f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:23.212467 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0555c539-3cb3-4ec6-aa80-27e6a7b05f67 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:18:23.213676 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0555c539-3cb3-4ec6-aa80-27e6a7b05f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:18:23.277715 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 601/1168] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:18:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:18:23.300419 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a87cc-1fbb-42c2-ad2e-0ce3f4607461 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:23.400013 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a87cc-1fbb-42c2-ad2e-0ce3f4607461 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:23.432270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f76cc-31c8-4ac2-8658-618bbc1f7ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:23.432919 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f76cc-31c8-4ac2-8658-618bbc1f7ed0 None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:23.433228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f76cc-31c8-4ac2-8658-618bbc1f7ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:23.433499 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f76cc-31c8-4ac2-8658-618bbc1f7ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:23.434231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f76cc-31c8-4ac2-8658-618bbc1f7ed0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:23.435572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f76cc-31c8-4ac2-8658-618bbc1f7ed0 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:23.451512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 568/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Thu Jul 21 22:18:23 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:18:25.478196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7a0e4-bb92-4652-b702-658bb5ca4b03 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:25.478712 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7a0e4-bb92-4652-b702-658bb5ca4b03 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:25.478806 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7a0e4-bb92-4652-b702-658bb5ca4b03 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:25.480148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 602/1170] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:18:25.485252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d4d78-b34b-4bcd-a71a-b3fab4ac2c9d None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:25.485667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d4d78-b34b-4bcd-a71a-b3fab4ac2c9d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:25.485810 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d4d78-b34b-4bcd-a71a-b3fab4ac2c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:25.502450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-fd7d4d78-b34b-4bcd-a71a-b3fab4ac2c9d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:18:25.503620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-fd7d4d78-b34b-4bcd-a71a-b3fab4ac2c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:18:25.511338 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:25.568799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 569/1171] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:18:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:18:25.593600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7a0e4-bb92-4652-b702-658bb5ca4b03 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:25.691727 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7a0e4-bb92-4652-b702-658bb5ca4b03 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:25.714205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:25.726990 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d5f9a-f5c6-475c-afac-ca00702df8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:25.727847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d5f9a-f5c6-475c-afac-ca00702df8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:25.728131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d5f9a-f5c6-475c-afac-ca00702df8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:25.728456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d5f9a-f5c6-475c-afac-ca00702df8f7 None admin] PATH_INFO: `/v3/domains/c8386374e96346e29ca27c770802ae99` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:25.738399 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d5f9a-f5c6-475c-afac-ca00702df8f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c8386374e96346e29ca27c770802ae99)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:25.739826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d5f9a-f5c6-475c-afac-ca00702df8f7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:25.742028 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 603/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Jul 21 22:18:25 2022] GET /identity/v3/domains/c8386374e96346e29ca27c770802ae99 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:25.747762 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d4d78-b34b-4bcd-a71a-b3fab4ac2c9d None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:25.840004 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d4d78-b34b-4bcd-a71a-b3fab4ac2c9d None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:25.872254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c48134-7cb6-4b1f-8877-11d1ce2438ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:25.872894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c48134-7cb6-4b1f-8877-11d1ce2438ad None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:25.873205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c48134-7cb6-4b1f-8877-11d1ce2438ad None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:25.873477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c48134-7cb6-4b1f-8877-11d1ce2438ad None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:25.874177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c48134-7cb6-4b1f-8877-11d1ce2438ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:25.875574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c48134-7cb6-4b1f-8877-11d1ce2438ad None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:25.887764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:25.899877 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 570/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jul 21 22:18:25 2022] POST /identity/v3/projects => generated 361 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:18:27.932074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa2ca8-3b29-4a57-bbf7-3c03980214bc None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:27.932677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa2ca8-3b29-4a57-bbf7-3c03980214bc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:27.932677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa2ca8-3b29-4a57-bbf7-3c03980214bc None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:27.934017 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 604/1174] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:18:27.939271 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097a5ef-1359-4007-a486-40f53f8891f7 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:27.939712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097a5ef-1359-4007-a486-40f53f8891f7 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:27.939809 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097a5ef-1359-4007-a486-40f53f8891f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:27.956649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-9097a5ef-1359-4007-a486-40f53f8891f7 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:18:27.957847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9097a5ef-1359-4007-a486-40f53f8891f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:18:28.020884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 571/1175] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:18:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:18:28.045329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa2ca8-3b29-4a57-bbf7-3c03980214bc None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:28.143581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa2ca8-3b29-4a57-bbf7-3c03980214bc None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:28.176001 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ae2c5-3777-46e2-aa11-f171484db8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:28.176850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ae2c5-3777-46e2-aa11-f171484db8db None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:28.177165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ae2c5-3777-46e2-aa11-f171484db8db None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:28.177442 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ae2c5-3777-46e2-aa11-f171484db8db None admin] PATH_INFO: `/v3/domains/c8386374e96346e29ca27c770802ae99` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:28.179207 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ae2c5-3777-46e2-aa11-f171484db8db None admin] RBAC: Authorizing `identity:get_domain(domain_id=c8386374e96346e29ca27c770802ae99)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:28.180619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ae2c5-3777-46e2-aa11-f171484db8db None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:28.182315 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 605/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Jul 21 22:18:28 2022] GET /identity/v3/domains/c8386374e96346e29ca27c770802ae99 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:28.187890 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097a5ef-1359-4007-a486-40f53f8891f7 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:28.281555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097a5ef-1359-4007-a486-40f53f8891f7 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:28.304960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:28.315815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20a461-e661-45d9-a3f7-852d5e68bd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:28.316473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20a461-e661-45d9-a3f7-852d5e68bd6f None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:28.316758 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20a461-e661-45d9-a3f7-852d5e68bd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:28.317069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20a461-e661-45d9-a3f7-852d5e68bd6f None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:28.317781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20a461-e661-45d9-a3f7-852d5e68bd6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:28.319224 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20a461-e661-45d9-a3f7-852d5e68bd6f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:28.338151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 572/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:18:28 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:18:30.382468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bd982-e8ec-491f-86bf-7f613efa18bf None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:30.382977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bd982-e8ec-491f-86bf-7f613efa18bf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:30.382977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bd982-e8ec-491f-86bf-7f613efa18bf None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:30.384299 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 606/1178] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:18:30.390316 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed985a94-2275-47cf-9102-6674932f90d5 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:30.390811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed985a94-2275-47cf-9102-6674932f90d5 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:30.391298 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed985a94-2275-47cf-9102-6674932f90d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:30.412119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-ed985a94-2275-47cf-9102-6674932f90d5 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:18:30.413330 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ed985a94-2275-47cf-9102-6674932f90d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:18:30.479660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 573/1179] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:18:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:18:30.502690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bd982-e8ec-491f-86bf-7f613efa18bf None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:30.552065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:30.600853 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bd982-e8ec-491f-86bf-7f613efa18bf None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:30.633599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10445227-9731-4936-94e7-b6e585583749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:30.634320 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10445227-9731-4936-94e7-b6e585583749 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:30.634600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10445227-9731-4936-94e7-b6e585583749 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:30.634871 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10445227-9731-4936-94e7-b6e585583749 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:30.644469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10445227-9731-4936-94e7-b6e585583749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-10445227-9731-4936-94e7-b6e585583749 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:18:30.652279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:18:30.653505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:18:30.654450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:18:30.654450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:18:30.654450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:18:30.654450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:18:30.654450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:18:30.654450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:18:30.654450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:18:30.654450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:18:30.654450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:18:30.654450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:18:30.654450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:18:30.654450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:18:30.654450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 607/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:18:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:18:30.659284 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed985a94-2275-47cf-9102-6674932f90d5 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:30.765053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed985a94-2275-47cf-9102-6674932f90d5 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:30.775120 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:30.798363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e9cc0-005e-4c45-aa00-5a86602bc48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:30.799024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e9cc0-005e-4c45-aa00-5a86602bc48d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:30.799308 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e9cc0-005e-4c45-aa00-5a86602bc48d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:30.799587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e9cc0-005e-4c45-aa00-5a86602bc48d None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:30.800329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e9cc0-005e-4c45-aa00-5a86602bc48d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:18:30.800637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e9cc0-005e-4c45-aa00-5a86602bc48d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:30.802032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e9cc0-005e-4c45-aa00-5a86602bc48d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:30.810248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 574/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:18:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:30.815969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10445227-9731-4936-94e7-b6e585583749 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:30.912040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10445227-9731-4936-94e7-b6e585583749 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:30.921655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:30.945053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59637b-9cc8-4e60-a176-1b3e1836684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:30.945897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59637b-9cc8-4e60-a176-1b3e1836684b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:30.946173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59637b-9cc8-4e60-a176-1b3e1836684b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:30.946444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59637b-9cc8-4e60-a176-1b3e1836684b None admin] PATH_INFO: `/v3/users/df00b38e30c641df83597afb7d79c9df` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:30.958783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59637b-9cc8-4e60-a176-1b3e1836684b None admin] RBAC: Authorizing `identity:get_user(user_id=df00b38e30c641df83597afb7d79c9df)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:30.960232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59637b-9cc8-4e60-a176-1b3e1836684b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:30.961850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 608/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:18:30 2022] GET /identity/v3/users/df00b38e30c641df83597afb7d79c9df => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:30.967679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e9cc0-005e-4c45-aa00-5a86602bc48d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:31.064724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e9cc0-005e-4c45-aa00-5a86602bc48d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:31.096561 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41a328-ea09-47b8-b343-b1e89983f8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:31.097236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41a328-ea09-47b8-b343-b1e89983f8bd None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:31.097523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41a328-ea09-47b8-b343-b1e89983f8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:31.097803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41a328-ea09-47b8-b343-b1e89983f8bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:31.137286 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:31.163107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41a328-ea09-47b8-b343-b1e89983f8bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:31.165059 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41a328-ea09-47b8-b343-b1e89983f8bd None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:31.258533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 575/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:18:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:18:31.264405 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59637b-9cc8-4e60-a176-1b3e1836684b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:31.359158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59637b-9cc8-4e60-a176-1b3e1836684b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:31.390610 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4bb0e-5c59-4865-a8a0-6802a6c94d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:31.391447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4bb0e-5c59-4865-a8a0-6802a6c94d4e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:31.391730 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4bb0e-5c59-4865-a8a0-6802a6c94d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:31.392002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4bb0e-5c59-4865-a8a0-6802a6c94d4e None admin] PATH_INFO: `/v3/projects/8fe574147fd949fcadfe79b4d4d6a88c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:31.393180 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4bb0e-5c59-4865-a8a0-6802a6c94d4e None admin] RBAC: Authorizing `identity:get_project(project_id=8fe574147fd949fcadfe79b4d4d6a88c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:31.394590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4bb0e-5c59-4865-a8a0-6802a6c94d4e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:31.396231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 609/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:18:31 2022] GET /identity/v3/projects/8fe574147fd949fcadfe79b4d4d6a88c => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:31.402989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41a328-ea09-47b8-b343-b1e89983f8bd None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:31.469665 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:31.498379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41a328-ea09-47b8-b343-b1e89983f8bd None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:31.531234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9941d-b747-4180-aa7e-744868d9b84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:31.531880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9941d-b747-4180-aa7e-744868d9b84e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:31.532165 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9941d-b747-4180-aa7e-744868d9b84e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:31.532444 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9941d-b747-4180-aa7e-744868d9b84e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:31.533301 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9941d-b747-4180-aa7e-744868d9b84e None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=8fe574147fd949fcadfe79b4d4d6a88c, user.id=df00b38e30c641df83597afb7d79c9df) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:18:31.533620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9941d-b747-4180-aa7e-744868d9b84e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:31.535036 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9941d-b747-4180-aa7e-744868d9b84e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:31.540838 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 576/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:18:31 2022] GET /identity/v3/role_assignments?user.id=df00b38e30c641df83597afb7d79c9df&scope.project.id=8fe574147fd949fcadfe79b4d4d6a88c&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:18:33.526115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e0fb6-f284-4637-be91-4edd83a68e87 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:33.526653 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e0fb6-f284-4637-be91-4edd83a68e87 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:33.526653 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e0fb6-f284-4637-be91-4edd83a68e87 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:33.528322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 610/1186] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:18:33.533357 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6abd23-6ad1-4364-b703-08234ac2ca8e None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:33.533784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6abd23-6ad1-4364-b703-08234ac2ca8e None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:33.533917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6abd23-6ad1-4364-b703-08234ac2ca8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:33.551167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-ce6abd23-6ad1-4364-b703-08234ac2ca8e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:18:33.552368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ce6abd23-6ad1-4364-b703-08234ac2ca8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:18:33.615986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 577/1187] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:18:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:18:33.638065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e0fb6-f284-4637-be91-4edd83a68e87 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:33.674255 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:33.737278 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e0fb6-f284-4637-be91-4edd83a68e87 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:33.769324 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26dae0-df01-4460-be27-1b56d7be5d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:33.770099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26dae0-df01-4460-be27-1b56d7be5d12 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:33.770380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26dae0-df01-4460-be27-1b56d7be5d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:33.770654 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26dae0-df01-4460-be27-1b56d7be5d12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:33.781114 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26dae0-df01-4460-be27-1b56d7be5d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-7f26dae0-df01-4460-be27-1b56d7be5d12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:18:33.789096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:18:33.790173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:18:33.791219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:18:33.791219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:18:33.791219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:18:33.791219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:18:33.791219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:18:33.791219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:18:33.791219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:18:33.791219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:18:33.791219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:18:33.791219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:18:33.791219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:18:33.791219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:18:33.791219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 611/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:18:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:18:33.796304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6abd23-6ad1-4364-b703-08234ac2ca8e None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:33.857546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:33.889802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6abd23-6ad1-4364-b703-08234ac2ca8e None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:33.922767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e6c61-079c-4a7d-b0dd-a811a2a0f4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:33.923429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e6c61-079c-4a7d-b0dd-a811a2a0f4ff None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:33.923713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e6c61-079c-4a7d-b0dd-a811a2a0f4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:33.923992 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e6c61-079c-4a7d-b0dd-a811a2a0f4ff None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:33.924734 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e6c61-079c-4a7d-b0dd-a811a2a0f4ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:18:33.925072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e6c61-079c-4a7d-b0dd-a811a2a0f4ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:33.926432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e6c61-079c-4a7d-b0dd-a811a2a0f4ff None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:33.934195 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 578/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:18:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:33.939890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26dae0-df01-4460-be27-1b56d7be5d12 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:34.030334 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:34.036576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26dae0-df01-4460-be27-1b56d7be5d12 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:34.067905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5abfa8-561f-4a06-bc99-a2814a445244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:34.069302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5abfa8-561f-4a06-bc99-a2814a445244 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:34.069589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5abfa8-561f-4a06-bc99-a2814a445244 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:34.069862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5abfa8-561f-4a06-bc99-a2814a445244 None admin] PATH_INFO: `/v3/users/df00b38e30c641df83597afb7d79c9df` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:34.071034 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5abfa8-561f-4a06-bc99-a2814a445244 None admin] RBAC: Authorizing `identity:get_user(user_id=df00b38e30c641df83597afb7d79c9df)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:34.072455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5abfa8-561f-4a06-bc99-a2814a445244 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:34.074242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 612/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:18:33 2022] GET /identity/v3/users/df00b38e30c641df83597afb7d79c9df => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:34.079786 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e6c61-079c-4a7d-b0dd-a811a2a0f4ff None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:34.175359 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e6c61-079c-4a7d-b0dd-a811a2a0f4ff None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:34.200199 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:34.207875 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880937f6-a203-4b2f-bf59-01310f8f7d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:34.208720 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880937f6-a203-4b2f-bf59-01310f8f7d9f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:34.209043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880937f6-a203-4b2f-bf59-01310f8f7d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:34.209859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880937f6-a203-4b2f-bf59-01310f8f7d9f None admin] PATH_INFO: `/v3/projects/8fe574147fd949fcadfe79b4d4d6a88c` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:34.211015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880937f6-a203-4b2f-bf59-01310f8f7d9f None admin] RBAC: Authorizing `identity:get_project(project_id=8fe574147fd949fcadfe79b4d4d6a88c)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:34.212432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880937f6-a203-4b2f-bf59-01310f8f7d9f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:34.214134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 579/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:18:34 2022] GET /identity/v3/projects/8fe574147fd949fcadfe79b4d4d6a88c => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:18:34.219805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5abfa8-561f-4a06-bc99-a2814a445244 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:34.315990 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5abfa8-561f-4a06-bc99-a2814a445244 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:34.347381 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fae58f-18cd-40f9-89e1-0fd29ea404a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:34.348241 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fae58f-18cd-40f9-89e1-0fd29ea404a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:34.348524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fae58f-18cd-40f9-89e1-0fd29ea404a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:34.348795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fae58f-18cd-40f9-89e1-0fd29ea404a2 None admin] PATH_INFO: `/v3/projects/8fe574147fd949fcadfe79b4d4d6a88c/users/df00b38e30c641df83597afb7d79c9df/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:34.351310 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fae58f-18cd-40f9-89e1-0fd29ea404a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8fe574147fd949fcadfe79b4d4d6a88c, user_id=df00b38e30c641df83597afb7d79c9df, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:34.352728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fae58f-18cd-40f9-89e1-0fd29ea404a2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:34.365188 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 613/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:18:34 2022] PUT /identity/v3/projects/8fe574147fd949fcadfe79b4d4d6a88c/users/df00b38e30c641df83597afb7d79c9df/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:18:36.348803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb07e8-e1ce-4953-85d5-989eaca06363 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:36.349492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb07e8-e1ce-4953-85d5-989eaca06363 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:36.349492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb07e8-e1ce-4953-85d5-989eaca06363 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:36.350662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 580/1193] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:18:36.355725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e8324-3f11-405b-bac4-da2f3a07c2f6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:36.356112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e8324-3f11-405b-bac4-da2f3a07c2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:36.356278 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e8324-3f11-405b-bac4-da2f3a07c2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:36.372323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c87e8324-3f11-405b-bac4-da2f3a07c2f6 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:18:36.373507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c87e8324-3f11-405b-bac4-da2f3a07c2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:18:36.390551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:36.438896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 614/1194] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:18:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:18:36.462303 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb07e8-e1ce-4953-85d5-989eaca06363 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:36.557484 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb07e8-e1ce-4953-85d5-989eaca06363 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:36.589812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417d346-d01b-45e1-ac09-22665f5fdca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:36.590580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417d346-d01b-45e1-ac09-22665f5fdca2 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:36.590859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417d346-d01b-45e1-ac09-22665f5fdca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:36.591129 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417d346-d01b-45e1-ac09-22665f5fdca2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:36.600791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417d346-d01b-45e1-ac09-22665f5fdca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-2417d346-d01b-45e1-ac09-22665f5fdca2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:18:36.608244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:18:36.609375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:18:36.610479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:18:36.610479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:18:36.610479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:18:36.610479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:18:36.610479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:18:36.610479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:18:36.610479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:18:36.610479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:18:36.610479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:18:36.610479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:18:36.610479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:18:36.610479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:18:36.610479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 581/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:18:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:18:36.615145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e8324-3f11-405b-bac4-da2f3a07c2f6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:36.709417 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e8324-3f11-405b-bac4-da2f3a07c2f6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:36.741241 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddae1e1-a54d-4fe7-af44-d440ed5dc00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:36.741885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddae1e1-a54d-4fe7-af44-d440ed5dc00d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:36.742162 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddae1e1-a54d-4fe7-af44-d440ed5dc00d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:36.742432 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddae1e1-a54d-4fe7-af44-d440ed5dc00d None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:36.743169 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddae1e1-a54d-4fe7-af44-d440ed5dc00d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:18:36.743471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddae1e1-a54d-4fe7-af44-d440ed5dc00d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:36.744817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddae1e1-a54d-4fe7-af44-d440ed5dc00d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:36.752437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 615/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:18:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:36.758469 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417d346-d01b-45e1-ac09-22665f5fdca2 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:36.812090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:36.854925 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417d346-d01b-45e1-ac09-22665f5fdca2 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:36.887031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08848152-8bb1-4b1a-b09a-7928c4d4c3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:36.887882 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08848152-8bb1-4b1a-b09a-7928c4d4c3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:36.888160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08848152-8bb1-4b1a-b09a-7928c4d4c3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:36.888433 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08848152-8bb1-4b1a-b09a-7928c4d4c3c2 None admin] PATH_INFO: `/v3/users/df00b38e30c641df83597afb7d79c9df` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:36.889602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08848152-8bb1-4b1a-b09a-7928c4d4c3c2 None admin] RBAC: Authorizing `identity:get_user(user_id=df00b38e30c641df83597afb7d79c9df)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:36.891014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08848152-8bb1-4b1a-b09a-7928c4d4c3c2 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:36.892607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 582/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jul 21 22:18:36 2022] GET /identity/v3/users/df00b38e30c641df83597afb7d79c9df => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:36.898572 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddae1e1-a54d-4fe7-af44-d440ed5dc00d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:36.916473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:36.994404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddae1e1-a54d-4fe7-af44-d440ed5dc00d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:37.025237 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7a413-a43f-4c89-9c7b-48fed58da9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:37.025865 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7a413-a43f-4c89-9c7b-48fed58da9fa None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:37.026145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7a413-a43f-4c89-9c7b-48fed58da9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:37.026414 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7a413-a43f-4c89-9c7b-48fed58da9fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:37.091228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7a413-a43f-4c89-9c7b-48fed58da9fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:37.092667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7a413-a43f-4c89-9c7b-48fed58da9fa None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:37.109614 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:37.187593 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 616/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:18:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:18:37.193987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08848152-8bb1-4b1a-b09a-7928c4d4c3c2 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:37.289740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08848152-8bb1-4b1a-b09a-7928c4d4c3c2 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:37.311223 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:37.322424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee1585-0e1c-492d-ad5b-c9b697a1f91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:37.323264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee1585-0e1c-492d-ad5b-c9b697a1f91a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:37.323545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee1585-0e1c-492d-ad5b-c9b697a1f91a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:37.323819 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee1585-0e1c-492d-ad5b-c9b697a1f91a None admin] PATH_INFO: `/v3/projects/8fe574147fd949fcadfe79b4d4d6a88c` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:37.324993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee1585-0e1c-492d-ad5b-c9b697a1f91a None admin] RBAC: Authorizing `identity:get_project(project_id=8fe574147fd949fcadfe79b4d4d6a88c)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:37.326413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee1585-0e1c-492d-ad5b-c9b697a1f91a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:37.328060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 583/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jul 21 22:18:37 2022] GET /identity/v3/projects/8fe574147fd949fcadfe79b4d4d6a88c => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:18:37.334182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7a413-a43f-4c89-9c7b-48fed58da9fa None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:18:37.426878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7a413-a43f-4c89-9c7b-48fed58da9fa None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:18:37.442645 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:37.460304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c24cec-e1ba-4e23-8d30-9d6568772258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:18:37.460949 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c24cec-e1ba-4e23-8d30-9d6568772258 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:18:37.461239 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c24cec-e1ba-4e23-8d30-9d6568772258 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:18:37.461508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c24cec-e1ba-4e23-8d30-9d6568772258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:18:37.462322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c24cec-e1ba-4e23-8d30-9d6568772258 None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=8fe574147fd949fcadfe79b4d4d6a88c, user.id=df00b38e30c641df83597afb7d79c9df) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:18:37.462630 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c24cec-e1ba-4e23-8d30-9d6568772258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:18:37.464041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c24cec-e1ba-4e23-8d30-9d6568772258 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:18:37.469648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 617/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:18:37 2022] GET /identity/v3/role_assignments?user.id=df00b38e30c641df83597afb7d79c9df&scope.project.id=8fe574147fd949fcadfe79b4d4d6a88c&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:18:47.317926 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:18:47.467163 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=10 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:32.596367 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15280d-3683-41ca-84c0-3576c8e994e8 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:32.596996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15280d-3683-41ca-84c0-3576c8e994e8 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:32.597866 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15280d-3683-41ca-84c0-3576c8e994e8 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:32.599901 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 584/1201] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:19:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:19:32.605714 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4c204-2ef4-4ab8-ace2-a1bd4d7c634d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:32.606211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4c204-2ef4-4ab8-ace2-a1bd4d7c634d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:32.606211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4c204-2ef4-4ab8-ace2-a1bd4d7c634d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:32.626997 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a5f4c204-2ef4-4ab8-ace2-a1bd4d7c634d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:19:32.628210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a5f4c204-2ef4-4ab8-ace2-a1bd4d7c634d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:19:32.720656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 618/1202] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:19:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:19:32.749130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15280d-3683-41ca-84c0-3576c8e994e8 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:32.871484 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15280d-3683-41ca-84c0-3576c8e994e8 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:32.918352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5cba7-0fe8-4ecc-b82b-0779ab00d6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:32.919530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5cba7-0fe8-4ecc-b82b-0779ab00d6ed None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:32.919944 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5cba7-0fe8-4ecc-b82b-0779ab00d6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:32.920278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5cba7-0fe8-4ecc-b82b-0779ab00d6ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:32.936975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5cba7-0fe8-4ecc-b82b-0779ab00d6ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:32.938603 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5cba7-0fe8-4ecc-b82b-0779ab00d6ed None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:32.960864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-5be5cba7-0fe8-4ecc-b82b-0779ab00d6ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:32.960864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:32.960864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:32.960864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:32.960864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:32.960864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:32.960864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:32.960864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:32.960864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:32.960864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:32.960864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:32.960864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:32.960864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:19:32.960864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:19:32.960864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:32.962413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:32.963653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:19:32.963653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:19:32.963653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:32.963653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:32.968291 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4c204-2ef4-4ab8-ace2-a1bd4d7c634d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:32.970618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 585/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:33.091066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4c204-2ef4-4ab8-ace2-a1bd4d7c634d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:33.126811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:33.134576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd975aa-e8f0-418b-8006-a6d0e6e2dd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:33.135304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd975aa-e8f0-418b-8006-a6d0e6e2dd82 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:33.135630 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd975aa-e8f0-418b-8006-a6d0e6e2dd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:33.135981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd975aa-e8f0-418b-8006-a6d0e6e2dd82 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:33.136697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd975aa-e8f0-418b-8006-a6d0e6e2dd82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:33.137122 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd975aa-e8f0-418b-8006-a6d0e6e2dd82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:33.138720 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd975aa-e8f0-418b-8006-a6d0e6e2dd82 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:33.165113 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 619/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:33.167641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5cba7-0fe8-4ecc-b82b-0779ab00d6ed None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:33.240588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:33.307484 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5cba7-0fe8-4ecc-b82b-0779ab00d6ed None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:33.351220 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991dde1-2c37-409b-8570-5f533a9eaeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:33.352335 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991dde1-2c37-409b-8570-5f533a9eaeaa None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:33.352807 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991dde1-2c37-409b-8570-5f533a9eaeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:33.353260 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991dde1-2c37-409b-8570-5f533a9eaeaa None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:33.354123 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991dde1-2c37-409b-8570-5f533a9eaeaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:33.356031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991dde1-2c37-409b-8570-5f533a9eaeaa None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:33.393054 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 586/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jul 21 22:19:33 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:19:35.869988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529343aa-8c43-47bd-8787-856d1f6fe8f1 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:35.870554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529343aa-8c43-47bd-8787-856d1f6fe8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:35.870554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529343aa-8c43-47bd-8787-856d1f6fe8f1 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:35.871926 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 620/1206] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:19:35.877924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fef23-ddf4-4aeb-a9fe-f9e4e9ffb346 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:35.878372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fef23-ddf4-4aeb-a9fe-f9e4e9ffb346 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:35.878551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fef23-ddf4-4aeb-a9fe-f9e4e9ffb346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:35.897162 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-8e4fef23-ddf4-4aeb-a9fe-f9e4e9ffb346 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:19:35.897781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8e4fef23-ddf4-4aeb-a9fe-f9e4e9ffb346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:19:35.981092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 587/1207] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:19:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:19:35.998549 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529343aa-8c43-47bd-8787-856d1f6fe8f1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:36.134478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529343aa-8c43-47bd-8787-856d1f6fe8f1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:36.172958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509513b-564c-4ab2-8692-2cf4277821a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:36.173768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509513b-564c-4ab2-8692-2cf4277821a4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:36.174094 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509513b-564c-4ab2-8692-2cf4277821a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:36.174412 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509513b-564c-4ab2-8692-2cf4277821a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:36.186592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509513b-564c-4ab2-8692-2cf4277821a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d509513b-564c-4ab2-8692-2cf4277821a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:19:36.194827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:36.195826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:36.196741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:36.196741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:36.196741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:36.196741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:36.196741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:19:36.196741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:19:36.196741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:19:36.196741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:19:36.196741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:19:36.196741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:19:36.196741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:19:36.196741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:19:36.196741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 621/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:19:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:19:36.204324 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fef23-ddf4-4aeb-a9fe-f9e4e9ffb346 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:36.250566 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:36.320585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fef23-ddf4-4aeb-a9fe-f9e4e9ffb346 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:36.362308 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739253d2-22f9-4efa-8c54-5bd22719ec3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:36.365292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739253d2-22f9-4efa-8c54-5bd22719ec3a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:36.365292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739253d2-22f9-4efa-8c54-5bd22719ec3a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:36.365292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739253d2-22f9-4efa-8c54-5bd22719ec3a None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:36.365292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739253d2-22f9-4efa-8c54-5bd22719ec3a None admin] RBAC: Adding query filter params (name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:36.365292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739253d2-22f9-4efa-8c54-5bd22719ec3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:36.366542 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739253d2-22f9-4efa-8c54-5bd22719ec3a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:36.375948 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 588/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:19:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:36.385248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509513b-564c-4ab2-8692-2cf4277821a4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:36.447978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:36.519421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509513b-564c-4ab2-8692-2cf4277821a4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:36.559261 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f1167-03e1-43ef-a262-e04ea539654f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:36.560111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f1167-03e1-43ef-a262-e04ea539654f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:36.560401 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f1167-03e1-43ef-a262-e04ea539654f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:36.560670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f1167-03e1-43ef-a262-e04ea539654f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:36.573110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f1167-03e1-43ef-a262-e04ea539654f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:36.574750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f1167-03e1-43ef-a262-e04ea539654f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:36.595125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d97f1167-03e1-43ef-a262-e04ea539654f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:36.595125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:36.595125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:36.595125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:36.595125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:36.595125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:36.595125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:36.595125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:36.595125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:36.595125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:36.595125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:36.595125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:36.595125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:19:36.595125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:19:36.595125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:36.602835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:36.603901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:19:36.603901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:19:36.603901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:36.603901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:19:36.603901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 622/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:36.604237 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739253d2-22f9-4efa-8c54-5bd22719ec3a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:36.721751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:36.725211 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739253d2-22f9-4efa-8c54-5bd22719ec3a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:36.770076 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d1d18-0791-49a8-b498-1a2122f7763d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:36.770735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d1d18-0791-49a8-b498-1a2122f7763d None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:36.771015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d1d18-0791-49a8-b498-1a2122f7763d None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:36.771291 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d1d18-0791-49a8-b498-1a2122f7763d None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:36.772017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d1d18-0791-49a8-b498-1a2122f7763d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:36.772325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d1d18-0791-49a8-b498-1a2122f7763d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:36.773797 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d1d18-0791-49a8-b498-1a2122f7763d None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:36.791177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 589/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:36.792437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f1167-03e1-43ef-a262-e04ea539654f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:36.903352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f1167-03e1-43ef-a262-e04ea539654f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:36.905349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:36.948612 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e22256-fc42-4007-94e1-ac429f8922b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:36.949500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e22256-fc42-4007-94e1-ac429f8922b2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:36.949822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e22256-fc42-4007-94e1-ac429f8922b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:36.950109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e22256-fc42-4007-94e1-ac429f8922b2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:36.960400 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e22256-fc42-4007-94e1-ac429f8922b2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:36.962841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e22256-fc42-4007-94e1-ac429f8922b2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-20e22256-fc42-4007-94e1-ac429f8922b2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:19:36.985907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:36.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:36.989052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:36.989052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:36.989052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:19:36.989052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:19:36.989052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:19:36.989052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:19:36.989052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:19:36.989052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:19:36.989052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:19:36.989052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:19:36.989052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 623/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:36.996866 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d1d18-0791-49a8-b498-1a2122f7763d None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:37.133179 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d1d18-0791-49a8-b498-1a2122f7763d None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:37.171939 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd095f6-ec53-4b9d-87a4-c9abec438a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:37.172614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd095f6-ec53-4b9d-87a4-c9abec438a6a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:37.172895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd095f6-ec53-4b9d-87a4-c9abec438a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:37.174985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd095f6-ec53-4b9d-87a4-c9abec438a6a None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:37.174985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd095f6-ec53-4b9d-87a4-c9abec438a6a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:37.174985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd095f6-ec53-4b9d-87a4-c9abec438a6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:37.177199 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd095f6-ec53-4b9d-87a4-c9abec438a6a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:37.198721 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 590/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jul 21 22:19:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:37.204847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e22256-fc42-4007-94e1-ac429f8922b2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:37.330816 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e22256-fc42-4007-94e1-ac429f8922b2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:37.368724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969fa45-7071-4cdc-8dc0-e3d8e8a21c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:37.369428 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969fa45-7071-4cdc-8dc0-e3d8e8a21c87 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:37.369711 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969fa45-7071-4cdc-8dc0-e3d8e8a21c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:37.369987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969fa45-7071-4cdc-8dc0-e3d8e8a21c87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:37.410273 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:37.453930 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969fa45-7071-4cdc-8dc0-e3d8e8a21c87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:37.455486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969fa45-7071-4cdc-8dc0-e3d8e8a21c87 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:37.566595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 624/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:19:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:19:37.572542 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd095f6-ec53-4b9d-87a4-c9abec438a6a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:37.596078 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:37.694942 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd095f6-ec53-4b9d-87a4-c9abec438a6a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:37.738236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cc215-a8c7-4183-81ad-0004136f0642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:37.739182 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cc215-a8c7-4183-81ad-0004136f0642 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:37.740352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cc215-a8c7-4183-81ad-0004136f0642 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:37.740352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cc215-a8c7-4183-81ad-0004136f0642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:37.753792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cc215-a8c7-4183-81ad-0004136f0642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:37.755258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cc215-a8c7-4183-81ad-0004136f0642 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:37.775722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-f42cc215-a8c7-4183-81ad-0004136f0642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:37.775722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:37.775722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:37.775722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:37.775722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:37.775722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:37.775722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:37.775722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:37.775722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:37.775722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:37.775722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:37.775722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:37.775722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:19:37.775722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:19:37.775722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:37.777168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:37.778172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:19:37.778172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:19:37.778172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:37.778172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:37.778172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 591/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:37.782952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969fa45-7071-4cdc-8dc0-e3d8e8a21c87 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:37.861628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:37.918332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969fa45-7071-4cdc-8dc0-e3d8e8a21c87 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:37.954987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca20cea-6aaf-440e-b5fe-d5cd0e871667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:37.955733 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca20cea-6aaf-440e-b5fe-d5cd0e871667 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:37.956007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca20cea-6aaf-440e-b5fe-d5cd0e871667 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:37.956323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca20cea-6aaf-440e-b5fe-d5cd0e871667 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:37.957063 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca20cea-6aaf-440e-b5fe-d5cd0e871667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:37.957366 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca20cea-6aaf-440e-b5fe-d5cd0e871667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:37.958724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca20cea-6aaf-440e-b5fe-d5cd0e871667 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:37.971011 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 625/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:19:37.977423 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cc215-a8c7-4183-81ad-0004136f0642 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:38.062909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:38.101253 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cc215-a8c7-4183-81ad-0004136f0642 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:38.144635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988e555-5543-4cd0-aaf2-947ddbdc5aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:38.145448 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988e555-5543-4cd0-aaf2-947ddbdc5aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:38.145734 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988e555-5543-4cd0-aaf2-947ddbdc5aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:38.146005 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988e555-5543-4cd0-aaf2-947ddbdc5aa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:38.154670 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988e555-5543-4cd0-aaf2-947ddbdc5aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:38.156386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988e555-5543-4cd0-aaf2-947ddbdc5aa6 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:38.175960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-4988e555-5543-4cd0-aaf2-947ddbdc5aa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:19:38.175960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:38.175960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:38.175960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:38.175960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:38.175960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:38.175960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:38.175960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:38.175960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:38.175960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:38.175960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:38.175960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:38.175960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:19:38.175960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:19:38.175960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:38.177145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:38.178066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:19:38.178066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:19:38.178066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:19:38.178066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:19:38.178066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:19:38.178066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:19:38.178066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:19:38.178066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:38.182197 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 592/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:19:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:19:38.183408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca20cea-6aaf-440e-b5fe-d5cd0e871667 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:38.289417 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca20cea-6aaf-440e-b5fe-d5cd0e871667 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:38.317169 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:38.331442 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4b8ee-73a8-44d7-8b87-dfdb6948e3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:38.332234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4b8ee-73a8-44d7-8b87-dfdb6948e3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:38.332548 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4b8ee-73a8-44d7-8b87-dfdb6948e3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:38.332810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4b8ee-73a8-44d7-8b87-dfdb6948e3e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:38.333860 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4b8ee-73a8-44d7-8b87-dfdb6948e3e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:38.334162 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4b8ee-73a8-44d7-8b87-dfdb6948e3e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:38.335829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4b8ee-73a8-44d7-8b87-dfdb6948e3e3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:38.354082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 626/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:19:38.355384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988e555-5543-4cd0-aaf2-947ddbdc5aa6 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:38.471223 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988e555-5543-4cd0-aaf2-947ddbdc5aa6 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:38.504769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:38.512065 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cde40c-7884-40f5-a3ee-302f894b7d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:38.513200 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cde40c-7884-40f5-a3ee-302f894b7d2b None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:38.513867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cde40c-7884-40f5-a3ee-302f894b7d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:38.514563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cde40c-7884-40f5-a3ee-302f894b7d2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:38.515527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cde40c-7884-40f5-a3ee-302f894b7d2b None admin] RBAC: Adding query filter params (role.id=21cd8dfe95a341df92f26899aaae6604, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=5ba75bf6ef954eb59d8db1efa6c73d8c) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:38.515949 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cde40c-7884-40f5-a3ee-302f894b7d2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:38.517527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cde40c-7884-40f5-a3ee-302f894b7d2b None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:38.524287 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 593/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:19:38 2022] GET /identity/v3/role_assignments?user.id=5ba75bf6ef954eb59d8db1efa6c73d8c&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=21cd8dfe95a341df92f26899aaae6604 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:40.700101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df99705-276c-4000-b7df-d080f5e301f0 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:40.700654 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df99705-276c-4000-b7df-d080f5e301f0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:40.700765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df99705-276c-4000-b7df-d080f5e301f0 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:40.702700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 627/1220] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:19:40.708551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d31952-df16-44c3-a67c-68dbaa7da3a3 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:40.709189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d31952-df16-44c3-a67c-68dbaa7da3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:40.709189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d31952-df16-44c3-a67c-68dbaa7da3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:40.725963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-c5d31952-df16-44c3-a67c-68dbaa7da3a3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:19:40.727151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c5d31952-df16-44c3-a67c-68dbaa7da3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:19:40.795513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 594/1221] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:19:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:19:40.819208 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df99705-276c-4000-b7df-d080f5e301f0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:40.933441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df99705-276c-4000-b7df-d080f5e301f0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:40.970896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eeaffb-02c9-4777-8fd8-fdd6d6f3028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:40.971621 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eeaffb-02c9-4777-8fd8-fdd6d6f3028d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:40.971953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eeaffb-02c9-4777-8fd8-fdd6d6f3028d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:40.972244 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eeaffb-02c9-4777-8fd8-fdd6d6f3028d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:40.986205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eeaffb-02c9-4777-8fd8-fdd6d6f3028d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-f1eeaffb-02c9-4777-8fd8-fdd6d6f3028d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:19:40.993922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:40.995081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:40.996027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:40.996027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:40.996027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:40.996027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:40.996027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:19:40.996027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:19:40.996027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:19:40.996027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:19:40.996027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:19:40.996027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:19:40.996027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:19:40.996027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:19:40.996027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 628/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:19:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:41.001373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d31952-df16-44c3-a67c-68dbaa7da3a3 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:41.106167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d31952-df16-44c3-a67c-68dbaa7da3a3 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:41.132615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:41.144375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce0c5d-80a7-4d83-b342-45c9931d072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:41.145075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce0c5d-80a7-4d83-b342-45c9931d072e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:41.145359 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce0c5d-80a7-4d83-b342-45c9931d072e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:41.145636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce0c5d-80a7-4d83-b342-45c9931d072e None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:41.146452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce0c5d-80a7-4d83-b342-45c9931d072e None admin] RBAC: Adding query filter params (name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:41.146846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce0c5d-80a7-4d83-b342-45c9931d072e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:41.148304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce0c5d-80a7-4d83-b342-45c9931d072e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:41.159856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 595/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:19:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:41.165953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eeaffb-02c9-4777-8fd8-fdd6d6f3028d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:41.212343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:41.273917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eeaffb-02c9-4777-8fd8-fdd6d6f3028d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:41.309530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e2778-7e23-4146-b902-2a64e51be53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:41.310352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e2778-7e23-4146-b902-2a64e51be53f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:41.310614 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e2778-7e23-4146-b902-2a64e51be53f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:41.310892 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e2778-7e23-4146-b902-2a64e51be53f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:41.324767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e2778-7e23-4146-b902-2a64e51be53f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:41.326320 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e2778-7e23-4146-b902-2a64e51be53f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:41.343868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c04e2778-7e23-4146-b902-2a64e51be53f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:41.343868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:41.343868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:41.343868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:41.343868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:41.343868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:41.343868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:41.343868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:41.343868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:41.343868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:41.343868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:41.343868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:41.343868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:19:41.343868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:19:41.343868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:41.344960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:41.345905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:19:41.345905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:19:41.345905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:41.345905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:19:41.345905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 629/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:41.351251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce0c5d-80a7-4d83-b342-45c9931d072e None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:41.455580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce0c5d-80a7-4d83-b342-45c9931d072e None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:41.490983 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beef8b1-50d0-44d8-b851-baee03bead05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:41.491649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beef8b1-50d0-44d8-b851-baee03bead05 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:41.491932 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beef8b1-50d0-44d8-b851-baee03bead05 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:41.492206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beef8b1-50d0-44d8-b851-baee03bead05 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:41.492955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beef8b1-50d0-44d8-b851-baee03bead05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:41.493270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beef8b1-50d0-44d8-b851-baee03bead05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:41.494681 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beef8b1-50d0-44d8-b851-baee03bead05 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:41.507943 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 596/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:19:41.514011 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e2778-7e23-4146-b902-2a64e51be53f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:41.614476 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:41.622125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e2778-7e23-4146-b902-2a64e51be53f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:41.667804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccb99f-709e-45e3-949e-e439c6b5635a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:41.668836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccb99f-709e-45e3-949e-e439c6b5635a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:41.669263 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccb99f-709e-45e3-949e-e439c6b5635a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:41.669545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccb99f-709e-45e3-949e-e439c6b5635a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:41.680389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccb99f-709e-45e3-949e-e439c6b5635a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:41.682174 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccb99f-709e-45e3-949e-e439c6b5635a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-49ccb99f-709e-45e3-949e-e439c6b5635a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:19:41.699918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:41.706533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:41.707687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:41.707687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:41.707687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:19:41.707687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:19:41.707687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:19:41.707687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:19:41.707687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:19:41.707687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:19:41.707687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:19:41.707687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:19:41.707687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 630/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:41.708309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beef8b1-50d0-44d8-b851-baee03bead05 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:41.758170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:41.819426 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beef8b1-50d0-44d8-b851-baee03bead05 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:41.861998 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c57034-0857-4c85-ab3a-b15568fe09f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:41.862815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c57034-0857-4c85-ab3a-b15568fe09f1 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:41.863104 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c57034-0857-4c85-ab3a-b15568fe09f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:41.863404 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c57034-0857-4c85-ab3a-b15568fe09f1 None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:41.864452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c57034-0857-4c85-ab3a-b15568fe09f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:41.864827 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c57034-0857-4c85-ab3a-b15568fe09f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:41.866536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c57034-0857-4c85-ab3a-b15568fe09f1 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:41.885763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 597/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jul 21 22:19:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:41.891599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccb99f-709e-45e3-949e-e439c6b5635a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:41.999510 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccb99f-709e-45e3-949e-e439c6b5635a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:42.035069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642506f0-3400-43d5-9bbe-bdb37d502b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:42.035911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642506f0-3400-43d5-9bbe-bdb37d502b1f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:42.036193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642506f0-3400-43d5-9bbe-bdb37d502b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:42.036462 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642506f0-3400-43d5-9bbe-bdb37d502b1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:42.046942 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642506f0-3400-43d5-9bbe-bdb37d502b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:42.048400 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642506f0-3400-43d5-9bbe-bdb37d502b1f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:42.066874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-642506f0-3400-43d5-9bbe-bdb37d502b1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:42.066874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:42.066874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:42.066874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:42.066874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:42.066874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:42.066874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:42.066874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:42.066874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:42.066874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:42.066874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:42.066874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:42.066874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:19:42.066874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:19:42.066874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:42.072844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:42.073810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:19:42.073810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:19:42.073810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:42.073810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:19:42.073810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 631/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:42.074584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c57034-0857-4c85-ab3a-b15568fe09f1 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:42.192720 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c57034-0857-4c85-ab3a-b15568fe09f1 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:42.195161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:42.232377 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c40951-5b25-4895-9e54-2f0ea2b066cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:42.233273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c40951-5b25-4895-9e54-2f0ea2b066cd None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:42.233564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c40951-5b25-4895-9e54-2f0ea2b066cd None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:42.233938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c40951-5b25-4895-9e54-2f0ea2b066cd None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:42.234790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c40951-5b25-4895-9e54-2f0ea2b066cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:42.235186 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c40951-5b25-4895-9e54-2f0ea2b066cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:42.236795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c40951-5b25-4895-9e54-2f0ea2b066cd None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:42.249151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 598/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:42.255315 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642506f0-3400-43d5-9bbe-bdb37d502b1f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:42.264339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:42.370373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642506f0-3400-43d5-9bbe-bdb37d502b1f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:42.417163 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240202f-2936-4d8f-8dda-e2905a4b5845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:42.418238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240202f-2936-4d8f-8dda-e2905a4b5845 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:42.418557 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240202f-2936-4d8f-8dda-e2905a4b5845 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:42.419014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240202f-2936-4d8f-8dda-e2905a4b5845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:42.427719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240202f-2936-4d8f-8dda-e2905a4b5845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:42.429548 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240202f-2936-4d8f-8dda-e2905a4b5845 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:42.445166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-0240202f-2936-4d8f-8dda-e2905a4b5845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:19:42.445166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:42.445166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:42.445166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:42.445166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:42.445166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:42.445166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:42.445166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:42.445166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:42.445166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:42.445166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:42.445166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:42.445166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:19:42.445166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:19:42.445166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:42.446079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:42.447183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:19:42.447183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:19:42.447183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:19:42.447183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:19:42.447183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:19:42.447183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:19:42.447183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:19:42.447183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:19:42.447183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 632/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:19:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:42.452823 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c40951-5b25-4895-9e54-2f0ea2b066cd None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:42.566085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c40951-5b25-4895-9e54-2f0ea2b066cd None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:42.609047 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116fcfe-1885-4743-9f0a-111be702c1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:42.609714 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116fcfe-1885-4743-9f0a-111be702c1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:42.609996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116fcfe-1885-4743-9f0a-111be702c1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:42.610270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116fcfe-1885-4743-9f0a-111be702c1b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:42.611119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116fcfe-1885-4743-9f0a-111be702c1b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:42.611354 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116fcfe-1885-4743-9f0a-111be702c1b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:42.613673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116fcfe-1885-4743-9f0a-111be702c1b6 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:42.629467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 599/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:19:42.637231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240202f-2936-4d8f-8dda-e2905a4b5845 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:42.718059 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:42.754775 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240202f-2936-4d8f-8dda-e2905a4b5845 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:42.793183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab823d2-f2d4-4761-bb57-428403dc24a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:42.794077 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab823d2-f2d4-4761-bb57-428403dc24a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:42.794363 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab823d2-f2d4-4761-bb57-428403dc24a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:42.794646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab823d2-f2d4-4761-bb57-428403dc24a0 None admin] PATH_INFO: `/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/5ba75bf6ef954eb59d8db1efa6c73d8c/roles/21cd8dfe95a341df92f26899aaae6604` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:42.811798 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab823d2-f2d4-4761-bb57-428403dc24a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e77f9cc1c14e35b1d3e1874f107494, user_id=5ba75bf6ef954eb59d8db1efa6c73d8c, role_id=21cd8dfe95a341df92f26899aaae6604)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:42.813863 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab823d2-f2d4-4761-bb57-428403dc24a0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:42.828178 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 633/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:19:42 2022] PUT /identity/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/5ba75bf6ef954eb59d8db1efa6c73d8c/roles/21cd8dfe95a341df92f26899aaae6604 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:19:45.060253 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202af107-e8ae-45be-ad08-9c323dacd0c4 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:45.060805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202af107-e8ae-45be-ad08-9c323dacd0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:45.060805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202af107-e8ae-45be-ad08-9c323dacd0c4 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:45.062203 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 600/1233] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:19:45.068766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc355f2-4b4b-4034-9b40-e966c7fa9630 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:45.069329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc355f2-4b4b-4034-9b40-e966c7fa9630 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:45.069419 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc355f2-4b4b-4034-9b40-e966c7fa9630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:45.086809 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5bc355f2-4b4b-4034-9b40-e966c7fa9630 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:19:45.087995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5bc355f2-4b4b-4034-9b40-e966c7fa9630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:19:45.164645 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 634/1234] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:19:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:19:45.189602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202af107-e8ae-45be-ad08-9c323dacd0c4 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:45.218456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:45.300228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202af107-e8ae-45be-ad08-9c323dacd0c4 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:45.337296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6305b-2423-4739-b158-c54a384b865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:45.338140 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6305b-2423-4739-b158-c54a384b865f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:45.338392 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6305b-2423-4739-b158-c54a384b865f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:45.338730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6305b-2423-4739-b158-c54a384b865f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:45.349538 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6305b-2423-4739-b158-c54a384b865f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-e7c6305b-2423-4739-b158-c54a384b865f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:19:45.357930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:45.359028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:45.359878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:45.359878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:45.359878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:45.359878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:45.359878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:19:45.359878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:19:45.359878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:19:45.359878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:19:45.359878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:19:45.359878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:19:45.359878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 22:19:45.359878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:45.359878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 601/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jul 21 22:19:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:45.365542 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc355f2-4b4b-4034-9b40-e966c7fa9630 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:45.417042 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:45.475800 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc355f2-4b4b-4034-9b40-e966c7fa9630 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:45.512590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9914b-a559-49d6-af94-71651c101ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:45.513567 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9914b-a559-49d6-af94-71651c101ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:45.513969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9914b-a559-49d6-af94-71651c101ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:45.514296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9914b-a559-49d6-af94-71651c101ed5 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:45.515104 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9914b-a559-49d6-af94-71651c101ed5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:45.515417 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9914b-a559-49d6-af94-71651c101ed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:45.516791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9914b-a559-49d6-af94-71651c101ed5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:45.525770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 635/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jul 21 22:19:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:45.532028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6305b-2423-4739-b158-c54a384b865f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:45.624339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:45.642251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6305b-2423-4739-b158-c54a384b865f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:45.683272 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91e69a-bfa4-4c93-b386-fee3135dac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:45.684144 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91e69a-bfa4-4c93-b386-fee3135dac07 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:45.684411 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91e69a-bfa4-4c93-b386-fee3135dac07 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:45.684697 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91e69a-bfa4-4c93-b386-fee3135dac07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:45.695745 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91e69a-bfa4-4c93-b386-fee3135dac07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:45.697250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91e69a-bfa4-4c93-b386-fee3135dac07 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:45.716600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-fe91e69a-bfa4-4c93-b386-fee3135dac07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:45.716600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:45.716600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:45.716600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:45.716600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:45.716600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:45.716600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:45.716600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:45.716600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:45.716600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:45.716600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:45.716600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:45.716600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:19:45.716600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:19:45.716600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:45.717756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:45.718818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:19:45.718818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:19:45.718818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:45.718818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:45.718818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 602/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:19:45.724269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9914b-a559-49d6-af94-71651c101ed5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:45.830642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9914b-a559-49d6-af94-71651c101ed5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:45.841240 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:45.870559 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dac89-ac40-436e-93ea-a1999dd0881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:45.871291 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dac89-ac40-436e-93ea-a1999dd0881b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:45.871596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dac89-ac40-436e-93ea-a1999dd0881b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:45.871901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dac89-ac40-436e-93ea-a1999dd0881b None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:45.872712 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dac89-ac40-436e-93ea-a1999dd0881b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:45.873095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dac89-ac40-436e-93ea-a1999dd0881b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:45.874681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dac89-ac40-436e-93ea-a1999dd0881b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:45.888578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 636/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:45.895411 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91e69a-bfa4-4c93-b386-fee3135dac07 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:46.010474 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91e69a-bfa4-4c93-b386-fee3135dac07 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:46.047616 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ca4d9-910c-48d9-9973-ac652a2a1d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:46.048511 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ca4d9-910c-48d9-9973-ac652a2a1d10 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:46.048811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ca4d9-910c-48d9-9973-ac652a2a1d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:46.049118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ca4d9-910c-48d9-9973-ac652a2a1d10 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:46.052388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:46.061860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ca4d9-910c-48d9-9973-ac652a2a1d10 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:46.063977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ca4d9-910c-48d9-9973-ac652a2a1d10 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-338ca4d9-910c-48d9-9973-ac652a2a1d10 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:19:46.079860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:46.081498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:46.082452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:46.082452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:46.082452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:19:46.082452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:19:46.082452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:19:46.082452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:19:46.082452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:19:46.082452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:19:46.082452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:19:46.082452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:46.082452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 603/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:46.087799 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dac89-ac40-436e-93ea-a1999dd0881b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:46.192424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dac89-ac40-436e-93ea-a1999dd0881b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:46.227327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a74cfb-a7a1-4d5d-bf0a-f0fe6f9cc49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:46.227998 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a74cfb-a7a1-4d5d-bf0a-f0fe6f9cc49e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:46.228284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a74cfb-a7a1-4d5d-bf0a-f0fe6f9cc49e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:46.228564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a74cfb-a7a1-4d5d-bf0a-f0fe6f9cc49e None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:46.229441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a74cfb-a7a1-4d5d-bf0a-f0fe6f9cc49e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:46.229756 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a74cfb-a7a1-4d5d-bf0a-f0fe6f9cc49e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:46.231182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a74cfb-a7a1-4d5d-bf0a-f0fe6f9cc49e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:46.249201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 637/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jul 21 22:19:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:46.255600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ca4d9-910c-48d9-9973-ac652a2a1d10 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:46.367782 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ca4d9-910c-48d9-9973-ac652a2a1d10 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:46.408162 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a4bbf-62fe-43f2-a863-755d4ad512d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:46.409098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a4bbf-62fe-43f2-a863-755d4ad512d1 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:46.409451 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a4bbf-62fe-43f2-a863-755d4ad512d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:46.409818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a4bbf-62fe-43f2-a863-755d4ad512d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:46.482246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:46.489233 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a4bbf-62fe-43f2-a863-755d4ad512d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:46.490802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a4bbf-62fe-43f2-a863-755d4ad512d1 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:46.603017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 604/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:19:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:19:46.609724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a74cfb-a7a1-4d5d-bf0a-f0fe6f9cc49e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:46.643310 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:46.723709 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a74cfb-a7a1-4d5d-bf0a-f0fe6f9cc49e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:46.760394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc1c69-adbf-4ae0-ac1b-1a4a743ab538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:46.761383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc1c69-adbf-4ae0-ac1b-1a4a743ab538 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:46.761797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc1c69-adbf-4ae0-ac1b-1a4a743ab538 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:46.762084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc1c69-adbf-4ae0-ac1b-1a4a743ab538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:46.773011 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc1c69-adbf-4ae0-ac1b-1a4a743ab538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:46.774475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc1c69-adbf-4ae0-ac1b-1a4a743ab538 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:46.797751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1cfc1c69-adbf-4ae0-ac1b-1a4a743ab538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:46.797751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:46.797751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:46.797751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:46.797751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:46.797751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:46.797751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:46.797751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:46.797751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:46.797751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:46.797751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:46.797751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:46.797751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:19:46.797751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:19:46.797751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:46.798906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:46.804883 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:19:46.804883 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:19:46.804883 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:46.804883 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:19:46.804883 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 638/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:46.805278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a4bbf-62fe-43f2-a863-755d4ad512d1 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:46.920185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:46.927024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a4bbf-62fe-43f2-a863-755d4ad512d1 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:46.964583 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683a508-9f13-4e56-9cac-7886a1642a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:46.965518 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683a508-9f13-4e56-9cac-7886a1642a49 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:46.965805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683a508-9f13-4e56-9cac-7886a1642a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:46.966212 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683a508-9f13-4e56-9cac-7886a1642a49 None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:46.967055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683a508-9f13-4e56-9cac-7886a1642a49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:46.967367 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683a508-9f13-4e56-9cac-7886a1642a49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:46.968745 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683a508-9f13-4e56-9cac-7886a1642a49 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:46.983277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 605/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:46.991342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc1c69-adbf-4ae0-ac1b-1a4a743ab538 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:47.082586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:47.107072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc1c69-adbf-4ae0-ac1b-1a4a743ab538 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:47.144197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4cb78-58e7-44d7-8b4c-29cc9c21e73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:47.145048 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4cb78-58e7-44d7-8b4c-29cc9c21e73a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:47.145324 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4cb78-58e7-44d7-8b4c-29cc9c21e73a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:47.145600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4cb78-58e7-44d7-8b4c-29cc9c21e73a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:47.152994 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4cb78-58e7-44d7-8b4c-29cc9c21e73a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:47.154484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4cb78-58e7-44d7-8b4c-29cc9c21e73a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:47.169259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-5ae4cb78-58e7-44d7-8b4c-29cc9c21e73a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:19:47.169259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:47.169259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:47.169259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:47.169259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:47.169259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:47.169259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:47.169259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:47.169259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:47.169259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:47.169259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:47.169259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:47.169259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:19:47.169259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:19:47.169259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:47.170338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:47.171356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:19:47.171356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:19:47.171356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:19:47.171356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:19:47.171356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:19:47.171356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:19:47.171356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:19:47.171356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:19:47.171356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 639/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:19:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:47.177327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683a508-9f13-4e56-9cac-7886a1642a49 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:47.285172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683a508-9f13-4e56-9cac-7886a1642a49 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:47.321474 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2f9cb-3494-4647-814d-856a0b33184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:47.322142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2f9cb-3494-4647-814d-856a0b33184e None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:47.322429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2f9cb-3494-4647-814d-856a0b33184e None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:47.322708 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2f9cb-3494-4647-814d-856a0b33184e None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:47.323514 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2f9cb-3494-4647-814d-856a0b33184e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:47.323868 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2f9cb-3494-4647-814d-856a0b33184e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:47.325530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2f9cb-3494-4647-814d-856a0b33184e None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:47.339889 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 606/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:47.346136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4cb78-58e7-44d7-8b4c-29cc9c21e73a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:47.462241 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4cb78-58e7-44d7-8b4c-29cc9c21e73a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:47.498577 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd28ff5-35c9-4977-b2f4-434bc5c775c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:47.499288 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd28ff5-35c9-4977-b2f4-434bc5c775c4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:47.499595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd28ff5-35c9-4977-b2f4-434bc5c775c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:47.499894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd28ff5-35c9-4977-b2f4-434bc5c775c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:47.500766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd28ff5-35c9-4977-b2f4-434bc5c775c4 None admin] RBAC: Adding query filter params (role.id=21cd8dfe95a341df92f26899aaae6604, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=5ba75bf6ef954eb59d8db1efa6c73d8c) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:47.501113 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd28ff5-35c9-4977-b2f4-434bc5c775c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:47.503140 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd28ff5-35c9-4977-b2f4-434bc5c775c4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:47.508961 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 640/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:19:47 2022] GET /identity/v3/role_assignments?user.id=5ba75bf6ef954eb59d8db1efa6c73d8c&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=21cd8dfe95a341df92f26899aaae6604 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:19:49.701276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dd7f1-31d4-4681-9bde-c227ab365b11 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:49.701841 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dd7f1-31d4-4681-9bde-c227ab365b11 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:49.702242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dd7f1-31d4-4681-9bde-c227ab365b11 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:49.704758 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 607/1247] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:19:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:19:49.711279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db9949-7a77-4040-842f-72ef8083e813 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:49.711798 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db9949-7a77-4040-842f-72ef8083e813 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:49.711889 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db9949-7a77-4040-842f-72ef8083e813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:49.717182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:49.730790 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f7db9949-7a77-4040-842f-72ef8083e813 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:19:49.732086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f7db9949-7a77-4040-842f-72ef8083e813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:19:49.804596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 641/1248] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:19:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:19:49.833165 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dd7f1-31d4-4681-9bde-c227ab365b11 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:49.855116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:49.964412 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dd7f1-31d4-4681-9bde-c227ab365b11 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:50.002456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf85321-92bd-4645-a800-8a6945c8b83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:50.003740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf85321-92bd-4645-a800-8a6945c8b83b None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:50.004022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf85321-92bd-4645-a800-8a6945c8b83b None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:50.004305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf85321-92bd-4645-a800-8a6945c8b83b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:50.014903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf85321-92bd-4645-a800-8a6945c8b83b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-fcf85321-92bd-4645-a800-8a6945c8b83b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:19:50.024023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:50.025014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:50.026322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:50.026322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:50.026322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:50.026322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:50.026322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:19:50.026322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:19:50.026322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:19:50.026322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:19:50.026322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:19:50.026322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:19:50.026322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:19:50.026322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:50.026322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 608/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:19:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:50.031867 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db9949-7a77-4040-842f-72ef8083e813 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:50.148414 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db9949-7a77-4040-842f-72ef8083e813 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:50.181411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:50.187322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293beee-812b-4046-a1f7-ac131bb9d784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:50.188006 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293beee-812b-4046-a1f7-ac131bb9d784 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:50.188295 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293beee-812b-4046-a1f7-ac131bb9d784 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:50.188634 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293beee-812b-4046-a1f7-ac131bb9d784 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:50.189391 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293beee-812b-4046-a1f7-ac131bb9d784 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:50.189715 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293beee-812b-4046-a1f7-ac131bb9d784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:50.191228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293beee-812b-4046-a1f7-ac131bb9d784 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:50.206110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 642/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:19:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:50.207731 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf85321-92bd-4645-a800-8a6945c8b83b None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:50.295440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:50.319100 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf85321-92bd-4645-a800-8a6945c8b83b None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:50.358734 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754fc76-d138-4571-9058-8597646bd1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:50.359660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754fc76-d138-4571-9058-8597646bd1cb None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:50.360052 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754fc76-d138-4571-9058-8597646bd1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:50.360420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754fc76-d138-4571-9058-8597646bd1cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:50.372764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754fc76-d138-4571-9058-8597646bd1cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:50.374265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754fc76-d138-4571-9058-8597646bd1cb None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:50.392339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-5754fc76-d138-4571-9058-8597646bd1cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:50.392339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:50.392339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:50.392339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:50.392339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:50.392339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:50.392339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:50.392339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:50.392339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:50.392339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:50.392339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:50.392339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:50.392339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:19:50.392339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:19:50.392339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:50.394093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:50.395289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:19:50.395289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:19:50.395289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:50.395289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:50.395289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 609/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:50.401835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293beee-812b-4046-a1f7-ac131bb9d784 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:50.515109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293beee-812b-4046-a1f7-ac131bb9d784 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:50.548994 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6f117-18ff-4d37-a038-26ae772f6278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:50.549641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6f117-18ff-4d37-a038-26ae772f6278 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:50.549924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6f117-18ff-4d37-a038-26ae772f6278 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:50.550182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6f117-18ff-4d37-a038-26ae772f6278 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:50.550890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6f117-18ff-4d37-a038-26ae772f6278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:50.551201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6f117-18ff-4d37-a038-26ae772f6278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:50.552545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6f117-18ff-4d37-a038-26ae772f6278 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:50.564644 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 643/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:50.570940 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754fc76-d138-4571-9058-8597646bd1cb None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:50.683755 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754fc76-d138-4571-9058-8597646bd1cb None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:50.713002 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:50.722627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737821e5-5977-4038-94f0-3b5f23a83198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:50.723433 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737821e5-5977-4038-94f0-3b5f23a83198 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:50.723713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737821e5-5977-4038-94f0-3b5f23a83198 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:50.723996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737821e5-5977-4038-94f0-3b5f23a83198 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:50.731478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737821e5-5977-4038-94f0-3b5f23a83198 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:50.732903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737821e5-5977-4038-94f0-3b5f23a83198 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-737821e5-5977-4038-94f0-3b5f23a83198 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:19:50.747436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:50.748399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:50.749387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:50.749387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:50.749387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:19:50.749387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:19:50.749387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:19:50.749387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:19:50.749387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:19:50.749387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:19:50.749387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:19:50.749387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:50.749387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 610/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:50.754608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6f117-18ff-4d37-a038-26ae772f6278 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:50.814337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:50.863478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6f117-18ff-4d37-a038-26ae772f6278 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:50.907383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13100e-a977-4fa7-81d8-fb1606175cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:50.908212 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13100e-a977-4fa7-81d8-fb1606175cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:50.908524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13100e-a977-4fa7-81d8-fb1606175cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:50.908787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13100e-a977-4fa7-81d8-fb1606175cc3 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:50.910360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13100e-a977-4fa7-81d8-fb1606175cc3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:50.910681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13100e-a977-4fa7-81d8-fb1606175cc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:50.912097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13100e-a977-4fa7-81d8-fb1606175cc3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:50.929759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 644/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jul 21 22:19:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:50.936095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737821e5-5977-4038-94f0-3b5f23a83198 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:51.044309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737821e5-5977-4038-94f0-3b5f23a83198 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:51.080006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80596b-ef8d-4f2b-9192-93a392a95053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:51.081116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80596b-ef8d-4f2b-9192-93a392a95053 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:51.081404 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80596b-ef8d-4f2b-9192-93a392a95053 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:51.081680 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80596b-ef8d-4f2b-9192-93a392a95053 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:51.140439 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:51.156483 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80596b-ef8d-4f2b-9192-93a392a95053 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:51.158005 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80596b-ef8d-4f2b-9192-93a392a95053 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:51.266708 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 611/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:19:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:19:51.273699 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13100e-a977-4fa7-81d8-fb1606175cc3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:51.375567 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13100e-a977-4fa7-81d8-fb1606175cc3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:51.391919 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:51.415117 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d510d-cbd8-48ec-b42e-ebee50ee8694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:51.415903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d510d-cbd8-48ec-b42e-ebee50ee8694 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:51.416186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d510d-cbd8-48ec-b42e-ebee50ee8694 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:51.416491 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d510d-cbd8-48ec-b42e-ebee50ee8694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:51.427875 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d510d-cbd8-48ec-b42e-ebee50ee8694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:51.429340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d510d-cbd8-48ec-b42e-ebee50ee8694 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:51.446484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ec3d510d-cbd8-48ec-b42e-ebee50ee8694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:51.446484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:51.446484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:51.446484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:51.446484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:51.446484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:51.446484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:51.446484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:51.446484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:51.446484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:51.446484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:51.446484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:51.446484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:19:51.446484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:19:51.446484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:51.447576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:51.448588 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:19:51.448588 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:19:51.448588 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:51.448588 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:19:51.448588 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 645/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:51.454133 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80596b-ef8d-4f2b-9192-93a392a95053 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:51.555398 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:51.568996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80596b-ef8d-4f2b-9192-93a392a95053 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:51.607336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5d699-5ae8-4314-98ad-83276780401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:51.608377 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5d699-5ae8-4314-98ad-83276780401f None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:51.608900 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5d699-5ae8-4314-98ad-83276780401f None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:51.609326 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5d699-5ae8-4314-98ad-83276780401f None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:51.610624 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5d699-5ae8-4314-98ad-83276780401f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:51.611178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5d699-5ae8-4314-98ad-83276780401f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:51.613118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5d699-5ae8-4314-98ad-83276780401f None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:51.625232 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 612/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:51.632371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d510d-cbd8-48ec-b42e-ebee50ee8694 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:51.746787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d510d-cbd8-48ec-b42e-ebee50ee8694 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:51.787410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd62fe-96f5-4016-8553-4ae816a3c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:51.788613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd62fe-96f5-4016-8553-4ae816a3c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:51.789004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd62fe-96f5-4016-8553-4ae816a3c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:51.789500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd62fe-96f5-4016-8553-4ae816a3c6e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:51.799739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd62fe-96f5-4016-8553-4ae816a3c6e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:51.801693 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd62fe-96f5-4016-8553-4ae816a3c6e0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:51.820759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ddbd62fe-96f5-4016-8553-4ae816a3c6e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:19:51.820759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:51.820759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:51.820759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:51.820759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:51.820759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:51.820759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:51.820759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:51.820759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:51.820759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:51.820759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:51.820759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:51.820759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:19:51.820759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:19:51.820759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:51.821862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:51.822858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:19:51.822858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:19:51.822858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:19:51.822858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:19:51.822858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:19:51.822858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:19:51.822858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:19:51.822858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:19:51.822858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 646/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:19:51.828495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5d699-5ae8-4314-98ad-83276780401f None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:51.956117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5d699-5ae8-4314-98ad-83276780401f None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:51.991660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c4be6-99d1-4142-8dcd-ecfc9b850056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:51.992335 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c4be6-99d1-4142-8dcd-ecfc9b850056 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:51.992617 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c4be6-99d1-4142-8dcd-ecfc9b850056 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:51.992894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c4be6-99d1-4142-8dcd-ecfc9b850056 None admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:51.993719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c4be6-99d1-4142-8dcd-ecfc9b850056 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:51.994033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c4be6-99d1-4142-8dcd-ecfc9b850056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:51.995473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c4be6-99d1-4142-8dcd-ecfc9b850056 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:52.008885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 613/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:19:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:19:52.015079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd62fe-96f5-4016-8553-4ae816a3c6e0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:52.042372 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:52.134218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd62fe-96f5-4016-8553-4ae816a3c6e0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:52.174145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b3edf-212f-4fa3-8977-c76b6f3c6ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:52.174858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b3edf-212f-4fa3-8977-c76b6f3c6ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:52.175139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b3edf-212f-4fa3-8977-c76b6f3c6ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:52.175417 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b3edf-212f-4fa3-8977-c76b6f3c6ee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:52.176259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b3edf-212f-4fa3-8977-c76b6f3c6ee5 None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=5ba75bf6ef954eb59d8db1efa6c73d8c) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:52.176570 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b3edf-212f-4fa3-8977-c76b6f3c6ee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:52.178073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b3edf-212f-4fa3-8977-c76b6f3c6ee5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:52.184848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 647/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:19:52 2022] GET /identity/v3/role_assignments?user.id=5ba75bf6ef954eb59d8db1efa6c73d8c&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:54.211690 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b5245-f1f5-4089-ac27-6a3db4491666 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:54.212202 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b5245-f1f5-4089-ac27-6a3db4491666 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:54.212316 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b5245-f1f5-4089-ac27-6a3db4491666 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:54.213636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 614/1261] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:19:54.218818 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ffb06-1216-4653-8d6e-ed5d606c952d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:54.219268 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ffb06-1216-4653-8d6e-ed5d606c952d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:54.219371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ffb06-1216-4653-8d6e-ed5d606c952d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:54.236331 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f24ffb06-1216-4653-8d6e-ed5d606c952d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:19:54.238206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f24ffb06-1216-4653-8d6e-ed5d606c952d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:19:54.302097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 648/1262] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:19:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:19:54.324702 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b5245-f1f5-4089-ac27-6a3db4491666 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:54.335191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:54.422322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b5245-f1f5-4089-ac27-6a3db4491666 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:54.454054 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aef78-41ff-4d12-b35f-b8e757a35920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:54.454829 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aef78-41ff-4d12-b35f-b8e757a35920 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:54.455107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aef78-41ff-4d12-b35f-b8e757a35920 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:54.455376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aef78-41ff-4d12-b35f-b8e757a35920 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:54.465101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217aef78-41ff-4d12-b35f-b8e757a35920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-217aef78-41ff-4d12-b35f-b8e757a35920 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:19:54.473311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:54.474440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:54.475462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:54.475462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:54.475462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:54.475462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:54.475462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:19:54.475462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:19:54.475462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:19:54.475462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:19:54.475462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:19:54.475462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:19:54.475462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:19:54.475462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:54.475462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 615/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:19:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:54.480322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ffb06-1216-4653-8d6e-ed5d606c952d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:54.498513 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:54.574402 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ffb06-1216-4653-8d6e-ed5d606c952d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:54.606966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a4e78-d550-4309-8ab0-9fde0658e85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:54.607550 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a4e78-d550-4309-8ab0-9fde0658e85d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:54.607829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a4e78-d550-4309-8ab0-9fde0658e85d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:54.608103 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a4e78-d550-4309-8ab0-9fde0658e85d None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:54.608830 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a4e78-d550-4309-8ab0-9fde0658e85d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:54.609166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a4e78-d550-4309-8ab0-9fde0658e85d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:54.610658 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a4e78-d550-4309-8ab0-9fde0658e85d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:54.618830 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 649/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:54.624463 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aef78-41ff-4d12-b35f-b8e757a35920 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:54.688387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:54.721895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aef78-41ff-4d12-b35f-b8e757a35920 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:54.755460 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673632a3-3327-4130-9f66-6939539b3086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:54.756240 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673632a3-3327-4130-9f66-6939539b3086 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:54.756526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673632a3-3327-4130-9f66-6939539b3086 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:54.756806 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673632a3-3327-4130-9f66-6939539b3086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:54.767049 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673632a3-3327-4130-9f66-6939539b3086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:54.768729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673632a3-3327-4130-9f66-6939539b3086 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:54.785596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-673632a3-3327-4130-9f66-6939539b3086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:54.785596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:54.785596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:54.785596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:54.785596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:54.785596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:54.785596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:54.785596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:54.785596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:54.785596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:54.785596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:54.785596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:54.785596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:19:54.785596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:19:54.785596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:54.786620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:54.787721 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:19:54.787721 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:19:54.787721 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:54.787721 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:54.787721 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 616/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:54.792776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a4e78-d550-4309-8ab0-9fde0658e85d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:54.885745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:54.906549 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a4e78-d550-4309-8ab0-9fde0658e85d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:54.939361 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80df009-a31d-4675-b33a-0014b3c3f7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:54.940636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80df009-a31d-4675-b33a-0014b3c3f7ca None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:54.940920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80df009-a31d-4675-b33a-0014b3c3f7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:54.941227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80df009-a31d-4675-b33a-0014b3c3f7ca None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:54.941937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80df009-a31d-4675-b33a-0014b3c3f7ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:54.942242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80df009-a31d-4675-b33a-0014b3c3f7ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:54.943594 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80df009-a31d-4675-b33a-0014b3c3f7ca None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:54.954751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 650/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:54.960669 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673632a3-3327-4130-9f66-6939539b3086 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:55.056286 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673632a3-3327-4130-9f66-6939539b3086 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:55.075645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:55.090049 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5164c-5421-41fa-870d-18aac1ee15cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:55.090838 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5164c-5421-41fa-870d-18aac1ee15cd None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:55.091117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5164c-5421-41fa-870d-18aac1ee15cd None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:55.091394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5164c-5421-41fa-870d-18aac1ee15cd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:55.098634 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5164c-5421-41fa-870d-18aac1ee15cd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:55.100066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5164c-5421-41fa-870d-18aac1ee15cd None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-f2f5164c-5421-41fa-870d-18aac1ee15cd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:19:55.114159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:55.115278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:55.116432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:55.116432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:55.116432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:19:55.116432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:19:55.116432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:19:55.116432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:19:55.116432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:19:55.116432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:19:55.116432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:19:55.116432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:55.116432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 617/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:55.121394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80df009-a31d-4675-b33a-0014b3c3f7ca None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:55.217177 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80df009-a31d-4675-b33a-0014b3c3f7ca None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:55.248879 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794d086-39f3-47c2-bd92-0b5376b08861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:55.249563 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794d086-39f3-47c2-bd92-0b5376b08861 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:55.249849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794d086-39f3-47c2-bd92-0b5376b08861 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:55.250130 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794d086-39f3-47c2-bd92-0b5376b08861 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:55.250957 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794d086-39f3-47c2-bd92-0b5376b08861 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:55.251269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794d086-39f3-47c2-bd92-0b5376b08861 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:55.253230 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794d086-39f3-47c2-bd92-0b5376b08861 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:55.261469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:55.270267 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 651/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jul 21 22:19:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:55.276063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5164c-5421-41fa-870d-18aac1ee15cd None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:55.371923 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5164c-5421-41fa-870d-18aac1ee15cd None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:55.403966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cb307-811f-4fa1-8ecc-51702ee68d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:55.404734 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cb307-811f-4fa1-8ecc-51702ee68d1a None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:55.405037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cb307-811f-4fa1-8ecc-51702ee68d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:55.405313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cb307-811f-4fa1-8ecc-51702ee68d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:55.415486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cb307-811f-4fa1-8ecc-51702ee68d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:55.416902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cb307-811f-4fa1-8ecc-51702ee68d1a None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:55.433757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-9f1cb307-811f-4fa1-8ecc-51702ee68d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:55.433757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:55.433757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:55.433757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:55.433757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:55.433757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:55.433757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:55.433757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:55.433757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:55.433757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:55.433757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:55.433757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:55.433757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:19:55.433757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:19:55.433757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:55.434781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:55.435878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:19:55.435878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:19:55.435878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:55.435878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:55.435878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 618/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:19:55.441033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794d086-39f3-47c2-bd92-0b5376b08861 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:55.534798 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794d086-39f3-47c2-bd92-0b5376b08861 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:55.567308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a372fa-5b89-4133-ad98-21d9184077f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:55.567946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a372fa-5b89-4133-ad98-21d9184077f9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:55.568223 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a372fa-5b89-4133-ad98-21d9184077f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:55.568496 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a372fa-5b89-4133-ad98-21d9184077f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:55.569228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a372fa-5b89-4133-ad98-21d9184077f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:55.569530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a372fa-5b89-4133-ad98-21d9184077f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:55.570874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a372fa-5b89-4133-ad98-21d9184077f9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:55.581525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 652/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:55.586802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cb307-811f-4fa1-8ecc-51702ee68d1a None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:55.617330 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:55.682161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cb307-811f-4fa1-8ecc-51702ee68d1a None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:55.713471 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7dd2f-2818-4797-9309-a48cb8e4fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:55.714240 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7dd2f-2818-4797-9309-a48cb8e4fc72 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:55.714520 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7dd2f-2818-4797-9309-a48cb8e4fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:55.714791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7dd2f-2818-4797-9309-a48cb8e4fc72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:55.721651 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7dd2f-2818-4797-9309-a48cb8e4fc72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:55.723057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7dd2f-2818-4797-9309-a48cb8e4fc72 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:55.737296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-1df7dd2f-2818-4797-9309-a48cb8e4fc72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:19:55.737296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:55.737296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:55.737296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:55.737296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:55.737296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:55.737296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:55.737296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:55.737296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:55.737296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:55.737296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:55.737296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:55.737296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:19:55.737296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:19:55.737296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:55.738329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:55.739598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:19:55.739598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:19:55.739598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:19:55.739598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:19:55.739598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:19:55.739598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:19:55.739598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:19:55.739598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:55.739598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 619/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:19:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:55.743993 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a372fa-5b89-4133-ad98-21d9184077f9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:55.800288 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:55.841908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a372fa-5b89-4133-ad98-21d9184077f9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:55.879159 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba9260-a07e-4578-b62e-fc7c87113de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:55.879810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9260-a07e-4578-b62e-fc7c87113de0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:55.880093 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9260-a07e-4578-b62e-fc7c87113de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:55.880367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9260-a07e-4578-b62e-fc7c87113de0 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:55.881182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba9260-a07e-4578-b62e-fc7c87113de0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:55.881492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba9260-a07e-4578-b62e-fc7c87113de0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:55.882915 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba9260-a07e-4578-b62e-fc7c87113de0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:55.894383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 653/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:19:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:55.900377 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7dd2f-2818-4797-9309-a48cb8e4fc72 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:55.988014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:55.996815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7dd2f-2818-4797-9309-a48cb8e4fc72 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:56.029211 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de4ae7-773b-43d5-bee9-892a88bf5102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:56.030088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de4ae7-773b-43d5-bee9-892a88bf5102 None admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:56.030376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de4ae7-773b-43d5-bee9-892a88bf5102 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:56.030656 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de4ae7-773b-43d5-bee9-892a88bf5102 None admin] PATH_INFO: `/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/5ba75bf6ef954eb59d8db1efa6c73d8c/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:56.032581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de4ae7-773b-43d5-bee9-892a88bf5102 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6e77f9cc1c14e35b1d3e1874f107494, user_id=5ba75bf6ef954eb59d8db1efa6c73d8c, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:56.034554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de4ae7-773b-43d5-bee9-892a88bf5102 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:56.046280 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 620/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jul 21 22:19:55 2022] PUT /identity/v3/projects/f6e77f9cc1c14e35b1d3e1874f107494/users/5ba75bf6ef954eb59d8db1efa6c73d8c/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:19:58.034099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a1edb-47ea-4521-b39a-e9de1a9e5c94 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:58.034626 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a1edb-47ea-4521-b39a-e9de1a9e5c94 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:58.034626 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a1edb-47ea-4521-b39a-e9de1a9e5c94 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:58.036024 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 654/1274] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:19:58.040991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a674e-12fe-48f5-92dc-f81125a1da95 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:58.041388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a674e-12fe-48f5-92dc-f81125a1da95 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:58.041555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a674e-12fe-48f5-92dc-f81125a1da95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:58.058376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-6d0a674e-12fe-48f5-92dc-f81125a1da95 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:19:58.059552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6d0a674e-12fe-48f5-92dc-f81125a1da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:19:58.123424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 621/1275] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:19:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:19:58.146595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a1edb-47ea-4521-b39a-e9de1a9e5c94 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:58.245068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a1edb-47ea-4521-b39a-e9de1a9e5c94 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:58.262236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:58.279143 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2f000-dcce-4cfb-a35d-a483faa0c18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:58.279921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2f000-dcce-4cfb-a35d-a483faa0c18a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:58.280199 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2f000-dcce-4cfb-a35d-a483faa0c18a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:58.280469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2f000-dcce-4cfb-a35d-a483faa0c18a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:58.290181 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2f000-dcce-4cfb-a35d-a483faa0c18a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a4a2f000-dcce-4cfb-a35d-a483faa0c18a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 22:19:58.297581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:58.298671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:58.300388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:58.300388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:58.300388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:58.300388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:58.300388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 22:19:58.300388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 22:19:58.300388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 22:19:58.300388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 22:19:58.300388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 22:19:58.300388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 22:19:58.300388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 22:19:58.300388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:19:58.300388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 655/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jul 21 22:19:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:58.305264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a674e-12fe-48f5-92dc-f81125a1da95 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:58.382909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:58.401117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a674e-12fe-48f5-92dc-f81125a1da95 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:58.433751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637c55b-a72d-48ca-8166-9c9062bb4783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:58.434403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c55b-a72d-48ca-8166-9c9062bb4783 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:58.434686 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c55b-a72d-48ca-8166-9c9062bb4783 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:58.434964 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c55b-a72d-48ca-8166-9c9062bb4783 None admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:58.435707 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637c55b-a72d-48ca-8166-9c9062bb4783 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:58.436012 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637c55b-a72d-48ca-8166-9c9062bb4783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:58.437429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637c55b-a72d-48ca-8166-9c9062bb4783 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:58.445128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 622/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jul 21 22:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:58.450590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2f000-dcce-4cfb-a35d-a483faa0c18a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:58.546051 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2f000-dcce-4cfb-a35d-a483faa0c18a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:58.577595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beba7e4-b742-4b76-a51a-82050164728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:58.578360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beba7e4-b742-4b76-a51a-82050164728f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:58.578641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beba7e4-b742-4b76-a51a-82050164728f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:58.578916 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beba7e4-b742-4b76-a51a-82050164728f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:58.588871 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beba7e4-b742-4b76-a51a-82050164728f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:58.590315 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beba7e4-b742-4b76-a51a-82050164728f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:58.607053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-4beba7e4-b742-4b76-a51a-82050164728f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:58.607053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:58.607053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:58.607053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:58.607053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:58.607053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:58.607053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:58.607053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:58.607053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:58.607053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:58.607053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:58.607053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:58.607053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:19:58.607053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:19:58.607053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:58.608041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:58.609166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:19:58.609166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:19:58.609166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:58.609166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:19:58.613380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 656/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:58.614478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637c55b-a72d-48ca-8166-9c9062bb4783 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:58.711898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637c55b-a72d-48ca-8166-9c9062bb4783 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:58.745151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace60bef-eb04-44ea-9080-9b801659ec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:58.745803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace60bef-eb04-44ea-9080-9b801659ec5b None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:58.746088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace60bef-eb04-44ea-9080-9b801659ec5b None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:58.746366 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace60bef-eb04-44ea-9080-9b801659ec5b None admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:58.747080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace60bef-eb04-44ea-9080-9b801659ec5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:58.747387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace60bef-eb04-44ea-9080-9b801659ec5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:58.748781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace60bef-eb04-44ea-9080-9b801659ec5b None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:58.760105 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 623/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:19:58.765667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beba7e4-b742-4b76-a51a-82050164728f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:58.796413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:58.872705 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beba7e4-b742-4b76-a51a-82050164728f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:58.905363 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0b182-54ec-4e78-b848-acc5ba2b5e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:58.906153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0b182-54ec-4e78-b848-acc5ba2b5e7d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:58.906437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0b182-54ec-4e78-b848-acc5ba2b5e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:58.906714 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0b182-54ec-4e78-b848-acc5ba2b5e7d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:58.914395 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0b182-54ec-4e78-b848-acc5ba2b5e7d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:58.915822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0b182-54ec-4e78-b848-acc5ba2b5e7d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-97e0b182-54ec-4e78-b848-acc5ba2b5e7d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 22:19:58.929672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:58.930952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:58.932371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:58.932371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:58.932371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 22:19:58.932371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 22:19:58.932371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 22:19:58.932371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 22:19:58.932371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 22:19:58.932371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 22:19:58.932371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 22:19:58.932371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:19:58.932371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 657/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:58.936601 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace60bef-eb04-44ea-9080-9b801659ec5b None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:58.940289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:59.035027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace60bef-eb04-44ea-9080-9b801659ec5b None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:59.067319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8685ec-84cf-4b14-8c21-dd0e1d23a1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:59.067927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8685ec-84cf-4b14-8c21-dd0e1d23a1af None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:59.068246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8685ec-84cf-4b14-8c21-dd0e1d23a1af None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:59.068528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8685ec-84cf-4b14-8c21-dd0e1d23a1af None admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:59.069392 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8685ec-84cf-4b14-8c21-dd0e1d23a1af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:59.069702 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8685ec-84cf-4b14-8c21-dd0e1d23a1af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:59.071129 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8685ec-84cf-4b14-8c21-dd0e1d23a1af None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:59.088438 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 624/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jul 21 22:19:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:59.094057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0b182-54ec-4e78-b848-acc5ba2b5e7d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:59.180045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:59.190225 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0b182-54ec-4e78-b848-acc5ba2b5e7d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:59.222796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3354c-c167-48d0-b025-2e153534fc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:59.223428 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3354c-c167-48d0-b025-2e153534fc99 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:59.223713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3354c-c167-48d0-b025-2e153534fc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:59.223996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3354c-c167-48d0-b025-2e153534fc99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:59.288482 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3354c-c167-48d0-b025-2e153534fc99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:59.289948 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3354c-c167-48d0-b025-2e153534fc99 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:59.373903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:59.384740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 658/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jul 21 22:19:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 22:19:59.390404 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8685ec-84cf-4b14-8c21-dd0e1d23a1af None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:59.449908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:59.487723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8685ec-84cf-4b14-8c21-dd0e1d23a1af None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:59.520254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54346dca-a675-4e12-ae19-971ea1017e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:59.521065 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54346dca-a675-4e12-ae19-971ea1017e16 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:59.521352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54346dca-a675-4e12-ae19-971ea1017e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:59.521631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54346dca-a675-4e12-ae19-971ea1017e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:59.531573 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54346dca-a675-4e12-ae19-971ea1017e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:59.533068 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54346dca-a675-4e12-ae19-971ea1017e16 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:59.550528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-54346dca-a675-4e12-ae19-971ea1017e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:59.550528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:59.550528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:59.550528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:59.550528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:59.550528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:59.550528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:59.550528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:59.550528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:59.550528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:59.550528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:59.550528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:59.550528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 22:19:59.550528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 22:19:59.550528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:59.551449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:59.552374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 22:19:59.552374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 22:19:59.552374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 22:19:59.552374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:59.552374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 625/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 22:19:59.557317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3354c-c167-48d0-b025-2e153534fc99 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:59.651094 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3354c-c167-48d0-b025-2e153534fc99 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:59.683528 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4c0fd-b243-40a1-9c05-668de994eb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:59.684176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4c0fd-b243-40a1-9c05-668de994eb1b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:59.684459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4c0fd-b243-40a1-9c05-668de994eb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:59.684734 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4c0fd-b243-40a1-9c05-668de994eb1b None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:59.685484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4c0fd-b243-40a1-9c05-668de994eb1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:19:59.685794 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4c0fd-b243-40a1-9c05-668de994eb1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:59.687146 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4c0fd-b243-40a1-9c05-668de994eb1b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:59.698681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 659/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jul 21 22:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:19:59.704075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54346dca-a675-4e12-ae19-971ea1017e16 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:59.799662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54346dca-a675-4e12-ae19-971ea1017e16 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:19:59.812883 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:59.836364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ecd75-3e0e-474d-9e45-166a6585c452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:19:59.837452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ecd75-3e0e-474d-9e45-166a6585c452 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:19:59.837895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ecd75-3e0e-474d-9e45-166a6585c452 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:19:59.838263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ecd75-3e0e-474d-9e45-166a6585c452 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:19:59.847900 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ecd75-3e0e-474d-9e45-166a6585c452 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:19:59.849925 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ecd75-3e0e-474d-9e45-166a6585c452 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:19:59.868609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application [None req-7f2ecd75-3e0e-474d-9e45-166a6585c452 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:19:59.868609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:19:59.868609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:19:59.868609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:19:59.868609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:19:59.868609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:19:59.868609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:19:59.868609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:19:59.868609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:19:59.868609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:19:59.868609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:19:59.868609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:19:59.868609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 22:19:59.868609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 22:19:59.868609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application with Lock( Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:19:59.869748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:19:59.870824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 22:19:59.870824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 22:19:59.870824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 22:19:59.870824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 22:19:59.870824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 22:19:59.870824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 22:19:59.870824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 22:19:59.870824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: ERROR keystone.server.flask.application Jul 21 22:19:59.870824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 626/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jul 21 22:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:19:59.875665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4c0fd-b243-40a1-9c05-668de994eb1b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:19:59.924895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:19:59.973210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4c0fd-b243-40a1-9c05-668de994eb1b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:20:00.005350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c4f21-de74-4d4d-8b49-c2933cb9b151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:20:00.005999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c4f21-de74-4d4d-8b49-c2933cb9b151 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:00.006284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c4f21-de74-4d4d-8b49-c2933cb9b151 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:00.006560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c4f21-de74-4d4d-8b49-c2933cb9b151 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:00.007340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c4f21-de74-4d4d-8b49-c2933cb9b151 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:20:00.007648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c4f21-de74-4d4d-8b49-c2933cb9b151 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:20:00.009095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c4f21-de74-4d4d-8b49-c2933cb9b151 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:20:00.020527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 660/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jul 21 22:19:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:20:00.026749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ecd75-3e0e-474d-9e45-166a6585c452 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:20:00.122614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ecd75-3e0e-474d-9e45-166a6585c452 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:20:00.155316 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3e79a-e288-4fe0-9c10-bcfdf3255b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:20:00.155957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3e79a-e288-4fe0-9c10-bcfdf3255b88 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:00.156237 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3e79a-e288-4fe0-9c10-bcfdf3255b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:00.156508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3e79a-e288-4fe0-9c10-bcfdf3255b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:00.157360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3e79a-e288-4fe0-9c10-bcfdf3255b88 None admin] RBAC: Adding query filter params (role.id=5261a67f0a3d4275bd9bc9c9ba1f763f, scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494, user.id=5ba75bf6ef954eb59d8db1efa6c73d8c) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:20:00.157674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3e79a-e288-4fe0-9c10-bcfdf3255b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:20:00.159112 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3e79a-e288-4fe0-9c10-bcfdf3255b88 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:20:00.164718 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 627/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jul 21 22:20:00 2022] GET /identity/v3/role_assignments?user.id=5ba75bf6ef954eb59d8db1efa6c73d8c&scope.project.id=f6e77f9cc1c14e35b1d3e1874f107494&role.id=5261a67f0a3d4275bd9bc9c9ba1f763f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:20:02.212328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95c9a0-0b49-4d52-99ac-ea27971c2733 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:02.212906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95c9a0-0b49-4d52-99ac-ea27971c2733 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:02.212906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95c9a0-0b49-4d52-99ac-ea27971c2733 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:02.214292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 661/1288] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:20:02.219352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa563996-322e-45fd-a153-bdaa62d7672d None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:02.219772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa563996-322e-45fd-a153-bdaa62d7672d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:02.219885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa563996-322e-45fd-a153-bdaa62d7672d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:02.235970 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-fa563996-322e-45fd-a153-bdaa62d7672d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:20:02.237648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-fa563996-322e-45fd-a153-bdaa62d7672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:20:02.271405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:02.307583 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 628/1289] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:20:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:20:02.330204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95c9a0-0b49-4d52-99ac-ea27971c2733 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:20:02.426723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95c9a0-0b49-4d52-99ac-ea27971c2733 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:20:02.436688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:02.459716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b38720-eff0-4ba7-99a2-c7b482df15c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:20:02.460500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b38720-eff0-4ba7-99a2-c7b482df15c5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:02.460789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b38720-eff0-4ba7-99a2-c7b482df15c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:02.461108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b38720-eff0-4ba7-99a2-c7b482df15c5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:02.461758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b38720-eff0-4ba7-99a2-c7b482df15c5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:20:02.463120 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b38720-eff0-4ba7-99a2-c7b482df15c5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-52b38720-eff0-4ba7-99a2-c7b482df15c5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:20:02.474681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:20:02.475981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:20:02.476849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:20:02.476849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:20:02.476849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:20:02.476849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:20:02.476849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:20:02.476849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:20:02.476849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:20:02.476849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:20:02.476849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:20:02.476849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:20:02.476849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:20:02.476849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:20:02.476849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:20:02.476849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:20:02.476849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 662/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jul 21 22:20:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:20:02.481698 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa563996-322e-45fd-a153-bdaa62d7672d None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:20:02.579402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa563996-322e-45fd-a153-bdaa62d7672d None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:20:02.612286 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb2a54-f019-472d-b45c-084a4339359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:20:02.612901 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb2a54-f019-472d-b45c-084a4339359c None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:02.613217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb2a54-f019-472d-b45c-084a4339359c None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:02.613487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb2a54-f019-472d-b45c-084a4339359c None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:02.614189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb2a54-f019-472d-b45c-084a4339359c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:20:02.614492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb2a54-f019-472d-b45c-084a4339359c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:20:02.615831 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb2a54-f019-472d-b45c-084a4339359c None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:20:02.620518 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 629/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Jul 21 22:20:02 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:20:02.626253 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b38720-eff0-4ba7-99a2-c7b482df15c5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:20:02.721719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b38720-eff0-4ba7-99a2-c7b482df15c5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:20:02.753860 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548435d7-a445-460d-b1fb-65758674a581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:20:02.754503 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548435d7-a445-460d-b1fb-65758674a581 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:02.754788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548435d7-a445-460d-b1fb-65758674a581 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:02.755065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548435d7-a445-460d-b1fb-65758674a581 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:02.755760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548435d7-a445-460d-b1fb-65758674a581 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:20:02.756068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548435d7-a445-460d-b1fb-65758674a581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:20:02.757456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548435d7-a445-460d-b1fb-65758674a581 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:20:02.761746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 663/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Jul 21 22:20:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:20:04.773101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfbf53-eab5-4f62-a929-099f35bcaf7d None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:04.773666 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfbf53-eab5-4f62-a929-099f35bcaf7d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:04.773666 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfbf53-eab5-4f62-a929-099f35bcaf7d None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:04.775031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 630/1293] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:20:04.780431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5586333-bf3d-48e1-89bc-7eb0a240d535 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:04.780823 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5586333-bf3d-48e1-89bc-7eb0a240d535 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:04.781009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5586333-bf3d-48e1-89bc-7eb0a240d535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:04.797778 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a5586333-bf3d-48e1-89bc-7eb0a240d535 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:20:04.798988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a5586333-bf3d-48e1-89bc-7eb0a240d535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:20:04.827175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:04.868482 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 664/1294] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:20:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:20:04.895495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfbf53-eab5-4f62-a929-099f35bcaf7d None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:20:04.928569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:04.997484 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfbf53-eab5-4f62-a929-099f35bcaf7d None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:20:05.030430 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42cafb-1b3f-4126-8112-8011019f6ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:20:05.031024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42cafb-1b3f-4126-8112-8011019f6ac9 None admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:05.031304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42cafb-1b3f-4126-8112-8011019f6ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:05.031586 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42cafb-1b3f-4126-8112-8011019f6ac9 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:05.032295 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42cafb-1b3f-4126-8112-8011019f6ac9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:20:05.033706 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42cafb-1b3f-4126-8112-8011019f6ac9 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:20:05.046055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 631/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jul 21 22:20:04 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:20:07.070393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f408f-ca65-4814-beed-59aaba9617ff None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:07.070931 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f408f-ca65-4814-beed-59aaba9617ff None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:07.071021 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f408f-ca65-4814-beed-59aaba9617ff None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:07.072342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 665/1296] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:20:07.077586 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd2ed3-b880-47d9-b831-90d2c1e90ba0 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:07.078009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd2ed3-b880-47d9-b831-90d2c1e90ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:07.078159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd2ed3-b880-47d9-b831-90d2c1e90ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:07.094408 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-9acd2ed3-b880-47d9-b831-90d2c1e90ba0 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:20:07.096115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9acd2ed3-b880-47d9-b831-90d2c1e90ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:20:07.166621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 632/1297] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:20:07 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:20:07.190140 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f408f-ca65-4814-beed-59aaba9617ff None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:20:07.286974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f408f-ca65-4814-beed-59aaba9617ff None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:20:07.318941 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905f1d8-9f03-4b0d-8fae-f4c316be66b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:20:07.319713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905f1d8-9f03-4b0d-8fae-f4c316be66b8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:07.319992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905f1d8-9f03-4b0d-8fae-f4c316be66b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:07.320262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905f1d8-9f03-4b0d-8fae-f4c316be66b8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:07.320966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905f1d8-9f03-4b0d-8fae-f4c316be66b8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:20:07.322264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905f1d8-9f03-4b0d-8fae-f4c316be66b8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-e905f1d8-9f03-4b0d-8fae-f4c316be66b8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:20:07.333827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:20:07.334988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:20:07.335836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:20:07.335836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:20:07.335836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:20:07.335836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:20:07.335836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:20:07.335836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:20:07.335836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:20:07.335836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:20:07.335836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:20:07.335836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:20:07.335836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:20:07.335836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:20:07.335836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:20:07.335836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:20:07.335836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 666/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jul 21 22:20:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:20:07.341356 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd2ed3-b880-47d9-b831-90d2c1e90ba0 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:20:07.359424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:07.438479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd2ed3-b880-47d9-b831-90d2c1e90ba0 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:20:07.472253 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd9fd3-afec-4ae3-8a2d-67b7fbe57a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:20:07.473005 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd9fd3-afec-4ae3-8a2d-67b7fbe57a01 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:07.473240 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd9fd3-afec-4ae3-8a2d-67b7fbe57a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:07.473523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd9fd3-afec-4ae3-8a2d-67b7fbe57a01 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:07.474237 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd9fd3-afec-4ae3-8a2d-67b7fbe57a01 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:20:07.474548 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd9fd3-afec-4ae3-8a2d-67b7fbe57a01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:20:07.475916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd9fd3-afec-4ae3-8a2d-67b7fbe57a01 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:20:07.481206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 633/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Jul 21 22:20:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:20:07.487185 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905f1d8-9f03-4b0d-8fae-f4c316be66b8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:20:07.518017 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:07.583821 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905f1d8-9f03-4b0d-8fae-f4c316be66b8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:20:07.615877 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc343c-8e86-4033-9f8f-207865cd8cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:20:07.616498 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc343c-8e86-4033-9f8f-207865cd8cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:07.616778 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc343c-8e86-4033-9f8f-207865cd8cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:07.617081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc343c-8e86-4033-9f8f-207865cd8cf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:07.617864 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc343c-8e86-4033-9f8f-207865cd8cf4 None admin] RBAC: Adding query filter params (interface=public, service_id=7cd547d8f7ab437fb9bf7462441913ee, region_id=RegionOne) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:20:07.618175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc343c-8e86-4033-9f8f-207865cd8cf4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:20:07.619520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc343c-8e86-4033-9f8f-207865cd8cf4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:20:07.624394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 667/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jul 21 22:20:07 2022] GET /identity/v3/endpoints?service_id=7cd547d8f7ab437fb9bf7462441913ee&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:20:07.630165 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd9fd3-afec-4ae3-8a2d-67b7fbe57a01 None admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:20:07.709664 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:07.727947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd9fd3-afec-4ae3-8a2d-67b7fbe57a01 None admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:20:07.760022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24392174-e8a7-445c-aad3-74a3ea7ba0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:20:07.760672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24392174-e8a7-445c-aad3-74a3ea7ba0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:07.760979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24392174-e8a7-445c-aad3-74a3ea7ba0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:07.761263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24392174-e8a7-445c-aad3-74a3ea7ba0e5 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:07.761938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24392174-e8a7-445c-aad3-74a3ea7ba0e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:20:07.763289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24392174-e8a7-445c-aad3-74a3ea7ba0e5 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:20:07.770549 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 634/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jul 21 22:20:07 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:20:09.788022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61da18-6728-40cc-99fc-89cdf84e05d2 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:09.788550 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61da18-6728-40cc-99fc-89cdf84e05d2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:09.788550 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61da18-6728-40cc-99fc-89cdf84e05d2 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:09.789966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 668/1302] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:20:09.795011 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75167cb6-1ae0-40a7-a35e-331ea422baac None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:09.795401 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75167cb6-1ae0-40a7-a35e-331ea422baac None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:09.795575 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75167cb6-1ae0-40a7-a35e-331ea422baac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:09.812124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-75167cb6-1ae0-40a7-a35e-331ea422baac None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:20:09.813333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-75167cb6-1ae0-40a7-a35e-331ea422baac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:20:09.877582 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 635/1303] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:20:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 22:20:09.900447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61da18-6728-40cc-99fc-89cdf84e05d2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:20:09.991062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:09.997727 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61da18-6728-40cc-99fc-89cdf84e05d2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:20:10.030101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e42c00-b94c-4df8-8bd6-521b7be2a0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:20:10.030877 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e42c00-b94c-4df8-8bd6-521b7be2a0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:10.031161 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e42c00-b94c-4df8-8bd6-521b7be2a0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:10.031438 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e42c00-b94c-4df8-8bd6-521b7be2a0f7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:10.032080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e42c00-b94c-4df8-8bd6-521b7be2a0f7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:20:10.033976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e42c00-b94c-4df8-8bd6-521b7be2a0f7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-93e42c00-b94c-4df8-8bd6-521b7be2a0f7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 22:20:10.045484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 22:20:10.046688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 22:20:10.047524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 22:20:10.047524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Jul 21 22:20:10.047524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 22:20:10.047524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Jul 21 22:20:10.047524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 22:20:10.047524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 22:20:10.047524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 22:20:10.047524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Jul 21 22:20:10.047524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 22:20:10.047524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Jul 21 22:20:10.047524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 22:20:10.047524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 22:20:10.047524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 22:20:10.047524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Jul 21 22:20:10.047524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 669/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jul 21 22:20:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 22:20:10.053011 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75167cb6-1ae0-40a7-a35e-331ea422baac None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:20:10.125995 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:10.148585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75167cb6-1ae0-40a7-a35e-331ea422baac None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:20:10.181971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51c0b8-97cd-481d-85e4-ee428c62f8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:20:10.182628 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51c0b8-97cd-481d-85e4-ee428c62f8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:10.182913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51c0b8-97cd-481d-85e4-ee428c62f8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:10.183190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51c0b8-97cd-481d-85e4-ee428c62f8a1 None admin] PATH_INFO: `/v3/services` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:10.183893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51c0b8-97cd-481d-85e4-ee428c62f8a1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:20:10.184202 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51c0b8-97cd-481d-85e4-ee428c62f8a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:20:10.185584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51c0b8-97cd-481d-85e4-ee428c62f8a1 None admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:20:10.190639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 636/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Jul 21 22:20:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:20:10.196450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e42c00-b94c-4df8-8bd6-521b7be2a0f7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:20:10.293705 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e42c00-b94c-4df8-8bd6-521b7be2a0f7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:20:10.326545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ad92e-8c36-4c22-b62f-f6b095ef9ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:20:10.327118 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad92e-8c36-4c22-b62f-f6b095ef9ad1 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:20:10.327401 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad92e-8c36-4c22-b62f-f6b095ef9ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:20:10.327678 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad92e-8c36-4c22-b62f-f6b095ef9ad1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:20:10.328405 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ad92e-8c36-4c22-b62f-f6b095ef9ad1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:20:10.329849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ad92e-8c36-4c22-b62f-f6b095ef9ad1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:20:10.347209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 670/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jul 21 22:20:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:20:20.187621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=30 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:20.343128 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:12.691719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2b1a1-1054-4297-8df6-cae4f6205e08 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:12.692810 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2b1a1-1054-4297-8df6-cae4f6205e08 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:12.693361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2b1a1-1054-4297-8df6-cae4f6205e08 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:12.698601 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 637/1307] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:21:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:21:12.701315 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed995a-872d-4335-80de-4df5872f1fe2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:12.701860 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed995a-872d-4335-80de-4df5872f1fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:12.702370 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed995a-872d-4335-80de-4df5872f1fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:12.845260 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-18ed995a-872d-4335-80de-4df5872f1fe2 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:12.847063 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-18ed995a-872d-4335-80de-4df5872f1fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:13.046348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 671/1308] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:21:13.099601 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0994eb6-d40a-4947-bfdb-6836e20f0cb5 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:13.099888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0994eb6-d40a-4947-bfdb-6836e20f0cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:13.100366 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0994eb6-d40a-4947-bfdb-6836e20f0cb5 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:13.101848 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 638/1309] 10.222.0.43 () {54 vars in 965 bytes} [Thu Jul 21 22:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:21:13.108886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5722cf-e3ba-4dba-9407-cacf3fa4415a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:13.109295 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5722cf-e3ba-4dba-9407-cacf3fa4415a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:13.109645 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5722cf-e3ba-4dba-9407-cacf3fa4415a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:13.186884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-bd5722cf-e3ba-4dba-9407-cacf3fa4415a None None] MFA Rules not processed for user `23aaef489c0948fe8bc10acb8e76c84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:13.188109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bd5722cf-e3ba-4dba-9407-cacf3fa4415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:13.209437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:13.267626 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 672/1310] 10.222.0.43 () {58 vars in 1062 bytes} [Thu Jul 21 22:21:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:21:13.276886 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0994eb6-d40a-4947-bfdb-6836e20f0cb5 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:21:13.278764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b0994eb6-d40a-4947-bfdb-6836e20f0cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:13.395941 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0994eb6-d40a-4947-bfdb-6836e20f0cb5 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:21:13.472463 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20e20a-fbec-4bf1-9d2c-6cafb3cf78ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:21:13.473145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20e20a-fbec-4bf1-9d2c-6cafb3cf78ba service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:13.473441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20e20a-fbec-4bf1-9d2c-6cafb3cf78ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:13.473715 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20e20a-fbec-4bf1-9d2c-6cafb3cf78ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:13.475350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-1a20e20a-fbec-4bf1-9d2c-6cafb3cf78ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:13.533297 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:13.590708 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20e20a-fbec-4bf1-9d2c-6cafb3cf78ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:21:13.592285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20e20a-fbec-4bf1-9d2c-6cafb3cf78ba service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:21:13.612798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 639/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:21:15.927236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685df7b-8664-4c9a-950d-d661d5727076 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:15.927846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685df7b-8664-4c9a-950d-d661d5727076 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:15.927846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685df7b-8664-4c9a-950d-d661d5727076 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:15.930279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 673/1312] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:21:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:21:15.935167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c503a6-a252-48dd-9e56-84a0a7ef5a4f None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:15.935701 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c503a6-a252-48dd-9e56-84a0a7ef5a4f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:15.935963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c503a6-a252-48dd-9e56-84a0a7ef5a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:16.027056 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-d4c503a6-a252-48dd-9e56-84a0a7ef5a4f None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:16.028436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-d4c503a6-a252-48dd-9e56-84a0a7ef5a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:16.146489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 640/1313] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:21:16.180520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685df7b-8664-4c9a-950d-d661d5727076 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:21:16.182020 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5685df7b-8664-4c9a-950d-d661d5727076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:16.294615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685df7b-8664-4c9a-950d-d661d5727076 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:21:16.377842 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:16.380565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdbdd8-e8e7-498e-8d5c-13b5530d91ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:21:16.381286 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdbdd8-e8e7-498e-8d5c-13b5530d91ad service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:16.381543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdbdd8-e8e7-498e-8d5c-13b5530d91ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:16.382179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdbdd8-e8e7-498e-8d5c-13b5530d91ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:16.384471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6bbdbdd8-e8e7-498e-8d5c-13b5530d91ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:16.500697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdbdd8-e8e7-498e-8d5c-13b5530d91ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:21:16.502169 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbdbdd8-e8e7-498e-8d5c-13b5530d91ad service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:21:16.521633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 674/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:21:19.043318 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d6d49-3c0c-4c6c-8467-01515ed2bf52 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:19.043888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d6d49-3c0c-4c6c-8467-01515ed2bf52 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:19.043888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d6d49-3c0c-4c6c-8467-01515ed2bf52 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:19.045275 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 641/1315] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:21:19.050341 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d6308-67f4-4e88-9e4d-71e0c544608a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:19.050724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d6308-67f4-4e88-9e4d-71e0c544608a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:19.050887 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d6308-67f4-4e88-9e4d-71e0c544608a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:19.116354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-052d6308-67f4-4e88-9e4d-71e0c544608a None None] MFA Rules not processed for user `5ee173f5cb884d6f8571ad755a0dd89a`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:19.117574 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-052d6308-67f4-4e88-9e4d-71e0c544608a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:19.167325 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:19.213129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 675/1316] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:21:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:21:19.265752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd465-db33-457a-81a6-7eb922545e29 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:19.266033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd465-db33-457a-81a6-7eb922545e29 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:19.266306 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd465-db33-457a-81a6-7eb922545e29 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:19.267677 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 642/1317] 10.222.0.43 () {54 vars in 965 bytes} [Thu Jul 21 22:21:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:21:19.273253 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055d973-479a-4b04-81f5-8b31d451718f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:19.273537 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055d973-479a-4b04-81f5-8b31d451718f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:19.273810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055d973-479a-4b04-81f5-8b31d451718f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:19.346257 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1055d973-479a-4b04-81f5-8b31d451718f None None] MFA Rules not processed for user `23aaef489c0948fe8bc10acb8e76c84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:19.347384 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1055d973-479a-4b04-81f5-8b31d451718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:19.425810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 676/1318] 10.222.0.43 () {58 vars in 1062 bytes} [Thu Jul 21 22:21:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:21:19.434805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabd465-db33-457a-81a6-7eb922545e29 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:21:19.437105 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ffabd465-db33-457a-81a6-7eb922545e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:19.446787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:19.541952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabd465-db33-457a-81a6-7eb922545e29 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:21:19.618035 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9087711-a789-43d2-b910-93b21d6e7354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:21:19.618610 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9087711-a789-43d2-b910-93b21d6e7354 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:19.618893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9087711-a789-43d2-b910-93b21d6e7354 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:19.619170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9087711-a789-43d2-b910-93b21d6e7354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:19.620801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a9087711-a789-43d2-b910-93b21d6e7354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:19.680777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:19.726467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9087711-a789-43d2-b910-93b21d6e7354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:21:19.727900 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9087711-a789-43d2-b910-93b21d6e7354 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:21:19.746235 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 643/1319] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:21:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:21:22.730015 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2f069-81db-4f12-b7e0-8af86f934c9b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:22.730539 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2f069-81db-4f12-b7e0-8af86f934c9b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:22.730636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2f069-81db-4f12-b7e0-8af86f934c9b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:22.731964 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 677/1320] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:21:22.737280 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96887f-0d6f-4924-a8df-55ace70f7cee None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:22.737697 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96887f-0d6f-4924-a8df-55ace70f7cee None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:22.737858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96887f-0d6f-4924-a8df-55ace70f7cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:22.800151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-1e96887f-0d6f-4924-a8df-55ace70f7cee None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:22.801380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-1e96887f-0d6f-4924-a8df-55ace70f7cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:22.898919 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 644/1321] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:21:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:21:22.937811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2f069-81db-4f12-b7e0-8af86f934c9b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:21:22.939335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a4e2f069-81db-4f12-b7e0-8af86f934c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:22.987831 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:23.040338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2f069-81db-4f12-b7e0-8af86f934c9b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:21:23.112203 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eeb3dc-5e84-4c8a-b9a5-4f1104428fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:21:23.112843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eeb3dc-5e84-4c8a-b9a5-4f1104428fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:23.113148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eeb3dc-5e84-4c8a-b9a5-4f1104428fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:23.113422 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eeb3dc-5e84-4c8a-b9a5-4f1104428fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:23.115055 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-02eeb3dc-5e84-4c8a-b9a5-4f1104428fa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:23.207340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:23.220117 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eeb3dc-5e84-4c8a-b9a5-4f1104428fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:21:23.221575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eeb3dc-5e84-4c8a-b9a5-4f1104428fa3 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:21:23.239296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 678/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:21:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:21:25.976277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33de2c6-dd94-471c-bd05-b629a501aced None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:25.976834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33de2c6-dd94-471c-bd05-b629a501aced None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:25.976834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33de2c6-dd94-471c-bd05-b629a501aced None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:25.978390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 645/1323] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:21:25.983520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f960d61-4557-48be-a414-d88d41ead63b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:25.983903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f960d61-4557-48be-a414-d88d41ead63b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:25.984073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f960d61-4557-48be-a414-d88d41ead63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:26.046987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6f960d61-4557-48be-a414-d88d41ead63b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:26.048173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6f960d61-4557-48be-a414-d88d41ead63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:26.157173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 679/1324] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:21:26.194490 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33de2c6-dd94-471c-bd05-b629a501aced None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:21:26.196035 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b33de2c6-dd94-471c-bd05-b629a501aced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:26.216043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:26.304318 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33de2c6-dd94-471c-bd05-b629a501aced None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:21:26.378711 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08e59c-899b-4228-b12f-c73e02c117d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:21:26.379366 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08e59c-899b-4228-b12f-c73e02c117d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:26.379649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08e59c-899b-4228-b12f-c73e02c117d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:26.379924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08e59c-899b-4228-b12f-c73e02c117d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:26.381614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2c08e59c-899b-4228-b12f-c73e02c117d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:26.451536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:26.495079 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08e59c-899b-4228-b12f-c73e02c117d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:21:26.496510 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08e59c-899b-4228-b12f-c73e02c117d8 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:21:26.515286 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 646/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:21:28.614496 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27980983-c0c0-4419-8fb6-08a454cd9c96 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:28.615012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27980983-c0c0-4419-8fb6-08a454cd9c96 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:28.615012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27980983-c0c0-4419-8fb6-08a454cd9c96 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:28.616341 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 680/1326] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:21:28.621808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40babe2e-c0c8-419d-82be-4f14bcd93a95 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:28.622222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40babe2e-c0c8-419d-82be-4f14bcd93a95 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:28.622369 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40babe2e-c0c8-419d-82be-4f14bcd93a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:28.686156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-40babe2e-c0c8-419d-82be-4f14bcd93a95 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:28.687350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-40babe2e-c0c8-419d-82be-4f14bcd93a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:28.781159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 647/1327] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:21:28.817026 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27980983-c0c0-4419-8fb6-08a454cd9c96 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:21:28.818586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-27980983-c0c0-4419-8fb6-08a454cd9c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:28.888347 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:28.933512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27980983-c0c0-4419-8fb6-08a454cd9c96 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:21:29.008203 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac021e6-0ce8-468b-9397-8d34fae22e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:21:29.008843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac021e6-0ce8-468b-9397-8d34fae22e8c service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:29.009154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac021e6-0ce8-468b-9397-8d34fae22e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:29.009427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac021e6-0ce8-468b-9397-8d34fae22e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:29.011060 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-eac021e6-0ce8-468b-9397-8d34fae22e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:29.132691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:29.139611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac021e6-0ce8-468b-9397-8d34fae22e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:21:29.141670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac021e6-0ce8-468b-9397-8d34fae22e8c service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:21:29.160740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 681/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:21:31.229881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3868483-b004-4c4a-a73a-f6617dd94d0d None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:31.230449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3868483-b004-4c4a-a73a-f6617dd94d0d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:31.230449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3868483-b004-4c4a-a73a-f6617dd94d0d None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:31.231808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 648/1329] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:21:31.237832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009303f5-6764-4ac6-a175-e7730284706c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:31.238312 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009303f5-6764-4ac6-a175-e7730284706c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:31.238412 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009303f5-6764-4ac6-a175-e7730284706c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:31.303873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-009303f5-6764-4ac6-a175-e7730284706c None None] MFA Rules not processed for user `5ee173f5cb884d6f8571ad755a0dd89a`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:31.305129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-009303f5-6764-4ac6-a175-e7730284706c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:31.405175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 682/1330] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:21:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:21:31.443286 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3868483-b004-4c4a-a73a-f6617dd94d0d None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:21:31.444968 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b3868483-b004-4c4a-a73a-f6617dd94d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:31.475103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:31.549933 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3868483-b004-4c4a-a73a-f6617dd94d0d None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:21:31.622283 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a6984-c1a8-4ffe-9fc5-707cade2aabb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:21:31.623509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a6984-c1a8-4ffe-9fc5-707cade2aabb service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:31.623788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a6984-c1a8-4ffe-9fc5-707cade2aabb service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:31.624061 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a6984-c1a8-4ffe-9fc5-707cade2aabb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:31.625747 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f52a6984-c1a8-4ffe-9fc5-707cade2aabb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:31.708801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:31.747511 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a6984-c1a8-4ffe-9fc5-707cade2aabb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:21:31.749704 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a6984-c1a8-4ffe-9fc5-707cade2aabb service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:21:31.768943 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 649/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:21:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:21:34.067870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a76725-e42c-4f0e-b0d0-047124946a4f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:34.068383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a76725-e42c-4f0e-b0d0-047124946a4f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:34.068515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a76725-e42c-4f0e-b0d0-047124946a4f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:34.069854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 683/1332] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:21:34.074948 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3916d88-d1a7-4b7c-91ff-5a7036c6938b None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:34.075325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3916d88-d1a7-4b7c-91ff-5a7036c6938b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:34.075497 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3916d88-d1a7-4b7c-91ff-5a7036c6938b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:34.137343 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-a3916d88-d1a7-4b7c-91ff-5a7036c6938b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:34.139034 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a3916d88-d1a7-4b7c-91ff-5a7036c6938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:34.230719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 650/1333] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:21:34.268650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a76725-e42c-4f0e-b0d0-047124946a4f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:21:34.270259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c3a76725-e42c-4f0e-b0d0-047124946a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:34.336332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:34.370740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a76725-e42c-4f0e-b0d0-047124946a4f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:21:34.445512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51787b-2c8f-4dfd-99b6-c6f6f396e15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:21:34.446159 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51787b-2c8f-4dfd-99b6-c6f6f396e15d service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:34.446444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51787b-2c8f-4dfd-99b6-c6f6f396e15d service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:34.446718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51787b-2c8f-4dfd-99b6-c6f6f396e15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:34.448370 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2c51787b-2c8f-4dfd-99b6-c6f6f396e15d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:34.558304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51787b-2c8f-4dfd-99b6-c6f6f396e15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:21:34.559742 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51787b-2c8f-4dfd-99b6-c6f6f396e15d service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:21:34.570267 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:34.580288 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 684/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:21:36.635462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725ca59-b2ae-454b-8776-16d24f555184 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:36.636012 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725ca59-b2ae-454b-8776-16d24f555184 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:36.636012 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725ca59-b2ae-454b-8776-16d24f555184 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:36.637339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 651/1335] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:21:36.642955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90ab23-d056-4eae-aaf5-4ec2601bd52a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:36.643403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90ab23-d056-4eae-aaf5-4ec2601bd52a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:36.643511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90ab23-d056-4eae-aaf5-4ec2601bd52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:36.706757 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1c90ab23-d056-4eae-aaf5-4ec2601bd52a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:36.707969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1c90ab23-d056-4eae-aaf5-4ec2601bd52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:36.801720 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 685/1336] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:21:36.842061 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725ca59-b2ae-454b-8776-16d24f555184 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:21:36.843591 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e725ca59-b2ae-454b-8776-16d24f555184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:36.883768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:36.945808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725ca59-b2ae-454b-8776-16d24f555184 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:21:37.016305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d88e2-52a7-4e2b-a8f5-4d6708560bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:21:37.016963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d88e2-52a7-4e2b-a8f5-4d6708560bcb service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:37.017252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d88e2-52a7-4e2b-a8f5-4d6708560bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:37.017531 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d88e2-52a7-4e2b-a8f5-4d6708560bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:37.019178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-fe3d88e2-52a7-4e2b-a8f5-4d6708560bcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:37.100426 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:37.131667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d88e2-52a7-4e2b-a8f5-4d6708560bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:21:37.133130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d88e2-52a7-4e2b-a8f5-4d6708560bcb service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:21:37.152215 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 652/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:21:39.494838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f8cc6-4a78-44c7-91d1-0455d801492c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:39.495383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f8cc6-4a78-44c7-91d1-0455d801492c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:39.495383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f8cc6-4a78-44c7-91d1-0455d801492c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:39.496784 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 686/1338] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:21:39.502504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8328-2e2c-44a9-a273-77360073d499 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:39.502938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8328-2e2c-44a9-a273-77360073d499 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:39.503042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8328-2e2c-44a9-a273-77360073d499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:39.565156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-798d8328-2e2c-44a9-a273-77360073d499 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:39.566351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-798d8328-2e2c-44a9-a273-77360073d499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:39.663693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 653/1339] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:21:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:21:39.700367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f8cc6-4a78-44c7-91d1-0455d801492c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:21:39.701954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-561f8cc6-4a78-44c7-91d1-0455d801492c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:39.775301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:39.802847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f8cc6-4a78-44c7-91d1-0455d801492c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:21:39.881561 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ec5f0-f9e6-4943-801a-aacbe6b8d499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:21:39.882210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ec5f0-f9e6-4943-801a-aacbe6b8d499 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:39.882492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ec5f0-f9e6-4943-801a-aacbe6b8d499 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:39.882768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ec5f0-f9e6-4943-801a-aacbe6b8d499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:39.884430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-248ec5f0-f9e6-4943-801a-aacbe6b8d499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:39.989960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ec5f0-f9e6-4943-801a-aacbe6b8d499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:21:39.991389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ec5f0-f9e6-4943-801a-aacbe6b8d499 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:21:40.009794 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 687/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:21:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:21:43.958931 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e377275-c962-4a2e-b2ee-356d88e0d450 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:43.959473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e377275-c962-4a2e-b2ee-356d88e0d450 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:43.959473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e377275-c962-4a2e-b2ee-356d88e0d450 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:43.960869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 654/1341] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:21:43.966671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c729ad-e19a-4969-bfba-108091494d7a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:43.967097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c729ad-e19a-4969-bfba-108091494d7a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:43.967403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c729ad-e19a-4969-bfba-108091494d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:43.971718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:44.033887 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-28c729ad-e19a-4969-bfba-108091494d7a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:44.035007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-28c729ad-e19a-4969-bfba-108091494d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:44.132295 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 688/1342] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:21:44.172123 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e377275-c962-4a2e-b2ee-356d88e0d450 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:21:44.173735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9e377275-c962-4a2e-b2ee-356d88e0d450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:44.222103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:44.276010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e377275-c962-4a2e-b2ee-356d88e0d450 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:21:44.348380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d113b1-ebc0-4310-a559-37378ea06b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:21:44.348970 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d113b1-ebc0-4310-a559-37378ea06b11 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:44.349255 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d113b1-ebc0-4310-a559-37378ea06b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:44.349528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d113b1-ebc0-4310-a559-37378ea06b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:44.351277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-55d113b1-ebc0-4310-a559-37378ea06b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:44.442268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:44.458932 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d113b1-ebc0-4310-a559-37378ea06b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:21:44.460364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d113b1-ebc0-4310-a559-37378ea06b11 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:21:44.483780 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 655/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:21:47.152019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984b4a1-273b-4d47-bf7c-65b8b35020c4 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:47.152565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984b4a1-273b-4d47-bf7c-65b8b35020c4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:47.152742 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984b4a1-273b-4d47-bf7c-65b8b35020c4 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:47.154326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 689/1344] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:21:47.160083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59f310-d8a1-460e-b002-8a3a6ea018c3 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:47.160573 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59f310-d8a1-460e-b002-8a3a6ea018c3 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:47.160727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59f310-d8a1-460e-b002-8a3a6ea018c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:47.232051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-6c59f310-d8a1-460e-b002-8a3a6ea018c3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:47.233294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6c59f310-d8a1-460e-b002-8a3a6ea018c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:47.329896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 656/1345] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:21:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:21:47.367787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984b4a1-273b-4d47-bf7c-65b8b35020c4 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:21:47.369413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0984b4a1-273b-4d47-bf7c-65b8b35020c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:47.456415 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:47.473761 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984b4a1-273b-4d47-bf7c-65b8b35020c4 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:21:47.548243 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9451a3-232d-4adf-90e0-775f5431fc7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:21:47.548893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9451a3-232d-4adf-90e0-775f5431fc7a service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:47.549200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9451a3-232d-4adf-90e0-775f5431fc7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:47.549476 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9451a3-232d-4adf-90e0-775f5431fc7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:47.551131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0f9451a3-232d-4adf-90e0-775f5431fc7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:47.657921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9451a3-232d-4adf-90e0-775f5431fc7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:21:47.659282 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9451a3-232d-4adf-90e0-775f5431fc7a service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:21:47.677805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 690/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:21:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:21:51.608222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0670386-dec8-4666-ba5a-7ba2bbbcc88d None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:51.608761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0670386-dec8-4666-ba5a-7ba2bbbcc88d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:51.608761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0670386-dec8-4666-ba5a-7ba2bbbcc88d None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:51.610248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 657/1347] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:21:51.615398 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055def5-b6fe-4593-a2a6-0c20be48dc3a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:51.615835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055def5-b6fe-4593-a2a6-0c20be48dc3a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:51.615927 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055def5-b6fe-4593-a2a6-0c20be48dc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:51.630215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:51.682022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c055def5-b6fe-4593-a2a6-0c20be48dc3a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:51.683214 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c055def5-b6fe-4593-a2a6-0c20be48dc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:51.780062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 691/1348] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:21:51.817521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0670386-dec8-4666-ba5a-7ba2bbbcc88d None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:21:51.819070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f0670386-dec8-4666-ba5a-7ba2bbbcc88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:51.903764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:51.955917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0670386-dec8-4666-ba5a-7ba2bbbcc88d None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:21:52.036822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07771798-4ea8-4108-8e6c-bd5f498fe6bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:21:52.037520 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07771798-4ea8-4108-8e6c-bd5f498fe6bb service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:52.037801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07771798-4ea8-4108-8e6c-bd5f498fe6bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:52.038073 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07771798-4ea8-4108-8e6c-bd5f498fe6bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:52.039798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-07771798-4ea8-4108-8e6c-bd5f498fe6bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:52.151182 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:52.155054 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07771798-4ea8-4108-8e6c-bd5f498fe6bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:21:52.157131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07771798-4ea8-4108-8e6c-bd5f498fe6bb service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:21:52.176287 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 658/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:21:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:21:57.183853 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd04e0e-24c9-4916-8348-c2990531abbe None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:57.184886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd04e0e-24c9-4916-8348-c2990531abbe None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:57.185210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd04e0e-24c9-4916-8348-c2990531abbe None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:57.187026 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 692/1350] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jul 21 22:21:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:21:57.192118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3090b5-505d-47b2-a6f3-3f57df1404a1 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:21:57.192560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3090b5-505d-47b2-a6f3-3f57df1404a1 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:21:57.192713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3090b5-505d-47b2-a6f3-3f57df1404a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:21:57.275811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-9c3090b5-505d-47b2-a6f3-3f57df1404a1 None None] MFA Rules not processed for user `5ba75bf6ef954eb59d8db1efa6c73d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:21:57.277149 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9c3090b5-505d-47b2-a6f3-3f57df1404a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:21:57.464407 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 659/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jul 21 22:21:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:01.415233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35233169-814c-4404-aff0-a6801b6d3370 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:01.415737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35233169-814c-4404-aff0-a6801b6d3370 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:01.415737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35233169-814c-4404-aff0-a6801b6d3370 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:01.417317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 693/1352] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jul 21 22:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:01.422174 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb763-b42a-4cc9-b995-9c978d6559c1 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:01.422603 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb763-b42a-4cc9-b995-9c978d6559c1 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:01.422744 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb763-b42a-4cc9-b995-9c978d6559c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:01.479636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:01.504547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-6c6cb763-b42a-4cc9-b995-9c978d6559c1 None None] MFA Rules not processed for user `5ba75bf6ef954eb59d8db1efa6c73d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:01.505845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6c6cb763-b42a-4cc9-b995-9c978d6559c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:01.628680 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 660/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jul 21 22:22:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:01.778595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=59 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:03.021643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8f768-8881-4f5d-9d71-65625b0476dd None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:03.022254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8f768-8881-4f5d-9d71-65625b0476dd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:03.022254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8f768-8881-4f5d-9d71-65625b0476dd None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:03.023581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 694/1354] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jul 21 22:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:03.029608 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e0ebc-0a65-4b04-9a59-f8df048cb8fc None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:03.030057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e0ebc-0a65-4b04-9a59-f8df048cb8fc None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:03.030222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e0ebc-0a65-4b04-9a59-f8df048cb8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:03.106741 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-ac0e0ebc-0a65-4b04-9a59-f8df048cb8fc None None] MFA Rules not processed for user `5ba75bf6ef954eb59d8db1efa6c73d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:03.107939 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ac0e0ebc-0a65-4b04-9a59-f8df048cb8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:03.151436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:03.217692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 661/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jul 21 22:22:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:06.708424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316727e-e7dd-4681-965f-b47a9be9978e None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:06.708962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316727e-e7dd-4681-965f-b47a9be9978e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:06.708962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316727e-e7dd-4681-965f-b47a9be9978e None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:06.710345 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 695/1356] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:06.716738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43173bf-f2c2-47b0-9b91-581e5feab6c9 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:06.717263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43173bf-f2c2-47b0-9b91-581e5feab6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:06.717440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43173bf-f2c2-47b0-9b91-581e5feab6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:06.787815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-d43173bf-f2c2-47b0-9b91-581e5feab6c9 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:06.789128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-d43173bf-f2c2-47b0-9b91-581e5feab6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:06.887722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 662/1357] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:06.945493 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c84d3-bac6-48e2-a435-307b59ff793b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:06.946356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c84d3-bac6-48e2-a435-307b59ff793b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:06.946971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c84d3-bac6-48e2-a435-307b59ff793b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:06.949127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 696/1358] 10.222.0.43 () {54 vars in 962 bytes} [Thu Jul 21 22:22:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:06.958559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38914ff1-ff0b-4762-b50c-592add8a22c9 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:06.959647 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38914ff1-ff0b-4762-b50c-592add8a22c9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:06.960906 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38914ff1-ff0b-4762-b50c-592add8a22c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:06.978594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:07.043885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-38914ff1-ff0b-4762-b50c-592add8a22c9 None None] MFA Rules not processed for user `2c04dc3ee4484afaab388cbb306974af`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:07.045282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-38914ff1-ff0b-4762-b50c-592add8a22c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:07.170879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 663/1359] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Jul 21 22:22:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:22:07.178774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c84d3-bac6-48e2-a435-307b59ff793b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:07.180337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3a0c84d3-bac6-48e2-a435-307b59ff793b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:07.337270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c84d3-bac6-48e2-a435-307b59ff793b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:07.411940 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:07.454694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d82741-cf8e-4aff-ae68-b7885ba8f7b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:07.455341 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d82741-cf8e-4aff-ae68-b7885ba8f7b5 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:07.455622 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d82741-cf8e-4aff-ae68-b7885ba8f7b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:07.455894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d82741-cf8e-4aff-ae68-b7885ba8f7b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:07.457538 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-82d82741-cf8e-4aff-ae68-b7885ba8f7b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:07.552818 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d82741-cf8e-4aff-ae68-b7885ba8f7b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:07.554433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d82741-cf8e-4aff-ae68-b7885ba8f7b5 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:07.572522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 697/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:22:09.806003 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae4d69-44bc-4f78-a618-b1c829840588 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:09.806515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae4d69-44bc-4f78-a618-b1c829840588 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:09.806515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae4d69-44bc-4f78-a618-b1c829840588 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:09.808032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 664/1361] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:09.814764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfde551-f0e1-4161-aba9-38f4bc580640 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:09.815165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfde551-f0e1-4161-aba9-38f4bc580640 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:09.815386 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfde551-f0e1-4161-aba9-38f4bc580640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:09.887704 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-bcfde551-f0e1-4161-aba9-38f4bc580640 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:09.889050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bcfde551-f0e1-4161-aba9-38f4bc580640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:09.930591 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:10.010411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 698/1362] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:10.060969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae4d69-44bc-4f78-a618-b1c829840588 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:10.060969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-58ae4d69-44bc-4f78-a618-b1c829840588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:10.135208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:10.227434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae4d69-44bc-4f78-a618-b1c829840588 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:10.349698 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a13b0-98b8-4d57-b09f-650c04352c06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:10.350359 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a13b0-98b8-4d57-b09f-650c04352c06 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:10.350644 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a13b0-98b8-4d57-b09f-650c04352c06 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:10.350921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a13b0-98b8-4d57-b09f-650c04352c06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:10.352597 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2e7a13b0-98b8-4d57-b09f-650c04352c06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:10.377926 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:10.449183 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a13b0-98b8-4d57-b09f-650c04352c06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:10.450801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a13b0-98b8-4d57-b09f-650c04352c06 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:10.470077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 665/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:22:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:22:12.825575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2048f89-d08d-445b-a7d2-3c4b0d173f5c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:12.826102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2048f89-d08d-445b-a7d2-3c4b0d173f5c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:12.826102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2048f89-d08d-445b-a7d2-3c4b0d173f5c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:12.827668 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 699/1364] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:22:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:12.832999 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce9a27-545a-4144-8f60-72a8602d19ad None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:12.833460 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce9a27-545a-4144-8f60-72a8602d19ad None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:12.833540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce9a27-545a-4144-8f60-72a8602d19ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:12.907334 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-d9ce9a27-545a-4144-8f60-72a8602d19ad None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:12.908964 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-d9ce9a27-545a-4144-8f60-72a8602d19ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:13.017059 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:13.019876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 666/1365] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:13.068354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02030404-214b-4c36-989c-430f725e9415 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:13.068696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02030404-214b-4c36-989c-430f725e9415 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:13.068998 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02030404-214b-4c36-989c-430f725e9415 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:13.073161 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 700/1366] 10.222.0.43 () {54 vars in 962 bytes} [Thu Jul 21 22:22:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:22:13.080637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f060300-9e10-4f04-b86f-3e77130bdf8b None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:13.081193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f060300-9e10-4f04-b86f-3e77130bdf8b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:13.081540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f060300-9e10-4f04-b86f-3e77130bdf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:13.164906 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-7f060300-9e10-4f04-b86f-3e77130bdf8b None None] MFA Rules not processed for user `2c04dc3ee4484afaab388cbb306974af`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:13.166130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-7f060300-9e10-4f04-b86f-3e77130bdf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:13.296169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 667/1367] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Jul 21 22:22:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:13.304634 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02030404-214b-4c36-989c-430f725e9415 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:13.306342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-02030404-214b-4c36-989c-430f725e9415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:13.469049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02030404-214b-4c36-989c-430f725e9415 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:13.490304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:13.590008 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6a3b6-e01a-4566-b715-671c9508910b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:13.590716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6a3b6-e01a-4566-b715-671c9508910b service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:13.591002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6a3b6-e01a-4566-b715-671c9508910b service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:13.591286 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6a3b6-e01a-4566-b715-671c9508910b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:13.592958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3bf6a3b6-e01a-4566-b715-671c9508910b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:13.687604 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6a3b6-e01a-4566-b715-671c9508910b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:13.689163 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6a3b6-e01a-4566-b715-671c9508910b service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:13.708128 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 701/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:22:14.686288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22982beb-4de1-45bb-a983-7757e95f59d8 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:14.686841 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22982beb-4de1-45bb-a983-7757e95f59d8 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:14.686841 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22982beb-4de1-45bb-a983-7757e95f59d8 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:14.688320 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 668/1369] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:14.693451 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f45069-154f-4ff6-a92e-dd1ba67453a2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:14.693928 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f45069-154f-4ff6-a92e-dd1ba67453a2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:14.694012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f45069-154f-4ff6-a92e-dd1ba67453a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:14.725795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:14.764132 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-03f45069-154f-4ff6-a92e-dd1ba67453a2 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:14.765464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-03f45069-154f-4ff6-a92e-dd1ba67453a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:14.865582 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 702/1370] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:15.216667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572da989-fd09-4860-9a3a-037b383b603d None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:15.216667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572da989-fd09-4860-9a3a-037b383b603d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:15.216667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572da989-fd09-4860-9a3a-037b383b603d None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:15.219762 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 669/1371] 10.222.0.43 () {54 vars in 964 bytes} [Thu Jul 21 22:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:15.223094 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77d740-7d88-4374-9274-31d54c8ef84a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:15.223389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77d740-7d88-4374-9274-31d54c8ef84a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:15.223669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77d740-7d88-4374-9274-31d54c8ef84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:15.303151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1b77d740-7d88-4374-9274-31d54c8ef84a None None] MFA Rules not processed for user `de7ad1ebf93b4e1db64e3ccf72fa54b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:15.304498 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1b77d740-7d88-4374-9274-31d54c8ef84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:15.353447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:15.386559 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 703/1372] 10.222.0.43 () {58 vars in 1061 bytes} [Thu Jul 21 22:22:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:15.394100 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572da989-fd09-4860-9a3a-037b383b603d None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:15.395730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-572da989-fd09-4860-9a3a-037b383b603d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:15.452279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:15.520961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572da989-fd09-4860-9a3a-037b383b603d None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:15.591026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab95ea-ab7c-433a-bb37-875719a6576a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:15.591684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab95ea-ab7c-433a-bb37-875719a6576a service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:15.591967 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab95ea-ab7c-433a-bb37-875719a6576a service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:15.592241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab95ea-ab7c-433a-bb37-875719a6576a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:15.593935 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-98ab95ea-ab7c-433a-bb37-875719a6576a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:15.694306 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:15.709382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab95ea-ab7c-433a-bb37-875719a6576a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:15.710789 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab95ea-ab7c-433a-bb37-875719a6576a service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:15.731110 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 670/1373] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:22:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:22:15.913564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608c1d8-5032-41e5-9387-2c9bda67a741 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:15.913996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608c1d8-5032-41e5-9387-2c9bda67a741 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:15.914235 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608c1d8-5032-41e5-9387-2c9bda67a741 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:15.916312 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 704/1374] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:15.921152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab46242-0fa9-4e3f-ba00-70272f08cc48 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:15.921788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab46242-0fa9-4e3f-ba00-70272f08cc48 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:15.922011 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab46242-0fa9-4e3f-ba00-70272f08cc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:15.993041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-bab46242-0fa9-4e3f-ba00-70272f08cc48 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:15.994343 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-bab46242-0fa9-4e3f-ba00-70272f08cc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:16.106866 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 671/1375] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:16.145955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608c1d8-5032-41e5-9387-2c9bda67a741 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:16.147467 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5608c1d8-5032-41e5-9387-2c9bda67a741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:16.294545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608c1d8-5032-41e5-9387-2c9bda67a741 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:16.344891 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:16.408681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e70fb2-65a6-4f85-99dd-1e3074fff655 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:16.409361 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e70fb2-65a6-4f85-99dd-1e3074fff655 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:16.409643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e70fb2-65a6-4f85-99dd-1e3074fff655 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:16.409917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e70fb2-65a6-4f85-99dd-1e3074fff655 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:16.411592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e2e70fb2-65a6-4f85-99dd-1e3074fff655 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:16.500866 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e70fb2-65a6-4f85-99dd-1e3074fff655 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:16.502505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e70fb2-65a6-4f85-99dd-1e3074fff655 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:16.520532 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 705/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:22:18.584245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620a42f-5ab0-4375-ad87-2410191f3923 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:18.584719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620a42f-5ab0-4375-ad87-2410191f3923 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:18.584719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620a42f-5ab0-4375-ad87-2410191f3923 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:18.590154 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 672/1377] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:18.592197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec3c4d-4698-4de7-ae72-a851f6853eb1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:18.592647 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec3c4d-4698-4de7-ae72-a851f6853eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:18.592741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec3c4d-4698-4de7-ae72-a851f6853eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:18.663764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-43ec3c4d-4698-4de7-ae72-a851f6853eb1 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:18.665070 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-43ec3c4d-4698-4de7-ae72-a851f6853eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:18.675939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:18.788792 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 706/1378] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:18.833117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620a42f-5ab0-4375-ad87-2410191f3923 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:18.835093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c620a42f-5ab0-4375-ad87-2410191f3923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:18.897175 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:18.987580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620a42f-5ab0-4375-ad87-2410191f3923 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:19.120090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ac0c7-f722-465f-8b22-d9af6c2ac960 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:19.120743 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ac0c7-f722-465f-8b22-d9af6c2ac960 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:19.121057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ac0c7-f722-465f-8b22-d9af6c2ac960 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:19.121338 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ac0c7-f722-465f-8b22-d9af6c2ac960 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:19.128788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-985ac0c7-f722-465f-8b22-d9af6c2ac960 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:19.157780 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:19.247314 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ac0c7-f722-465f-8b22-d9af6c2ac960 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:19.249238 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ac0c7-f722-465f-8b22-d9af6c2ac960 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:19.271576 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 673/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:22:21.385720 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c8bd1-886a-4db1-9d53-382aebe71a9e None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:21.386735 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c8bd1-886a-4db1-9d53-382aebe71a9e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:21.387258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c8bd1-886a-4db1-9d53-382aebe71a9e None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:21.389229 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 707/1380] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:22:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:21.394362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a62152-e15d-4208-a6a2-438606fbc599 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:21.394820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a62152-e15d-4208-a6a2-438606fbc599 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:21.395026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a62152-e15d-4208-a6a2-438606fbc599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:21.462265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-13a62152-e15d-4208-a6a2-438606fbc599 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:21.463461 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-13a62152-e15d-4208-a6a2-438606fbc599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:21.562326 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:21.569332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 674/1381] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:21.613642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c8bd1-886a-4db1-9d53-382aebe71a9e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:21.615166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-285c8bd1-886a-4db1-9d53-382aebe71a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:21.752217 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:21.763375 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c8bd1-886a-4db1-9d53-382aebe71a9e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:21.880107 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e231e-7d14-4ac5-91f1-e7032550df77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:21.880764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e231e-7d14-4ac5-91f1-e7032550df77 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:21.881084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e231e-7d14-4ac5-91f1-e7032550df77 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:21.881361 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e231e-7d14-4ac5-91f1-e7032550df77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:21.882997 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e65e231e-7d14-4ac5-91f1-e7032550df77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:21.980042 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e231e-7d14-4ac5-91f1-e7032550df77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:21.981723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e231e-7d14-4ac5-91f1-e7032550df77 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:21.992446 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:22.002729 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 708/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:22:24.074803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478c41a-f625-4d45-877a-3379205f0e01 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:24.075623 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478c41a-f625-4d45-877a-3379205f0e01 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:24.075623 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478c41a-f625-4d45-877a-3379205f0e01 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:24.076764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 675/1383] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:24.083080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1c318-a68f-4746-a3c9-da2f67768682 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:24.083557 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1c318-a68f-4746-a3c9-da2f67768682 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:24.083557 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1c318-a68f-4746-a3c9-da2f67768682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:24.150604 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-95b1c318-a68f-4746-a3c9-da2f67768682 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:24.151931 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-95b1c318-a68f-4746-a3c9-da2f67768682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:24.251807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 709/1384] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:22:24.295225 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478c41a-f625-4d45-877a-3379205f0e01 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:24.297310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c478c41a-f625-4d45-877a-3379205f0e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:24.447607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478c41a-f625-4d45-877a-3379205f0e01 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:24.521925 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:24.580328 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b80f9-211f-4589-904f-cd4830addb03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:24.581268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b80f9-211f-4589-904f-cd4830addb03 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:24.581633 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b80f9-211f-4589-904f-cd4830addb03 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:24.581997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b80f9-211f-4589-904f-cd4830addb03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:24.584267 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-789b80f9-211f-4589-904f-cd4830addb03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:24.694077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b80f9-211f-4589-904f-cd4830addb03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:24.696103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b80f9-211f-4589-904f-cd4830addb03 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:24.719885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 676/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:22:26.736738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78296a-ecd5-4bad-b059-0ba60bee92b5 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:26.737411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78296a-ecd5-4bad-b059-0ba60bee92b5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:26.737411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78296a-ecd5-4bad-b059-0ba60bee92b5 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:26.738698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 710/1386] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:22:26.744524 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a237d-eb78-4dac-9a8e-bd82453f96e5 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:26.744981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a237d-eb78-4dac-9a8e-bd82453f96e5 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:26.745269 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a237d-eb78-4dac-9a8e-bd82453f96e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:26.816112 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-c15a237d-eb78-4dac-9a8e-bd82453f96e5 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:26.817366 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c15a237d-eb78-4dac-9a8e-bd82453f96e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:26.851675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:26.918551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 677/1387] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:26.963367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78296a-ecd5-4bad-b059-0ba60bee92b5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:26.964962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cb78296a-ecd5-4bad-b059-0ba60bee92b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:27.040775 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:27.113376 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78296a-ecd5-4bad-b059-0ba60bee92b5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:27.239483 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede21f11-19ce-4f6d-b4b0-dec29965f08d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:27.240390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede21f11-19ce-4f6d-b4b0-dec29965f08d service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:27.240754 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede21f11-19ce-4f6d-b4b0-dec29965f08d service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:27.241148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede21f11-19ce-4f6d-b4b0-dec29965f08d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:27.243501 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ede21f11-19ce-4f6d-b4b0-dec29965f08d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:27.292829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:27.345908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede21f11-19ce-4f6d-b4b0-dec29965f08d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:27.347501 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede21f11-19ce-4f6d-b4b0-dec29965f08d service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:27.365620 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 711/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:22:29.435564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce24af-effa-4855-b5ea-da9a4004f55f None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:29.436093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce24af-effa-4855-b5ea-da9a4004f55f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:29.436093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce24af-effa-4855-b5ea-da9a4004f55f None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:29.437479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 678/1389] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:29.442619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a4128-c78c-4cde-9ff7-ca7e5be1e2e5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:29.443031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a4128-c78c-4cde-9ff7-ca7e5be1e2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:29.443179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a4128-c78c-4cde-9ff7-ca7e5be1e2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:29.508600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f50a4128-c78c-4cde-9ff7-ca7e5be1e2e5 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:29.509832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f50a4128-c78c-4cde-9ff7-ca7e5be1e2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:29.606910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 712/1390] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:29.652773 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce24af-effa-4855-b5ea-da9a4004f55f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:29.654405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4dce24af-effa-4855-b5ea-da9a4004f55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:29.805471 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce24af-effa-4855-b5ea-da9a4004f55f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:29.823144 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:29.922276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599875a3-275a-4f52-8c36-8ab9756b1248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:29.922935 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599875a3-275a-4f52-8c36-8ab9756b1248 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:29.923231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599875a3-275a-4f52-8c36-8ab9756b1248 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:29.923515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599875a3-275a-4f52-8c36-8ab9756b1248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:29.925201 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-599875a3-275a-4f52-8c36-8ab9756b1248 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:30.013090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599875a3-275a-4f52-8c36-8ab9756b1248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:30.014835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599875a3-275a-4f52-8c36-8ab9756b1248 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:30.033616 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 679/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:22:31.239382 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627771-b2c7-4b06-9d79-2754fdd71bdf None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:31.239915 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627771-b2c7-4b06-9d79-2754fdd71bdf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:31.239915 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627771-b2c7-4b06-9d79-2754fdd71bdf None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:31.241503 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 713/1392] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:31.246589 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36af06b-8c4e-4635-83cb-b3c3b957c699 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:31.247536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36af06b-8c4e-4635-83cb-b3c3b957c699 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:31.247693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36af06b-8c4e-4635-83cb-b3c3b957c699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:31.272317 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:31.313413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-c36af06b-8c4e-4635-83cb-b3c3b957c699 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:31.314614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c36af06b-8c4e-4635-83cb-b3c3b957c699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:31.412175 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 680/1393] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:31.468196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aadc0c-5a25-4f37-8661-1fcdffcdf99f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:31.468555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aadc0c-5a25-4f37-8661-1fcdffcdf99f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:31.468908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aadc0c-5a25-4f37-8661-1fcdffcdf99f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:31.470361 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 714/1394] 10.222.0.43 () {54 vars in 966 bytes} [Thu Jul 21 22:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:31.475353 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce031b-a3a6-420f-a534-14c424bafc60 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:31.475716 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce031b-a3a6-420f-a534-14c424bafc60 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:31.476069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce031b-a3a6-420f-a534-14c424bafc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:31.551386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-52ce031b-a3a6-420f-a534-14c424bafc60 None None] MFA Rules not processed for user `aefb0fe4d09b451a861510508bb9cf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:31.552583 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-52ce031b-a3a6-420f-a534-14c424bafc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:31.592564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:31.629267 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 681/1395] 10.222.0.43 () {58 vars in 1063 bytes} [Thu Jul 21 22:22:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:31.636889 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aadc0c-5a25-4f37-8661-1fcdffcdf99f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:31.638444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c0aadc0c-5a25-4f37-8661-1fcdffcdf99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:31.652205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:31.742856 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aadc0c-5a25-4f37-8661-1fcdffcdf99f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:31.818418 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf913b86-4b03-4c69-955c-aeb1082228af service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefb0fe4d09b451a861510508bb9cf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:31.819065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf913b86-4b03-4c69-955c-aeb1082228af service glance] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:31.819350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf913b86-4b03-4c69-955c-aeb1082228af service glance] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:31.819628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf913b86-4b03-4c69-955c-aeb1082228af service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:31.821301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bf913b86-4b03-4c69-955c-aeb1082228af service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:31.890631 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:31.933512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf913b86-4b03-4c69-955c-aeb1082228af service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:31.934995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf913b86-4b03-4c69-955c-aeb1082228af service glance] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:31.953382 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 715/1396] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:22:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:22:32.094174 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb078a-8fc2-42d2-bd87-5156d4c7e282 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:32.094620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb078a-8fc2-42d2-bd87-5156d4c7e282 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:32.094915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb078a-8fc2-42d2-bd87-5156d4c7e282 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:32.096298 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 682/1397] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:32.101885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ab97f-43a5-474f-83c2-057ad0849e1e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:32.102174 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ab97f-43a5-474f-83c2-057ad0849e1e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:32.102453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ab97f-43a5-474f-83c2-057ad0849e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:32.171854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fb4ab97f-43a5-474f-83c2-057ad0849e1e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:32.173185 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fb4ab97f-43a5-474f-83c2-057ad0849e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:32.282630 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 716/1398] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:32.335174 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb078a-8fc2-42d2-bd87-5156d4c7e282 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:32.336713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-facb078a-8fc2-42d2-bd87-5156d4c7e282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:32.490183 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb078a-8fc2-42d2-bd87-5156d4c7e282 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:32.540634 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:32.612095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f883692-7d94-4175-9bd6-0eb2dbeec56a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:32.612660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f883692-7d94-4175-9bd6-0eb2dbeec56a service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:32.612970 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f883692-7d94-4175-9bd6-0eb2dbeec56a service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:32.613251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f883692-7d94-4175-9bd6-0eb2dbeec56a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:32.614923 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4f883692-7d94-4175-9bd6-0eb2dbeec56a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:32.681952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa3a12-12d3-40bf-b4ff-b26fc2155be7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:32.682249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa3a12-12d3-40bf-b4ff-b26fc2155be7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:32.682532 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa3a12-12d3-40bf-b4ff-b26fc2155be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:32.709380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:32.714560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f883692-7d94-4175-9bd6-0eb2dbeec56a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:32.716206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f883692-7d94-4175-9bd6-0eb2dbeec56a service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:32.735119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 683/1399] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:22:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:22:32.750148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d8fa3a12-12d3-40bf-b4ff-b26fc2155be7 None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:32.751418 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d8fa3a12-12d3-40bf-b4ff-b26fc2155be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:32.844642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 717/1400] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jul 21 22:22:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:22:32.894983 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7fc56-800c-4fde-9836-578bb65677b9 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:32.895370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7fc56-800c-4fde-9836-578bb65677b9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:32.895764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7fc56-800c-4fde-9836-578bb65677b9 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:32.897335 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 684/1401] 10.222.0.43 () {54 vars in 943 bytes} [Thu Jul 21 22:22:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:32.904799 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8b9dc-4b7c-498e-9f89-7857551e2f83 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:32.905118 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8b9dc-4b7c-498e-9f89-7857551e2f83 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:32.905401 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8b9dc-4b7c-498e-9f89-7857551e2f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:32.985690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b9e8b9dc-4b7c-498e-9f89-7857551e2f83 None None] MFA Rules not processed for user `16a38d4a306748aa8f2e72ceb7f629e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:32.987095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b9e8b9dc-4b7c-498e-9f89-7857551e2f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:33.040301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:33.105801 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 718/1402] 10.222.0.43 () {58 vars in 1040 bytes} [Thu Jul 21 22:22:32 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:33.115928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7fc56-800c-4fde-9836-578bb65677b9 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:33.117498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-31a7fc56-800c-4fde-9836-578bb65677b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:33.174443 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:33.257338 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7fc56-800c-4fde-9836-578bb65677b9 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:33.359754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e624d-ab65-405e-862b-3ff3b16d2e8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:33.360429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e624d-ab65-405e-862b-3ff3b16d2e8d service swift] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:33.360679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e624d-ab65-405e-862b-3ff3b16d2e8d service swift] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:33.360980 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e624d-ab65-405e-862b-3ff3b16d2e8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:33.362672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-051e624d-ab65-405e-862b-3ff3b16d2e8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:33.398527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:33.445339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e624d-ab65-405e-862b-3ff3b16d2e8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:33.446944 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e624d-ab65-405e-862b-3ff3b16d2e8d service swift] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:33.455040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 685/1403] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:22:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:22:34.850629 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07676335-43e6-4f60-a628-17e636d7c56e None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:34.851205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07676335-43e6-4f60-a628-17e636d7c56e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:34.851313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07676335-43e6-4f60-a628-17e636d7c56e None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:34.857310 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 719/1404] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:22:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:34.858887 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f081ca-1a7a-4b8e-ac34-8a6027a42edc None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:34.859334 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f081ca-1a7a-4b8e-ac34-8a6027a42edc None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:34.859478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f081ca-1a7a-4b8e-ac34-8a6027a42edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:34.931309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-97f081ca-1a7a-4b8e-ac34-8a6027a42edc None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:34.932526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-97f081ca-1a7a-4b8e-ac34-8a6027a42edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:35.042758 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 686/1405] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:35.090479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07676335-43e6-4f60-a628-17e636d7c56e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:35.092664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-07676335-43e6-4f60-a628-17e636d7c56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:35.257053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07676335-43e6-4f60-a628-17e636d7c56e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:35.286192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:35.383434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9401e6-4e0b-40c1-91dd-e6bd286db329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:35.384082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9401e6-4e0b-40c1-91dd-e6bd286db329 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:35.384361 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9401e6-4e0b-40c1-91dd-e6bd286db329 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:35.390090 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9401e6-4e0b-40c1-91dd-e6bd286db329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:35.390090 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7a9401e6-4e0b-40c1-91dd-e6bd286db329 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:35.530758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9401e6-4e0b-40c1-91dd-e6bd286db329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:35.532322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9401e6-4e0b-40c1-91dd-e6bd286db329 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:35.570893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 720/1406] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:22:37.655629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8de34-e535-4e3f-8d4f-0110e5e30fdc None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:37.656229 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8de34-e535-4e3f-8d4f-0110e5e30fdc None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:37.656229 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8de34-e535-4e3f-8d4f-0110e5e30fdc None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:37.657756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 687/1407] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:37.663033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062677a-1ce4-4b28-9a1c-ddacafb0cb73 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:37.663439 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062677a-1ce4-4b28-9a1c-ddacafb0cb73 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:37.663598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062677a-1ce4-4b28-9a1c-ddacafb0cb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:37.706790 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:37.735806 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6062677a-1ce4-4b28-9a1c-ddacafb0cb73 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:37.737050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6062677a-1ce4-4b28-9a1c-ddacafb0cb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:37.847401 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 721/1408] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:37.892717 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8de34-e535-4e3f-8d4f-0110e5e30fdc None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:37.894407 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-72e8de34-e535-4e3f-8d4f-0110e5e30fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:37.930256 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:38.049782 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8de34-e535-4e3f-8d4f-0110e5e30fdc None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:38.171564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:38.183042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab9834-e5c5-47bf-bd5e-62cd93251f71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:38.183631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab9834-e5c5-47bf-bd5e-62cd93251f71 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:38.183910 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab9834-e5c5-47bf-bd5e-62cd93251f71 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:38.184191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab9834-e5c5-47bf-bd5e-62cd93251f71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:38.186488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e0ab9834-e5c5-47bf-bd5e-62cd93251f71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:38.284601 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab9834-e5c5-47bf-bd5e-62cd93251f71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:38.286268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab9834-e5c5-47bf-bd5e-62cd93251f71 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:38.305314 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 688/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:22:47.845518 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=51 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:48.302522 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=49 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:55.792364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1306-0b7a-40fc-b77d-e58bfbc73784 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:55.792959 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1306-0b7a-40fc-b77d-e58bfbc73784 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:55.792959 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1306-0b7a-40fc-b77d-e58bfbc73784 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:55.795200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 722/1410] 10.222.0.43 () {54 vars in 918 bytes} [Thu Jul 21 22:22:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:55.800275 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d52ce-2e77-4f2d-b2a3-44386c59efec None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:55.800723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d52ce-2e77-4f2d-b2a3-44386c59efec None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:55.800820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d52ce-2e77-4f2d-b2a3-44386c59efec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:55.873151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-b86d52ce-2e77-4f2d-b2a3-44386c59efec None None] MFA Rules not processed for user `5ba75bf6ef954eb59d8db1efa6c73d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:55.874343 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b86d52ce-2e77-4f2d-b2a3-44386c59efec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:55.976815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 689/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Jul 21 22:22:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:55.991591 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b4152-6a73-40e9-94c1-711af7a20485 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:55.991882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b4152-6a73-40e9-94c1-711af7a20485 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:55.992165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b4152-6a73-40e9-94c1-711af7a20485 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:55.993576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 723/1412] 10.222.0.43 () {54 vars in 918 bytes} [Thu Jul 21 22:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:55.998037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed36b74-0eb0-464d-a19a-9277dc572b59 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:55.998324 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed36b74-0eb0-464d-a19a-9277dc572b59 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:55.998606 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed36b74-0eb0-464d-a19a-9277dc572b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:56.069281 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:56.072027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-4ed36b74-0eb0-464d-a19a-9277dc572b59 None None] MFA Rules not processed for user `2c04dc3ee4484afaab388cbb306974af`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:56.074041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4ed36b74-0eb0-464d-a19a-9277dc572b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:56.306106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 690/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Jul 21 22:22:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:58.797822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14afe-a6fe-43fb-bd33-12538640c00a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:58.798400 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14afe-a6fe-43fb-bd33-12538640c00a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:58.798400 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14afe-a6fe-43fb-bd33-12538640c00a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:58.799767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 724/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:22:58.805242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4d924-3dfb-4071-af1d-fb7580b70b24 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:58.805739 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4d924-3dfb-4071-af1d-fb7580b70b24 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:58.805854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4d924-3dfb-4071-af1d-fb7580b70b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:58.869836 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-45e4d924-3dfb-4071-af1d-fb7580b70b24 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:22:58.871032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-45e4d924-3dfb-4071-af1d-fb7580b70b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:58.924688 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:58.966336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 691/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:22:59.009595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14afe-a6fe-43fb-bd33-12538640c00a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:22:59.011255 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-efd14afe-a6fe-43fb-bd33-12538640c00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:59.155811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14afe-a6fe-43fb-bd33-12538640c00a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:22:59.225332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:59.265792 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dc55b-ea43-463c-9845-0f42797231b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:22:59.266447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc55b-ea43-463c-9845-0f42797231b6 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:22:59.266729 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc55b-ea43-463c-9845-0f42797231b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:22:59.267002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc55b-ea43-463c-9845-0f42797231b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:22:59.268657 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-382dc55b-ea43-463c-9845-0f42797231b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:22:59.361205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dc55b-ea43-463c-9845-0f42797231b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:22:59.362733 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dc55b-ea43-463c-9845-0f42797231b6 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:22:59.380994 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 725/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:00.277022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caabc1-7376-463e-97e2-1cdb12fd60bf None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:00.277581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caabc1-7376-463e-97e2-1cdb12fd60bf None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:00.277581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caabc1-7376-463e-97e2-1cdb12fd60bf None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:00.279552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 692/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:00.284485 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378de80-66cc-43c4-9976-62428745cc31 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:00.284889 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378de80-66cc-43c4-9976-62428745cc31 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:00.285076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378de80-66cc-43c4-9976-62428745cc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:00.357355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b378de80-66cc-43c4-9976-62428745cc31 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:00.358466 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b378de80-66cc-43c4-9976-62428745cc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:00.385103 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:00.460990 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 726/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:00.610574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66caabc1-7376-463e-97e2-1cdb12fd60bf None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:00.612009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-66caabc1-7376-463e-97e2-1cdb12fd60bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:00.763890 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66caabc1-7376-463e-97e2-1cdb12fd60bf None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:00.807778 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:00.880539 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac999f0e-545a-4ba1-a0d5-7e95a3dfb67b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:00.881130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac999f0e-545a-4ba1-a0d5-7e95a3dfb67b service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:00.881409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac999f0e-545a-4ba1-a0d5-7e95a3dfb67b service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:00.881679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac999f0e-545a-4ba1-a0d5-7e95a3dfb67b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:00.883318 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ac999f0e-545a-4ba1-a0d5-7e95a3dfb67b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:00.968660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac999f0e-545a-4ba1-a0d5-7e95a3dfb67b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:00.970250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac999f0e-545a-4ba1-a0d5-7e95a3dfb67b service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:00.987867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 693/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:01.864766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1c968-d3e9-4a9a-bf42-34f20e480c17 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:01.865333 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1c968-d3e9-4a9a-bf42-34f20e480c17 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:01.865445 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1c968-d3e9-4a9a-bf42-34f20e480c17 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:01.866784 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 727/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:23:01.871728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bb1a5-e522-482e-bb9b-60bb3fa38761 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:01.872664 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bb1a5-e522-482e-bb9b-60bb3fa38761 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:01.872823 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bb1a5-e522-482e-bb9b-60bb3fa38761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:01.924136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:01.946235 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-663bb1a5-e522-482e-bb9b-60bb3fa38761 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:01.947440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-663bb1a5-e522-482e-bb9b-60bb3fa38761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:02.041721 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 694/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:02.193112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1c968-d3e9-4a9a-bf42-34f20e480c17 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:02.194594 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-28a1c968-d3e9-4a9a-bf42-34f20e480c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:02.337069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1c968-d3e9-4a9a-bf42-34f20e480c17 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:02.348851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:02.447691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff4a43-cc85-4fd3-9324-2eee6e95020d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:02.448267 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff4a43-cc85-4fd3-9324-2eee6e95020d service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:02.448544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff4a43-cc85-4fd3-9324-2eee6e95020d service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:02.448844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff4a43-cc85-4fd3-9324-2eee6e95020d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:02.450527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-52ff4a43-cc85-4fd3-9324-2eee6e95020d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:02.536426 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff4a43-cc85-4fd3-9324-2eee6e95020d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:02.538018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff4a43-cc85-4fd3-9324-2eee6e95020d service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:02.555777 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 728/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:03.416879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e49ad-737b-477b-b689-5d2e6fb0d063 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:03.417447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e49ad-737b-477b-b689-5d2e6fb0d063 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:03.417447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e49ad-737b-477b-b689-5d2e6fb0d063 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:03.418756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 695/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:03.423609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a238a-f338-47c8-8ce8-c042d233c344 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:03.424063 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a238a-f338-47c8-8ce8-c042d233c344 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:03.424159 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a238a-f338-47c8-8ce8-c042d233c344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:03.443159 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:03.498120 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d05a238a-f338-47c8-8ce8-c042d233c344 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:03.499309 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d05a238a-f338-47c8-8ce8-c042d233c344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:03.593820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 729/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:03.743273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e49ad-737b-477b-b689-5d2e6fb0d063 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:03.744824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ce8e49ad-737b-477b-b689-5d2e6fb0d063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:03.851985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:03.889010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e49ad-737b-477b-b689-5d2e6fb0d063 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:03.999345 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de66bda-4930-483b-b65e-29b2ab4f31c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:03.999915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de66bda-4930-483b-b65e-29b2ab4f31c3 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:04.000196 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de66bda-4930-483b-b65e-29b2ab4f31c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:04.000469 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de66bda-4930-483b-b65e-29b2ab4f31c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:04.002148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-5de66bda-4930-483b-b65e-29b2ab4f31c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:04.076336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:04.090201 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de66bda-4930-483b-b65e-29b2ab4f31c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:04.092273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de66bda-4930-483b-b65e-29b2ab4f31c3 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:04.110223 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 696/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:04.969985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0d35c-c6d6-43b1-a0e9-c2ec2717d70a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:04.970564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0d35c-c6d6-43b1-a0e9-c2ec2717d70a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:04.970564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0d35c-c6d6-43b1-a0e9-c2ec2717d70a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:04.971925 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 730/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:04.976824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00911b77-484b-4e21-ab6b-69d910ebf58d None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:04.977383 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00911b77-484b-4e21-ab6b-69d910ebf58d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:04.977383 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00911b77-484b-4e21-ab6b-69d910ebf58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:05.050144 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-00911b77-484b-4e21-ab6b-69d910ebf58d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:05.051321 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-00911b77-484b-4e21-ab6b-69d910ebf58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:05.144770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 697/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:05.293315 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0d35c-c6d6-43b1-a0e9-c2ec2717d70a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:05.295372 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3ca0d35c-c6d6-43b1-a0e9-c2ec2717d70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:05.383638 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:05.446251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0d35c-c6d6-43b1-a0e9-c2ec2717d70a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:05.556315 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55639353-fa5c-4743-b0bc-2fc34d1ea0d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:05.556892 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55639353-fa5c-4743-b0bc-2fc34d1ea0d0 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:05.557210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55639353-fa5c-4743-b0bc-2fc34d1ea0d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:05.557489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55639353-fa5c-4743-b0bc-2fc34d1ea0d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:05.559171 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-55639353-fa5c-4743-b0bc-2fc34d1ea0d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:05.606230 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:05.647292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55639353-fa5c-4743-b0bc-2fc34d1ea0d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:05.648910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55639353-fa5c-4743-b0bc-2fc34d1ea0d0 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:05.666816 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 731/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:06.469623 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2b801-0334-48ee-8015-f535f7bec91e None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:06.470131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2b801-0334-48ee-8015-f535f7bec91e None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:06.470262 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2b801-0334-48ee-8015-f535f7bec91e None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:06.471557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 698/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:06.476499 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39621f6-f0dc-4a0b-9cc3-259b52c31946 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:06.476888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39621f6-f0dc-4a0b-9cc3-259b52c31946 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:06.477103 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39621f6-f0dc-4a0b-9cc3-259b52c31946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:06.550534 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c39621f6-f0dc-4a0b-9cc3-259b52c31946 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:06.551728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c39621f6-f0dc-4a0b-9cc3-259b52c31946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:06.645541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 732/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:06.796695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2b801-0334-48ee-8015-f535f7bec91e None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:06.798253 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-1fd2b801-0334-48ee-8015-f535f7bec91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:06.846433 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:06.942472 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2b801-0334-48ee-8015-f535f7bec91e None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:07.053450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aae039-939e-4a92-b3de-fc30abbd3c16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:07.054091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aae039-939e-4a92-b3de-fc30abbd3c16 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:07.054374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aae039-939e-4a92-b3de-fc30abbd3c16 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:07.054649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aae039-939e-4a92-b3de-fc30abbd3c16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:07.056312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-58aae039-939e-4a92-b3de-fc30abbd3c16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:07.063953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:07.144914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aae039-939e-4a92-b3de-fc30abbd3c16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:07.146530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aae039-939e-4a92-b3de-fc30abbd3c16 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:07.164362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 699/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:07.970715 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82080f87-424c-4ca8-859f-d867e80442de None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:07.971254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82080f87-424c-4ca8-859f-d867e80442de None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:07.971254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82080f87-424c-4ca8-859f-d867e80442de None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:07.972678 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 733/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:07.977748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec8563-c148-4e75-b34a-65aaede36dfe None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:07.978175 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec8563-c148-4e75-b34a-65aaede36dfe None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:07.978286 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec8563-c148-4e75-b34a-65aaede36dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:08.051706 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-8eec8563-c148-4e75-b34a-65aaede36dfe None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:08.052968 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8eec8563-c148-4e75-b34a-65aaede36dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:08.118954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:08.147624 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 700/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:08.299014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82080f87-424c-4ca8-859f-d867e80442de None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:08.300562 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-82080f87-424c-4ca8-859f-d867e80442de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:08.317998 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:08.445142 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82080f87-424c-4ca8-859f-d867e80442de None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:08.530822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:08.556423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7641026-4373-4315-9b74-8a48db3bc671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:08.557036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7641026-4373-4315-9b74-8a48db3bc671 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:08.557326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7641026-4373-4315-9b74-8a48db3bc671 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:08.557613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7641026-4373-4315-9b74-8a48db3bc671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:08.559276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d7641026-4373-4315-9b74-8a48db3bc671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:08.650934 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7641026-4373-4315-9b74-8a48db3bc671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:08.652790 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7641026-4373-4315-9b74-8a48db3bc671 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:08.670327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 734/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:09.469657 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eb6c5-38f8-4292-b6f8-59442b0e0162 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:09.470173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eb6c5-38f8-4292-b6f8-59442b0e0162 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:09.470173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eb6c5-38f8-4292-b6f8-59442b0e0162 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:09.471541 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 701/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:09.476454 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c9ec-fc29-485a-ad02-a17f2360bd24 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:09.476858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c9ec-fc29-485a-ad02-a17f2360bd24 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:09.477056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c9ec-fc29-485a-ad02-a17f2360bd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:09.550828 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e406c9ec-fc29-485a-ad02-a17f2360bd24 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:09.552036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e406c9ec-fc29-485a-ad02-a17f2360bd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:09.592398 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:09.652829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 735/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:09.803599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354eb6c5-38f8-4292-b6f8-59442b0e0162 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:09.805138 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-354eb6c5-38f8-4292-b6f8-59442b0e0162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:09.946653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354eb6c5-38f8-4292-b6f8-59442b0e0162 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:10.001190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:10.059190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457b0d1-9ec0-4a86-b123-b40934545213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:10.060310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457b0d1-9ec0-4a86-b123-b40934545213 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:10.060588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457b0d1-9ec0-4a86-b123-b40934545213 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:10.060858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457b0d1-9ec0-4a86-b123-b40934545213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:10.062540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f457b0d1-9ec0-4a86-b123-b40934545213 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:10.151929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457b0d1-9ec0-4a86-b123-b40934545213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:10.153550 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457b0d1-9ec0-4a86-b123-b40934545213 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:10.171420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 702/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:10.968054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c77979-62e7-42ec-9005-66abc4d372e3 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:10.968673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c77979-62e7-42ec-9005-66abc4d372e3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:10.968673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c77979-62e7-42ec-9005-66abc4d372e3 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:10.970023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 736/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:10.974924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b675c0-106b-4adc-9a70-63e1374d21b5 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:10.975326 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b675c0-106b-4adc-9a70-63e1374d21b5 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:10.975472 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b675c0-106b-4adc-9a70-63e1374d21b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:11.048058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-39b675c0-106b-4adc-9a70-63e1374d21b5 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:11.049274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-39b675c0-106b-4adc-9a70-63e1374d21b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:11.051251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:11.144078 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 703/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:11.294668 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c77979-62e7-42ec-9005-66abc4d372e3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:11.296212 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-70c77979-62e7-42ec-9005-66abc4d372e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:11.446447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c77979-62e7-42ec-9005-66abc4d372e3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:11.472823 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:11.558227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ed109-d20b-4d8a-98cf-d27a971d2cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:11.558798 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ed109-d20b-4d8a-98cf-d27a971d2cbc service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:11.559082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ed109-d20b-4d8a-98cf-d27a971d2cbc service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:11.559363 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ed109-d20b-4d8a-98cf-d27a971d2cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:11.561553 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6e4ed109-d20b-4d8a-98cf-d27a971d2cbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:11.646927 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ed109-d20b-4d8a-98cf-d27a971d2cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:11.648529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ed109-d20b-4d8a-98cf-d27a971d2cbc service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:11.666228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 737/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:13.613357 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851c486-e06c-4f11-b67d-3cda21591aea None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:13.613937 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851c486-e06c-4f11-b67d-3cda21591aea None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:13.613937 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851c486-e06c-4f11-b67d-3cda21591aea None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:13.615278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 704/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:13.620404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e63711-62f0-4b7b-b01f-bd36d869ddd3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:13.620810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e63711-62f0-4b7b-b01f-bd36d869ddd3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:13.621031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e63711-62f0-4b7b-b01f-bd36d869ddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:13.660487 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:13.686428 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c0e63711-62f0-4b7b-b01f-bd36d869ddd3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:13.687621 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c0e63711-62f0-4b7b-b01f-bd36d869ddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:13.782128 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 738/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:13.820853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851c486-e06c-4f11-b67d-3cda21591aea None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:13.822431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4851c486-e06c-4f11-b67d-3cda21591aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:13.929428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851c486-e06c-4f11-b67d-3cda21591aea None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:13.960324 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:14.001363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab211cf-b0de-42f9-9307-5dedd7942c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:14.002014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab211cf-b0de-42f9-9307-5dedd7942c63 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:14.002307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab211cf-b0de-42f9-9307-5dedd7942c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:14.002586 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab211cf-b0de-42f9-9307-5dedd7942c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:14.004232 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-5ab211cf-b0de-42f9-9307-5dedd7942c63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:14.111638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab211cf-b0de-42f9-9307-5dedd7942c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:14.113100 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab211cf-b0de-42f9-9307-5dedd7942c63 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:14.130496 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 705/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:16.359017 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1c02a-bdbb-469b-b8ae-8f13afba86f5 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:16.359541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1c02a-bdbb-469b-b8ae-8f13afba86f5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:16.359541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1c02a-bdbb-469b-b8ae-8f13afba86f5 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:16.360896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 739/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:16.366166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9444b3-21ce-42f8-811a-a5cb924c3312 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:16.366584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9444b3-21ce-42f8-811a-a5cb924c3312 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:16.366725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9444b3-21ce-42f8-811a-a5cb924c3312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:16.429837 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-6b9444b3-21ce-42f8-811a-a5cb924c3312 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:16.431038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6b9444b3-21ce-42f8-811a-a5cb924c3312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:16.444003 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:16.526006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 706/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:23:16.565157 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1c02a-bdbb-469b-b8ae-8f13afba86f5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:16.566696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-81c1c02a-bdbb-469b-b8ae-8f13afba86f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:16.669795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1c02a-bdbb-469b-b8ae-8f13afba86f5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:16.681292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:16.742807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91f2fd-6d50-44cf-92ba-46c90ae8ca9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:16.743525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91f2fd-6d50-44cf-92ba-46c90ae8ca9d service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:16.743806 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91f2fd-6d50-44cf-92ba-46c90ae8ca9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:16.744082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91f2fd-6d50-44cf-92ba-46c90ae8ca9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:16.745767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5e91f2fd-6d50-44cf-92ba-46c90ae8ca9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:16.853510 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91f2fd-6d50-44cf-92ba-46c90ae8ca9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:16.855058 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91f2fd-6d50-44cf-92ba-46c90ae8ca9d service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:16.879360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 740/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:19.280711 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad96ef9-34fb-4417-9ded-e36fa9ab21ee None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:19.281308 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad96ef9-34fb-4417-9ded-e36fa9ab21ee None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:19.281308 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad96ef9-34fb-4417-9ded-e36fa9ab21ee None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:19.282658 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 707/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:19.287820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b026f-72db-4806-8e62-8a766cf7bf9e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:19.288248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b026f-72db-4806-8e62-8a766cf7bf9e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:19.288393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b026f-72db-4806-8e62-8a766cf7bf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:19.334607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:19.352407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-897b026f-72db-4806-8e62-8a766cf7bf9e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:19.353660 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-897b026f-72db-4806-8e62-8a766cf7bf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:19.448285 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 741/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:19.487429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad96ef9-34fb-4417-9ded-e36fa9ab21ee None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:19.489155 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-cad96ef9-34fb-4417-9ded-e36fa9ab21ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:19.588313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad96ef9-34fb-4417-9ded-e36fa9ab21ee None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:19.627192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:19.659701 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea0b0e-3fbc-4368-b795-803e7f8af84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:19.660341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea0b0e-3fbc-4368-b795-803e7f8af84f service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:19.660622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea0b0e-3fbc-4368-b795-803e7f8af84f service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:19.660896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea0b0e-3fbc-4368-b795-803e7f8af84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:19.662553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8bea0b0e-3fbc-4368-b795-803e7f8af84f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:19.767713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea0b0e-3fbc-4368-b795-803e7f8af84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:19.769163 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea0b0e-3fbc-4368-b795-803e7f8af84f service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:19.787913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 708/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:21.952630 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab3785-abf4-40d9-aca3-dbb30fa93526 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:21.953227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab3785-abf4-40d9-aca3-dbb30fa93526 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:21.953227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab3785-abf4-40d9-aca3-dbb30fa93526 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:21.954592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 742/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:21.959685 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959a26a-d31e-4a68-9fab-36801b7e8883 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:21.960082 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959a26a-d31e-4a68-9fab-36801b7e8883 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:21.960233 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959a26a-d31e-4a68-9fab-36801b7e8883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:22.022220 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-b959a26a-d31e-4a68-9fab-36801b7e8883 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:22.023403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b959a26a-d31e-4a68-9fab-36801b7e8883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:22.043822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:22.131828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 709/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:22.171256 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab3785-abf4-40d9-aca3-dbb30fa93526 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:22.172797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c0ab3785-abf4-40d9-aca3-dbb30fa93526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:22.278975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab3785-abf4-40d9-aca3-dbb30fa93526 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:22.298697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:22.352468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b9eba-e1bc-47b3-8d88-70ea9e086562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:22.353170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b9eba-e1bc-47b3-8d88-70ea9e086562 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:22.353451 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b9eba-e1bc-47b3-8d88-70ea9e086562 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:22.353729 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b9eba-e1bc-47b3-8d88-70ea9e086562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:22.355398 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8d8b9eba-e1bc-47b3-8d88-70ea9e086562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:22.463836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b9eba-e1bc-47b3-8d88-70ea9e086562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:22.465296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b9eba-e1bc-47b3-8d88-70ea9e086562 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:22.603781 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 743/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:24.701581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38720be-86b5-43b6-a6cf-ae3b97becfe6 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:24.702091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38720be-86b5-43b6-a6cf-ae3b97becfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:24.702091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38720be-86b5-43b6-a6cf-ae3b97becfe6 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:24.703422 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 710/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:24.708829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ce09e-be3f-432c-be2b-01518414e791 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:24.709277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ce09e-be3f-432c-be2b-01518414e791 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:24.709427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ce09e-be3f-432c-be2b-01518414e791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:24.770231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:24.772910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-570ce09e-be3f-432c-be2b-01518414e791 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:24.774700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-570ce09e-be3f-432c-be2b-01518414e791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:24.869453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 744/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:24.908368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38720be-86b5-43b6-a6cf-ae3b97becfe6 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:24.909934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f38720be-86b5-43b6-a6cf-ae3b97becfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:25.009752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38720be-86b5-43b6-a6cf-ae3b97becfe6 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:25.058130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:25.083996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6e259-087b-4067-a383-8a2dd0fe4b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:25.084645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6e259-087b-4067-a383-8a2dd0fe4b07 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:25.084953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6e259-087b-4067-a383-8a2dd0fe4b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:25.085230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6e259-087b-4067-a383-8a2dd0fe4b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:25.086900 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-1dd6e259-087b-4067-a383-8a2dd0fe4b07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:25.193433 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6e259-087b-4067-a383-8a2dd0fe4b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:25.194912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6e259-087b-4067-a383-8a2dd0fe4b07 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:25.215113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 711/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:23:27.305512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd7da9-8bda-4d67-a995-796fd1c4a84c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:27.306070 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd7da9-8bda-4d67-a995-796fd1c4a84c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:27.306070 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd7da9-8bda-4d67-a995-796fd1c4a84c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:27.307434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 745/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:27.312717 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287623f-ccae-479e-aa17-e709b219234e None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:27.313152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287623f-ccae-479e-aa17-e709b219234e None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:27.313377 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287623f-ccae-479e-aa17-e709b219234e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:27.378319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-f287623f-ccae-479e-aa17-e709b219234e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:27.379530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f287623f-ccae-479e-aa17-e709b219234e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:27.408110 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:27.475396 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 712/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:27.514230 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd7da9-8bda-4d67-a995-796fd1c4a84c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:27.515760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bbcd7da9-8bda-4d67-a995-796fd1c4a84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:27.616265 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd7da9-8bda-4d67-a995-796fd1c4a84c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:27.643503 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:27.687934 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f5424-a6b5-4149-8419-dbebd65c96a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:27.688571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f5424-a6b5-4149-8419-dbebd65c96a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:27.688855 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f5424-a6b5-4149-8419-dbebd65c96a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:27.689162 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f5424-a6b5-4149-8419-dbebd65c96a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:27.690806 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a02f5424-a6b5-4149-8419-dbebd65c96a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:27.798722 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f5424-a6b5-4149-8419-dbebd65c96a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:27.800155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f5424-a6b5-4149-8419-dbebd65c96a0 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:27.817914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 746/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:29.890482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56124767-3707-43a5-a534-6f2c4991abb3 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:29.891064 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56124767-3707-43a5-a534-6f2c4991abb3 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:29.891064 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56124767-3707-43a5-a534-6f2c4991abb3 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:29.892449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 713/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:29.898063 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ca8d6-9005-4187-b3d2-8cd63643d785 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:29.898481 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ca8d6-9005-4187-b3d2-8cd63643d785 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:29.898609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ca8d6-9005-4187-b3d2-8cd63643d785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:29.960681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-187ca8d6-9005-4187-b3d2-8cd63643d785 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:29.961890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-187ca8d6-9005-4187-b3d2-8cd63643d785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:29.970141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:30.056889 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 747/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:30.095330 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56124767-3707-43a5-a534-6f2c4991abb3 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:30.096880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-56124767-3707-43a5-a534-6f2c4991abb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:30.198161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56124767-3707-43a5-a534-6f2c4991abb3 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:30.251689 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:30.269673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295e429-5d44-4e2d-b58c-0d553f04c77a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:30.270313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295e429-5d44-4e2d-b58c-0d553f04c77a service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:30.270590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295e429-5d44-4e2d-b58c-0d553f04c77a service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:30.270860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295e429-5d44-4e2d-b58c-0d553f04c77a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:30.272495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-3295e429-5d44-4e2d-b58c-0d553f04c77a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:30.378239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295e429-5d44-4e2d-b58c-0d553f04c77a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:30.379659 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295e429-5d44-4e2d-b58c-0d553f04c77a service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:30.397352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 714/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:32.485436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36a65f-0050-4152-85a8-e83f7e745928 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:32.485963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36a65f-0050-4152-85a8-e83f7e745928 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:32.486072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36a65f-0050-4152-85a8-e83f7e745928 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:32.487410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 748/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:32.492797 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd679-24b2-40eb-8a20-5fd47fe3dffe None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:32.493229 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd679-24b2-40eb-8a20-5fd47fe3dffe None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:32.493399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd679-24b2-40eb-8a20-5fd47fe3dffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:32.557958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-b46cd679-24b2-40eb-8a20-5fd47fe3dffe None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:32.559159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b46cd679-24b2-40eb-8a20-5fd47fe3dffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:32.597225 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:32.654737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 715/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:32.692819 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36a65f-0050-4152-85a8-e83f7e745928 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:32.694422 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3e36a65f-0050-4152-85a8-e83f7e745928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:32.795580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36a65f-0050-4152-85a8-e83f7e745928 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:32.832721 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:32.867755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237632c1-1288-480c-8d35-969ec7fc7334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:32.868513 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237632c1-1288-480c-8d35-969ec7fc7334 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:32.868792 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237632c1-1288-480c-8d35-969ec7fc7334 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:32.869102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237632c1-1288-480c-8d35-969ec7fc7334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:32.870740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-237632c1-1288-480c-8d35-969ec7fc7334 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:32.980397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237632c1-1288-480c-8d35-969ec7fc7334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:32.982373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237632c1-1288-480c-8d35-969ec7fc7334 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:33.000765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 749/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:35.054323 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9f4e8-9231-4394-bd89-971759438983 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:35.054913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9f4e8-9231-4394-bd89-971759438983 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:35.054913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9f4e8-9231-4394-bd89-971759438983 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:35.056245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 716/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:35.062144 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f957fb3-4dff-40dc-95b9-dec6c5f77cb1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:35.062593 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f957fb3-4dff-40dc-95b9-dec6c5f77cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:35.062727 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f957fb3-4dff-40dc-95b9-dec6c5f77cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:35.127869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2f957fb3-4dff-40dc-95b9-dec6c5f77cb1 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:35.129074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2f957fb3-4dff-40dc-95b9-dec6c5f77cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:35.146686 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:35.223233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 750/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:35.269865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9f4e8-9231-4394-bd89-971759438983 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:35.271412 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a4c9f4e8-9231-4394-bd89-971759438983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:35.371914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9f4e8-9231-4394-bd89-971759438983 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:35.437056 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:35.444250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21d666-4641-4c14-97d7-06d9ba181a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:35.444901 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21d666-4641-4c14-97d7-06d9ba181a3c service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:35.445208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21d666-4641-4c14-97d7-06d9ba181a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:35.445486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21d666-4641-4c14-97d7-06d9ba181a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:35.447151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-5c21d666-4641-4c14-97d7-06d9ba181a3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:35.556299 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21d666-4641-4c14-97d7-06d9ba181a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:35.557772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21d666-4641-4c14-97d7-06d9ba181a3c service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:35.581111 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 717/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:37.615916 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7799a-db87-4953-a875-a51a367dbf61 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:37.616480 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7799a-db87-4953-a875-a51a367dbf61 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:37.616480 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7799a-db87-4953-a875-a51a367dbf61 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:37.617878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 751/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:37.623864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8682f8f-7723-4700-be9b-d0b0081e357a None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:37.624297 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8682f8f-7723-4700-be9b-d0b0081e357a None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:37.624456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8682f8f-7723-4700-be9b-d0b0081e357a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:37.688507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-b8682f8f-7723-4700-be9b-d0b0081e357a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:37.689725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b8682f8f-7723-4700-be9b-d0b0081e357a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:37.736173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:37.784231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 718/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:37.821121 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7799a-db87-4953-a875-a51a367dbf61 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:37.822677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-65f7799a-db87-4953-a875-a51a367dbf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:37.925842 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7799a-db87-4953-a875-a51a367dbf61 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:37.972845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:37.998975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b7436-5acb-4ee0-b779-866365066ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:37.999621 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b7436-5acb-4ee0-b779-866365066ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:37.999906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b7436-5acb-4ee0-b779-866365066ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:38.000186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b7436-5acb-4ee0-b779-866365066ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:38.001868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a62b7436-5acb-4ee0-b779-866365066ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:38.110857 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b7436-5acb-4ee0-b779-866365066ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:38.112306 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b7436-5acb-4ee0-b779-866365066ff1 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:38.130404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 752/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:23:47.782453 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=22 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:48.128040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=66 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:57.756724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1118b-3ee0-4901-9dee-d9a04a8933aa None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:57.757325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1118b-3ee0-4901-9dee-d9a04a8933aa None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:57.757325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1118b-3ee0-4901-9dee-d9a04a8933aa None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:57.758667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 719/1471] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:57.764307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5e37b-b13e-4758-a97b-0863e4a22e7b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:57.764737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5e37b-b13e-4758-a97b-0863e4a22e7b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:57.764846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5e37b-b13e-4758-a97b-0863e4a22e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:57.828030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c9c5e37b-b13e-4758-a97b-0863e4a22e7b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:57.829237 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c9c5e37b-b13e-4758-a97b-0863e4a22e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:57.922643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 753/1472] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:58.005491 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c36d1-7681-4e28-b898-6d9fcf6298ac None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:58.005780 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c36d1-7681-4e28-b898-6d9fcf6298ac None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:58.006060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c36d1-7681-4e28-b898-6d9fcf6298ac None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:58.007477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 720/1473] 10.222.0.43 () {54 vars in 966 bytes} [Thu Jul 21 22:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:23:58.012130 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106e793-88e5-459c-8ccc-d5a53a9e88d4 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:58.012421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106e793-88e5-459c-8ccc-d5a53a9e88d4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:58.012701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106e793-88e5-459c-8ccc-d5a53a9e88d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:58.087255 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7106e793-88e5-459c-8ccc-d5a53a9e88d4 None None] MFA Rules not processed for user `aefb0fe4d09b451a861510508bb9cf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:23:58.088470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7106e793-88e5-459c-8ccc-d5a53a9e88d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:58.108950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:58.163214 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 754/1474] 10.222.0.43 () {58 vars in 1063 bytes} [Thu Jul 21 22:23:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:23:58.170679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c36d1-7681-4e28-b898-6d9fcf6298ac None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:23:58.172198 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-7d2c36d1-7681-4e28-b898-6d9fcf6298ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:58.273582 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c36d1-7681-4e28-b898-6d9fcf6298ac None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:23:58.345775 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80571c4-42e3-448a-afe1-4c37b627f2bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefb0fe4d09b451a861510508bb9cf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:23:58.346418 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80571c4-42e3-448a-afe1-4c37b627f2bb service glance] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:23:58.346702 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80571c4-42e3-448a-afe1-4c37b627f2bb service glance] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:23:58.346983 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80571c4-42e3-448a-afe1-4c37b627f2bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:23:58.348619 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c80571c4-42e3-448a-afe1-4c37b627f2bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:23:58.401837 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:58.455837 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80571c4-42e3-448a-afe1-4c37b627f2bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:23:58.457301 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80571c4-42e3-448a-afe1-4c37b627f2bb service glance] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:23:58.475089 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 721/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:24:00.644817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303ac3b-23cf-4fb5-b9d3-9fc8cf4f0370 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:00.645394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303ac3b-23cf-4fb5-b9d3-9fc8cf4f0370 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:00.645394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303ac3b-23cf-4fb5-b9d3-9fc8cf4f0370 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:00.646785 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 755/1476] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:00.651850 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308b1d8-0619-4013-b1d5-bf80d506eaba None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:00.652265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308b1d8-0619-4013-b1d5-bf80d506eaba None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:00.652402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308b1d8-0619-4013-b1d5-bf80d506eaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:00.719177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-2308b1d8-0619-4013-b1d5-bf80d506eaba None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:00.720299 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2308b1d8-0619-4013-b1d5-bf80d506eaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:00.815507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 722/1477] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:24:00.838729 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303ac3b-23cf-4fb5-b9d3-9fc8cf4f0370 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:00.840255 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a303ac3b-23cf-4fb5-b9d3-9fc8cf4f0370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:00.961025 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303ac3b-23cf-4fb5-b9d3-9fc8cf4f0370 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:01.007535 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:01.051237 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698e24c-ac7c-4d1d-9013-4134ee73d3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:01.051882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698e24c-ac7c-4d1d-9013-4134ee73d3eb admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:01.052258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698e24c-ac7c-4d1d-9013-4134ee73d3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:01.052529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698e24c-ac7c-4d1d-9013-4134ee73d3eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:01.053440 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698e24c-ac7c-4d1d-9013-4134ee73d3eb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:01.055244 dv-cinder-850697-1-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-d698e24c-ac7c-4d1d-9013-4134ee73d3eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:24:01.055244 dv-cinder-850697-1-smb devstack@keystone.service[80106]: warnings.warn(msg) Jul 21 22:24:01.055244 dv-cinder-850697-1-smb devstack@keystone.service[80106]: Jul 21 22:24:01.056631 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698e24c-ac7c-4d1d-9013-4134ee73d3eb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:01.078430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 756/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jul 21 22:24:00 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:24:03.138084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14145818-33fa-4188-a2f1-e884fd6da595 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:03.138660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14145818-33fa-4188-a2f1-e884fd6da595 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:03.138660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14145818-33fa-4188-a2f1-e884fd6da595 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:03.140015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 723/1479] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:03.145309 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d32ab-a51c-4488-b1f6-e91a1f3cd206 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:03.145703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d32ab-a51c-4488-b1f6-e91a1f3cd206 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:03.145870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d32ab-a51c-4488-b1f6-e91a1f3cd206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:03.209660 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-102d32ab-a51c-4488-b1f6-e91a1f3cd206 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:03.210840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-102d32ab-a51c-4488-b1f6-e91a1f3cd206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:03.304507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 757/1480] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:24:03.348018 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14145818-33fa-4188-a2f1-e884fd6da595 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:03.349631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-14145818-33fa-4188-a2f1-e884fd6da595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:03.359795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:03.492232 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14145818-33fa-4188-a2f1-e884fd6da595 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:03.571568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:03.605463 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22cc05-0aac-4fcb-8c76-d75f42a87364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:03.606084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22cc05-0aac-4fcb-8c76-d75f42a87364 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:03.606366 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22cc05-0aac-4fcb-8c76-d75f42a87364 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:03.607264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22cc05-0aac-4fcb-8c76-d75f42a87364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:03.608902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ec22cc05-0aac-4fcb-8c76-d75f42a87364 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:03.695682 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22cc05-0aac-4fcb-8c76-d75f42a87364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:03.697321 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22cc05-0aac-4fcb-8c76-d75f42a87364 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:03.715191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 724/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:24:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:24:05.907041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032f925-37bb-408d-b4a1-f9dfbd0d3dae None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:05.907599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032f925-37bb-408d-b4a1-f9dfbd0d3dae None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:05.907599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032f925-37bb-408d-b4a1-f9dfbd0d3dae None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:05.909001 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 758/1482] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:05.914246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1644f0-2b36-49d4-8887-d78c10c45d75 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:05.914661 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1644f0-2b36-49d4-8887-d78c10c45d75 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:05.914809 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1644f0-2b36-49d4-8887-d78c10c45d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:05.977637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-dd1644f0-2b36-49d4-8887-d78c10c45d75 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:05.978834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-dd1644f0-2b36-49d4-8887-d78c10c45d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:06.025127 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:06.077550 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 725/1483] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:24:06.114080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032f925-37bb-408d-b4a1-f9dfbd0d3dae None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:06.115608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6032f925-37bb-408d-b4a1-f9dfbd0d3dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:06.138968 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:06.218169 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032f925-37bb-408d-b4a1-f9dfbd0d3dae None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:06.291906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384885b-661b-4c78-9ff6-8d21653a0f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:06.292545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384885b-661b-4c78-9ff6-8d21653a0f69 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:06.292825 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384885b-661b-4c78-9ff6-8d21653a0f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:06.293124 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384885b-661b-4c78-9ff6-8d21653a0f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:06.295385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5384885b-661b-4c78-9ff6-8d21653a0f69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:06.366401 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:06.400604 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384885b-661b-4c78-9ff6-8d21653a0f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:06.402079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384885b-661b-4c78-9ff6-8d21653a0f69 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:06.421536 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 759/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:24:08.512146 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60708-af3d-4752-b495-dea1bae549ac None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:08.512584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60708-af3d-4752-b495-dea1bae549ac None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:08.512688 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60708-af3d-4752-b495-dea1bae549ac None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:08.514284 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 726/1485] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:08.519730 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c07f1-1b14-4d5f-9f3a-13a610872cf6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:08.520144 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c07f1-1b14-4d5f-9f3a-13a610872cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:08.520282 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c07f1-1b14-4d5f-9f3a-13a610872cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:08.584545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ce6c07f1-1b14-4d5f-9f3a-13a610872cf6 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:08.585787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ce6c07f1-1b14-4d5f-9f3a-13a610872cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:08.684803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 760/1486] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:24:08.723598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e60708-af3d-4752-b495-dea1bae549ac None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:08.725209 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b4e60708-af3d-4752-b495-dea1bae549ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:08.825990 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e60708-af3d-4752-b495-dea1bae549ac None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:08.896388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:08.898293 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dea758-2670-44e9-80b8-2955c8cf2e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:08.899167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dea758-2670-44e9-80b8-2955c8cf2e5a service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:08.899672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dea758-2670-44e9-80b8-2955c8cf2e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:08.900135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dea758-2670-44e9-80b8-2955c8cf2e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:08.901815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b0dea758-2670-44e9-80b8-2955c8cf2e5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:09.008703 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dea758-2670-44e9-80b8-2955c8cf2e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:09.010178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dea758-2670-44e9-80b8-2955c8cf2e5a service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:09.029643 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 727/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:24:11.205412 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d626c0b-9096-44f5-9d97-0f51926c9a6a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:11.205966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d626c0b-9096-44f5-9d97-0f51926c9a6a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:11.205966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d626c0b-9096-44f5-9d97-0f51926c9a6a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:11.207349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 761/1488] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:11.212592 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e7231-c384-45a1-8190-93978ec3a772 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:11.213004 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e7231-c384-45a1-8190-93978ec3a772 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:11.213163 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e7231-c384-45a1-8190-93978ec3a772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:11.275970 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-987e7231-c384-45a1-8190-93978ec3a772 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:11.277190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-987e7231-c384-45a1-8190-93978ec3a772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:11.329873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:11.373376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 728/1489] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:24:11.417109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d626c0b-9096-44f5-9d97-0f51926c9a6a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:11.418651 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1d626c0b-9096-44f5-9d97-0f51926c9a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:11.454014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:11.522086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d626c0b-9096-44f5-9d97-0f51926c9a6a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:11.595565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4275ea-8ab4-4f8a-8e38-a89a0d7d3f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:11.596147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4275ea-8ab4-4f8a-8e38-a89a0d7d3f63 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:11.596436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4275ea-8ab4-4f8a-8e38-a89a0d7d3f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:11.596711 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4275ea-8ab4-4f8a-8e38-a89a0d7d3f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:11.598394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0e4275ea-8ab4-4f8a-8e38-a89a0d7d3f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:11.686170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:11.715912 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4275ea-8ab4-4f8a-8e38-a89a0d7d3f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:11.717382 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4275ea-8ab4-4f8a-8e38-a89a0d7d3f63 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:11.735473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 762/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:24:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:24:14.023503 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ba261-d86d-4727-a9ea-54f8c402b5ad None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:14.024060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ba261-d86d-4727-a9ea-54f8c402b5ad None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:14.024060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ba261-d86d-4727-a9ea-54f8c402b5ad None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:14.025482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 729/1491] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jul 21 22:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:24:14.031232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f752ff-b0ad-47bc-bb18-1090a60b945f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:14.031632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f752ff-b0ad-47bc-bb18-1090a60b945f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:14.031783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f752ff-b0ad-47bc-bb18-1090a60b945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:14.096461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a1f752ff-b0ad-47bc-bb18-1090a60b945f None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:24:14.097762 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a1f752ff-b0ad-47bc-bb18-1090a60b945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:14.191246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 763/1492] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jul 21 22:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:24:14.231553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ba261-d86d-4727-a9ea-54f8c402b5ad None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:24:14.233203 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-415ba261-d86d-4727-a9ea-54f8c402b5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:14.335731 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ba261-d86d-4727-a9ea-54f8c402b5ad None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:24:14.408010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9e415-9759-43b5-ba9f-6a2fe2e2dff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:24:14.408657 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9e415-9759-43b5-ba9f-6a2fe2e2dff1 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:24:14.408963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9e415-9759-43b5-ba9f-6a2fe2e2dff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:24:14.409247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9e415-9759-43b5-ba9f-6a2fe2e2dff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:24:14.410889 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-afe9e415-9759-43b5-ba9f-6a2fe2e2dff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:24:14.419806 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:14.519034 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9e415-9759-43b5-ba9f-6a2fe2e2dff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:24:14.520477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9e415-9759-43b5-ba9f-6a2fe2e2dff1 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:24:14.538917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 730/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:24:24.189394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=82 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:24.536600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=50 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:48.865461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd56b-3554-4a71-9596-781f31981702 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:48.866057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd56b-3554-4a71-9596-781f31981702 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:48.866057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd56b-3554-4a71-9596-781f31981702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:48.938397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e16bd56b-3554-4a71-9596-781f31981702 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:48.939569 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e16bd56b-3554-4a71-9596-781f31981702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:49.035542 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 764/1494] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:25:49.043818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7642dc-ec17-40c4-aec7-1d7df02efaba None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.044305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7642dc-ec17-40c4-aec7-1d7df02efaba None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.044428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7642dc-ec17-40c4-aec7-1d7df02efaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.117804 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-0f7642dc-ec17-40c4-aec7-1d7df02efaba None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:49.118962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0f7642dc-ec17-40c4-aec7-1d7df02efaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:49.213884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 731/1495] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:25:49.218557 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bd56b-3554-4a71-9596-781f31981702 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:49.219751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e16bd56b-3554-4a71-9596-781f31981702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:49.231010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bd56b-3554-4a71-9596-781f31981702 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:49.291325 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:49.324355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1683a-a52d-4e59-9b34-b73be698adef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:49.325043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1683a-a52d-4e59-9b34-b73be698adef admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.325324 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1683a-a52d-4e59-9b34-b73be698adef admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.325599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1683a-a52d-4e59-9b34-b73be698adef admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.326308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1683a-a52d-4e59-9b34-b73be698adef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:25:49.326609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1683a-a52d-4e59-9b34-b73be698adef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:49.328198 dv-cinder-850697-1-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-13e1683a-a52d-4e59-9b34-b73be698adef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:25:49.328198 dv-cinder-850697-1-smb devstack@keystone.service[80106]: warnings.warn(msg) Jul 21 22:25:49.328198 dv-cinder-850697-1-smb devstack@keystone.service[80106]: Jul 21 22:25:49.329093 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1683a-a52d-4e59-9b34-b73be698adef admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:49.339804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 765/1496] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:25:49.347917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7642dc-ec17-40c4-aec7-1d7df02efaba None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:49.356892 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7642dc-ec17-40c4-aec7-1d7df02efaba None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:49.416951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:49.451296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752b9dc-d9a5-4322-86d7-15c6aa42164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:49.451949 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752b9dc-d9a5-4322-86d7-15c6aa42164e admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.452248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752b9dc-d9a5-4322-86d7-15c6aa42164e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.452543 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752b9dc-d9a5-4322-86d7-15c6aa42164e admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.453251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752b9dc-d9a5-4322-86d7-15c6aa42164e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:49.454959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: WARNING py.warnings [None req-9752b9dc-d9a5-4322-86d7-15c6aa42164e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:25:49.454959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: warnings.warn(msg) Jul 21 22:25:49.454959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: Jul 21 22:25:49.456151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752b9dc-d9a5-4322-86d7-15c6aa42164e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:49.510116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 732/1497] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:25:49 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:25:49.514355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1683a-a52d-4e59-9b34-b73be698adef admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:49.515950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-13e1683a-a52d-4e59-9b34-b73be698adef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:49.548455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1683a-a52d-4e59-9b34-b73be698adef admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:49.642423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e4e7e-8548-49db-becc-b6af67c9ecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:49.643088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e4e7e-8548-49db-becc-b6af67c9ecbd admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.643370 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e4e7e-8548-49db-becc-b6af67c9ecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.643647 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e4e7e-8548-49db-becc-b6af67c9ecbd admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.644335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e4e7e-8548-49db-becc-b6af67c9ecbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:49.645374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-4e6e4e7e-8548-49db-becc-b6af67c9ecbd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:25:49.645374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: warnings.warn(msg) Jul 21 22:25:49.645374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: Jul 21 22:25:49.646575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e4e7e-8548-49db-becc-b6af67c9ecbd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:49.685403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 766/1498] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:25:49 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:25:49.689949 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752b9dc-d9a5-4322-86d7-15c6aa42164e admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:49.691523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9752b9dc-d9a5-4322-86d7-15c6aa42164e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:49.752064 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752b9dc-d9a5-4322-86d7-15c6aa42164e admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:49.834190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:49.846333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26970ac7-af23-4ad1-bae9-ae48fcbb1432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:49.847003 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26970ac7-af23-4ad1-bae9-ae48fcbb1432 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.847287 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26970ac7-af23-4ad1-bae9-ae48fcbb1432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.847567 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26970ac7-af23-4ad1-bae9-ae48fcbb1432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.848294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26970ac7-af23-4ad1-bae9-ae48fcbb1432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:49.849351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: WARNING py.warnings [None req-26970ac7-af23-4ad1-bae9-ae48fcbb1432 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:25:49.849351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: warnings.warn(msg) Jul 21 22:25:49.849351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: Jul 21 22:25:49.850246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26970ac7-af23-4ad1-bae9-ae48fcbb1432 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:49.863017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 733/1499] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:25:49.867098 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e4e7e-8548-49db-becc-b6af67c9ecbd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:49.868842 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4e6e4e7e-8548-49db-becc-b6af67c9ecbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:49.880327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e4e7e-8548-49db-becc-b6af67c9ecbd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:49.904773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:49.973242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e2ad3-48e8-40d2-b409-48b8a28168d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:49.973834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e2ad3-48e8-40d2-b409-48b8a28168d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:49.974123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e2ad3-48e8-40d2-b409-48b8a28168d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:49.974398 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e2ad3-48e8-40d2-b409-48b8a28168d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:49.975119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e2ad3-48e8-40d2-b409-48b8a28168d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:49.976126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-dd4e2ad3-48e8-40d2-b409-48b8a28168d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:25:49.976126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: warnings.warn(msg) Jul 21 22:25:49.976126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: Jul 21 22:25:49.977031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e2ad3-48e8-40d2-b409-48b8a28168d4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:49.989684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 767/1500] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:25:49.993820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26970ac7-af23-4ad1-bae9-ae48fcbb1432 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:49.995385 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-26970ac7-af23-4ad1-bae9-ae48fcbb1432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:50.027912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26970ac7-af23-4ad1-bae9-ae48fcbb1432 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:50.122062 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a4374-9567-4764-84b7-7ef6d4a3fdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:50.122951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4374-9567-4764-84b7-7ef6d4a3fdc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:50.123231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4374-9567-4764-84b7-7ef6d4a3fdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:50.123505 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4374-9567-4764-84b7-7ef6d4a3fdc5 admin admin] PATH_INFO: `/v3/projects/3c5ce784eaf74cf9afd1226e211d4ea5/users/30d314bfdbcb42099a6fd74e9d561ebe/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:50.145974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a4374-9567-4764-84b7-7ef6d4a3fdc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5ce784eaf74cf9afd1226e211d4ea5, user_id=30d314bfdbcb42099a6fd74e9d561ebe, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:50.146993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: WARNING py.warnings [None req-754a4374-9567-4764-84b7-7ef6d4a3fdc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:25:50.146993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: warnings.warn(msg) Jul 21 22:25:50.146993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: Jul 21 22:25:50.149090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a4374-9567-4764-84b7-7ef6d4a3fdc5 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:50.173885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 734/1501] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:25:49 2022] PUT /identity/v3/projects/3c5ce784eaf74cf9afd1226e211d4ea5/users/30d314bfdbcb42099a6fd74e9d561ebe/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:25:50.186163 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25272a7-8cb4-432d-9076-00893076d710 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:50.186460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25272a7-8cb4-432d-9076-00893076d710 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:50.186736 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25272a7-8cb4-432d-9076-00893076d710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:50.245124 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a25272a7-8cb4-432d-9076-00893076d710 None None] MFA Rules not processed for user `30d314bfdbcb42099a6fd74e9d561ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:50.246327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a25272a7-8cb4-432d-9076-00893076d710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:50.321490 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 768/1502] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:25:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:25:50.335081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d0e5c-2ab5-4e84-a17d-8ece9b665c74 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:50.335373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d0e5c-2ab5-4e84-a17d-8ece9b665c74 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:50.335655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d0e5c-2ab5-4e84-a17d-8ece9b665c74 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:50.337036 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 735/1503] 10.222.0.43 () {54 vars in 964 bytes} [Thu Jul 21 22:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:50.341643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae704641-14a6-4471-901f-661a1d532832 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:50.341935 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae704641-14a6-4471-901f-661a1d532832 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:50.342214 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae704641-14a6-4471-901f-661a1d532832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:50.371416 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:50.430301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ae704641-14a6-4471-901f-661a1d532832 None None] MFA Rules not processed for user `de7ad1ebf93b4e1db64e3ccf72fa54b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:50.431522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ae704641-14a6-4471-901f-661a1d532832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:50.521640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 769/1504] 10.222.0.43 () {58 vars in 1061 bytes} [Thu Jul 21 22:25:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:25:50.529187 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d0e5c-2ab5-4e84-a17d-8ece9b665c74 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:50.531028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-3d2d0e5c-2ab5-4e84-a17d-8ece9b665c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:50.580752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:50.636059 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d0e5c-2ab5-4e84-a17d-8ece9b665c74 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:50.707555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12139785-5546-44d5-958b-d28c2bb0c921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:50.708199 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12139785-5546-44d5-958b-d28c2bb0c921 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:50.708484 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12139785-5546-44d5-958b-d28c2bb0c921 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:50.708763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12139785-5546-44d5-958b-d28c2bb0c921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:50.710444 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-12139785-5546-44d5-958b-d28c2bb0c921 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:50.808718 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12139785-5546-44d5-958b-d28c2bb0c921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:50.810101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12139785-5546-44d5-958b-d28c2bb0c921 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:50.813956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:50.829515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 736/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:25:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:25:50.871170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5771390-7638-4d58-9f68-04a8f2c18230 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:50.871592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5771390-7638-4d58-9f68-04a8f2c18230 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:50.871724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5771390-7638-4d58-9f68-04a8f2c18230 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:50.873037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 770/1506] 10.222.0.43 () {52 vars in 829 bytes} [Thu Jul 21 22:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:25:50.876519 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12139785-5546-44d5-958b-d28c2bb0c921 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:50.877801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-12139785-5546-44d5-958b-d28c2bb0c921 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:50.974089 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12139785-5546-44d5-958b-d28c2bb0c921 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:51.067080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4ec1f-4659-48a0-a589-b7dbbbe471ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:51.067882 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4ec1f-4659-48a0-a589-b7dbbbe471ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:51.068162 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4ec1f-4659-48a0-a589-b7dbbbe471ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:51.068438 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4ec1f-4659-48a0-a589-b7dbbbe471ad admin admin] PATH_INFO: `/v3/users/30d314bfdbcb42099a6fd74e9d561ebe` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:51.081279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4ec1f-4659-48a0-a589-b7dbbbe471ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d314bfdbcb42099a6fd74e9d561ebe)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:51.082305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: WARNING py.warnings [None req-0eb4ec1f-4659-48a0-a589-b7dbbbe471ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:25:51.082305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: warnings.warn(msg) Jul 21 22:25:51.082305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: Jul 21 22:25:51.083519 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4ec1f-4659-48a0-a589-b7dbbbe471ad admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:51.093818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:51.145178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0eb4ec1f-4659-48a0-a589-b7dbbbe471ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d314bfdbcb42099a6fd74e9d561ebe'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:25:51.157825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0eb4ec1f-4659-48a0-a589-b7dbbbe471ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d314bfdbcb42099a6fd74e9d561ebe'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:25:51.158366 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0eb4ec1f-4659-48a0-a589-b7dbbbe471ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d314bfdbcb42099a6fd74e9d561ebe'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:25:51.177633 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0eb4ec1f-4659-48a0-a589-b7dbbbe471ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d314bfdbcb42099a6fd74e9d561ebe'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:25:51.185675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0eb4ec1f-4659-48a0-a589-b7dbbbe471ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d314bfdbcb42099a6fd74e9d561ebe'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:25:51.191897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 737/1507] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:25:50 2022] DELETE /identity/v3/users/30d314bfdbcb42099a6fd74e9d561ebe => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:25:51.196486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cb0a8-519e-4cb0-9d75-6af3379db958 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:51.196768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cb0a8-519e-4cb0-9d75-6af3379db958 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:51.197078 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cb0a8-519e-4cb0-9d75-6af3379db958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:51.250297 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-166cb0a8-519e-4cb0-9d75-6af3379db958 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:25:51.251475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-166cb0a8-519e-4cb0-9d75-6af3379db958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:51.325362 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:51.338811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 771/1508] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:25:51.348377 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4ec1f-4659-48a0-a589-b7dbbbe471ad admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:51.349609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0eb4ec1f-4659-48a0-a589-b7dbbbe471ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:51.446070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4ec1f-4659-48a0-a589-b7dbbbe471ad admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:51.498350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:51.518813 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172488d9-1274-4fa4-b6f6-cf386ba9ca0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:51.519464 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172488d9-1274-4fa4-b6f6-cf386ba9ca0b service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:51.519751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172488d9-1274-4fa4-b6f6-cf386ba9ca0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:51.520029 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172488d9-1274-4fa4-b6f6-cf386ba9ca0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:51.521731 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-172488d9-1274-4fa4-b6f6-cf386ba9ca0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:51.627165 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172488d9-1274-4fa4-b6f6-cf386ba9ca0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:51.628529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172488d9-1274-4fa4-b6f6-cf386ba9ca0b service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:51.646440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 738/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:25:51.990854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cb0a8-519e-4cb0-9d75-6af3379db958 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:25:51.992074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-166cb0a8-519e-4cb0-9d75-6af3379db958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:25:52.003338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cb0a8-519e-4cb0-9d75-6af3379db958 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:25:52.102876 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:25:52.103738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:25:52.104020 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:25:52.104324 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c admin admin] PATH_INFO: `/v3/projects/3c5ce784eaf74cf9afd1226e211d4ea5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:25:52.114765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c5ce784eaf74cf9afd1226e211d4ea5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:25:52.115801 dv-cinder-850697-1-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:25:52.115801 dv-cinder-850697-1-smb devstack@keystone.service[80106]: warnings.warn(msg) Jul 21 22:25:52.115801 dv-cinder-850697-1-smb devstack@keystone.service[80106]: Jul 21 22:25:52.117020 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:25:52.173262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5ce784eaf74cf9afd1226e211d4ea5', 'request_id': 'req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:25:52.185779 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5ce784eaf74cf9afd1226e211d4ea5', 'request_id': 'req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:25:52.191951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5ce784eaf74cf9afd1226e211d4ea5', 'request_id': 'req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:25:52.216822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c admin admin] The token cache is being invalidate because project 3c5ce784eaf74cf9afd1226e211d4ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:25:52.217137 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:25:52.217642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0d71da87-e6ef-40a9-bf21-19b1c9b7b99c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:25:52.219505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 772/1510] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:25:51 2022] DELETE /identity/v3/projects/3c5ce784eaf74cf9afd1226e211d4ea5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:26:01.644171 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=62 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:02.214902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:40.044068 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81ff48-4289-4c14-9fb5-490c14814f18 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:40.044662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81ff48-4289-4c14-9fb5-490c14814f18 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:40.044662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81ff48-4289-4c14-9fb5-490c14814f18 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:40.046061 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 739/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:27:40.051366 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3f317-e973-48a2-9003-45ae9271b479 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:40.051789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3f317-e973-48a2-9003-45ae9271b479 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:40.051935 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3f317-e973-48a2-9003-45ae9271b479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:40.132322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-eda3f317-e973-48a2-9003-45ae9271b479 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:27:40.133538 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-eda3f317-e973-48a2-9003-45ae9271b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:27:40.235706 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 773/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:27:40.388733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81ff48-4289-4c14-9fb5-490c14814f18 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:27:40.390884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ac81ff48-4289-4c14-9fb5-490c14814f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:27:40.509695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81ff48-4289-4c14-9fb5-490c14814f18 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:27:40.520772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0ff4e-1442-48ca-931e-c26390833609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:27:40.521457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0ff4e-1442-48ca-931e-c26390833609 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:40.521768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0ff4e-1442-48ca-931e-c26390833609 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:40.522056 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0ff4e-1442-48ca-931e-c26390833609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:40.530410 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0ff4e-1442-48ca-931e-c26390833609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:27:40.532252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0ff4e-1442-48ca-931e-c26390833609 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:27:40.542031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 740/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:27:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:27:41.373390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4c3c1-cf35-40ed-b28a-6168284cbdd9 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:41.373930 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4c3c1-cf35-40ed-b28a-6168284cbdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:41.373930 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4c3c1-cf35-40ed-b28a-6168284cbdd9 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:41.375339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 774/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:27:41.380330 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a06a9-8867-41a6-bd54-088f4a063db9 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:41.380740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a06a9-8867-41a6-bd54-088f4a063db9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:41.380888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a06a9-8867-41a6-bd54-088f4a063db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:41.400284 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-0a9a06a9-8867-41a6-bd54-088f4a063db9 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:27:41.401505 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0a9a06a9-8867-41a6-bd54-088f4a063db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:27:41.409498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 741/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:27:41.559690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4c3c1-cf35-40ed-b28a-6168284cbdd9 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:27:41.574296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4c3c1-cf35-40ed-b28a-6168284cbdd9 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:27:41.579662 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be4d84-3fa9-4848-96fb-f98e703f6f55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:27:41.580294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be4d84-3fa9-4848-96fb-f98e703f6f55 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:41.580580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be4d84-3fa9-4848-96fb-f98e703f6f55 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:41.580858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be4d84-3fa9-4848-96fb-f98e703f6f55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:41.589473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be4d84-3fa9-4848-96fb-f98e703f6f55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:27:41.591035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be4d84-3fa9-4848-96fb-f98e703f6f55 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:27:41.600242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 775/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:27:42.216811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1d306-f4d7-4a9c-bb37-febfa6d53ad2 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:42.217124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1d306-f4d7-4a9c-bb37-febfa6d53ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:42.217408 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1d306-f4d7-4a9c-bb37-febfa6d53ad2 None None] PATH_INFO: `/v3` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:42.218730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 742/1517] 10.222.0.17 () {54 vars in 925 bytes} [Thu Jul 21 22:27:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:27:42.225366 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f71dd-6906-4174-bb31-bd1cf8b04f61 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:42.225657 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f71dd-6906-4174-bb31-bd1cf8b04f61 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:42.225935 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f71dd-6906-4174-bb31-bd1cf8b04f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:42.281761 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a99f71dd-6906-4174-bb31-bd1cf8b04f61 None None] MFA Rules not processed for user `5ba75bf6ef954eb59d8db1efa6c73d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:27:42.282863 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a99f71dd-6906-4174-bb31-bd1cf8b04f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:27:42.299493 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:42.352145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 776/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Thu Jul 21 22:27:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:27:46.178849 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f4f6e-5654-4759-a795-2b396f3a38db None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:46.179320 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f4f6e-5654-4759-a795-2b396f3a38db None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:46.179320 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f4f6e-5654-4759-a795-2b396f3a38db None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:46.180698 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 743/1519] 10.222.0.43 () {54 vars in 961 bytes} [Thu Jul 21 22:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:27:46.185492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69298b4e-883a-4550-b5ae-7095ff94227e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:46.185910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69298b4e-883a-4550-b5ae-7095ff94227e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:46.186049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69298b4e-883a-4550-b5ae-7095ff94227e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:46.204100 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-69298b4e-883a-4550-b5ae-7095ff94227e None None] MFA Rules not processed for user `5ba75bf6ef954eb59d8db1efa6c73d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:27:46.205307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-69298b4e-883a-4550-b5ae-7095ff94227e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:27:46.213674 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 777/1520] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Jul 21 22:27:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:27:46.220946 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f4f6e-5654-4759-a795-2b396f3a38db None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:27:46.234002 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f4f6e-5654-4759-a795-2b396f3a38db None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:27:46.238775 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabeee3-7bed-4089-9a3d-a769eb57583e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba75bf6ef954eb59d8db1efa6c73d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:27:46.239402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabeee3-7bed-4089-9a3d-a769eb57583e service placement] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:46.239683 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabeee3-7bed-4089-9a3d-a769eb57583e service placement] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:46.239963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabeee3-7bed-4089-9a3d-a769eb57583e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:46.248494 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabeee3-7bed-4089-9a3d-a769eb57583e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:27:46.250080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabeee3-7bed-4089-9a3d-a769eb57583e service placement] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:27:46.260103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 744/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:27:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:27:52.846747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a289aee-66cd-43d8-bf44-b307afa99b67 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:52.847270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a289aee-66cd-43d8-bf44-b307afa99b67 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:52.847270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a289aee-66cd-43d8-bf44-b307afa99b67 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:52.848608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 778/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:27:52.854095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7840ff-00a9-4422-8425-67e63d5d255e None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:52.854485 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7840ff-00a9-4422-8425-67e63d5d255e None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:52.854656 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7840ff-00a9-4422-8425-67e63d5d255e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:52.872280 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-6e7840ff-00a9-4422-8425-67e63d5d255e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:27:52.873483 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6e7840ff-00a9-4422-8425-67e63d5d255e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:27:52.881142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 745/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:27:53.035365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a289aee-66cd-43d8-bf44-b307afa99b67 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:27:53.050325 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a289aee-66cd-43d8-bf44-b307afa99b67 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:27:53.055680 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557d2f5-fd5f-4e0b-8f4b-962921eb7558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:27:53.056349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557d2f5-fd5f-4e0b-8f4b-962921eb7558 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:53.056632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557d2f5-fd5f-4e0b-8f4b-962921eb7558 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:53.056910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557d2f5-fd5f-4e0b-8f4b-962921eb7558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:53.065248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557d2f5-fd5f-4e0b-8f4b-962921eb7558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:27:53.066836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557d2f5-fd5f-4e0b-8f4b-962921eb7558 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:27:53.079065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 779/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:27:53.905252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971e0bc-823f-433a-8f86-f07ae2c042bc None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:53.905840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971e0bc-823f-433a-8f86-f07ae2c042bc None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:53.905840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971e0bc-823f-433a-8f86-f07ae2c042bc None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:53.907424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 746/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 22:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:27:53.912220 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1438a-8f87-4908-9e2c-7fa2067c3460 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:53.912626 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1438a-8f87-4908-9e2c-7fa2067c3460 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:53.912773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1438a-8f87-4908-9e2c-7fa2067c3460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:53.931065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f6d1438a-8f87-4908-9e2c-7fa2067c3460 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:27:53.932281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f6d1438a-8f87-4908-9e2c-7fa2067c3460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:27:53.940581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 780/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 22:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:27:54.090935 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971e0bc-823f-433a-8f86-f07ae2c042bc None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:27:54.104951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971e0bc-823f-433a-8f86-f07ae2c042bc None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:27:54.110308 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ed2d5-d6a7-416e-bb87-887a6c8b13cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:27:54.110936 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ed2d5-d6a7-416e-bb87-887a6c8b13cd service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:54.111222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ed2d5-d6a7-416e-bb87-887a6c8b13cd service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:54.111501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ed2d5-d6a7-416e-bb87-887a6c8b13cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:54.119373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ed2d5-d6a7-416e-bb87-887a6c8b13cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:27:54.121010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ed2d5-d6a7-416e-bb87-887a6c8b13cd service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:27:54.130087 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 747/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:27:58.091724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374dedf-4100-4551-8f7b-90366ded7f0f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:58.092201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374dedf-4100-4551-8f7b-90366ded7f0f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:58.092317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374dedf-4100-4551-8f7b-90366ded7f0f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:58.093744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 781/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:27:58.098981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40d983-2bde-4d96-a744-2724bef33452 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:58.099399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40d983-2bde-4d96-a744-2724bef33452 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:58.099542 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40d983-2bde-4d96-a744-2724bef33452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:58.118690 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-bd40d983-2bde-4d96-a744-2724bef33452 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:27:58.119885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-bd40d983-2bde-4d96-a744-2724bef33452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:27:58.127627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 748/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:27:58.201529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374dedf-4100-4551-8f7b-90366ded7f0f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:27:58.203223 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7374dedf-4100-4551-8f7b-90366ded7f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:27:58.280460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374dedf-4100-4551-8f7b-90366ded7f0f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:27:58.284248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f9150-4f7f-452e-a436-ce441097527c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:27:58.284888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f9150-4f7f-452e-a436-ce441097527c service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:27:58.285203 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f9150-4f7f-452e-a436-ce441097527c service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:27:58.285479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f9150-4f7f-452e-a436-ce441097527c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:27:58.294855 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f9150-4f7f-452e-a436-ce441097527c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:27:58.296280 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f9150-4f7f-452e-a436-ce441097527c service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:27:58.305493 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 782/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:28:00.305349 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4afa1-f4be-4b2a-b1d9-d57a2e8ee8fd None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:00.306459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4afa1-f4be-4b2a-b1d9-d57a2e8ee8fd None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:00.306459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4afa1-f4be-4b2a-b1d9-d57a2e8ee8fd None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:00.307843 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 749/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:28:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:28:00.313128 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ddef5-1b6a-4393-b6d9-34586677d843 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:00.313611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ddef5-1b6a-4393-b6d9-34586677d843 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:00.313717 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ddef5-1b6a-4393-b6d9-34586677d843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:00.331716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7d8ddef5-1b6a-4393-b6d9-34586677d843 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:28:00.332846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7d8ddef5-1b6a-4393-b6d9-34586677d843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:28:00.341125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 783/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:28:00.376783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4afa1-f4be-4b2a-b1d9-d57a2e8ee8fd None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:00.387535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4afa1-f4be-4b2a-b1d9-d57a2e8ee8fd None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:00.391044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4f8d6-cc7d-4d42-95c3-356f8c7d5a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:00.391676 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4f8d6-cc7d-4d42-95c3-356f8c7d5a16 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:00.391961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4f8d6-cc7d-4d42-95c3-356f8c7d5a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:00.392268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4f8d6-cc7d-4d42-95c3-356f8c7d5a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:00.401521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4f8d6-cc7d-4d42-95c3-356f8c7d5a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:00.402940 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4f8d6-cc7d-4d42-95c3-356f8c7d5a16 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:00.412378 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 750/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:28:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:28:04.017517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047c344-03fb-4a8f-b423-884ecb92ce50 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:04.018101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047c344-03fb-4a8f-b423-884ecb92ce50 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:04.018101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047c344-03fb-4a8f-b423-884ecb92ce50 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:04.019451 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 784/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:28:04.025318 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ad74d-0229-4fc8-b8ba-d8322b043fe4 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:04.025746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ad74d-0229-4fc8-b8ba-d8322b043fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:04.025866 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ad74d-0229-4fc8-b8ba-d8322b043fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:04.032485 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=81 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:04.045045 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-648ad74d-0229-4fc8-b8ba-d8322b043fe4 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:28:04.046250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-648ad74d-0229-4fc8-b8ba-d8322b043fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:28:04.054055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 751/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:28:04.359146 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047c344-03fb-4a8f-b423-884ecb92ce50 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:04.360831 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f047c344-03fb-4a8f-b423-884ecb92ce50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:28:04.425360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:04.439194 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047c344-03fb-4a8f-b423-884ecb92ce50 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:04.442698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddb243-13ae-4bdc-a2b2-4a374b557b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:04.443331 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddb243-13ae-4bdc-a2b2-4a374b557b1a service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:04.443608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddb243-13ae-4bdc-a2b2-4a374b557b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:04.443879 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddb243-13ae-4bdc-a2b2-4a374b557b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:04.453224 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddb243-13ae-4bdc-a2b2-4a374b557b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:04.454622 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddb243-13ae-4bdc-a2b2-4a374b557b1a service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:04.463733 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 785/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:28:06.494315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57960a3-a403-49ed-89cc-24ae2fbf8677 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:06.494858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57960a3-a403-49ed-89cc-24ae2fbf8677 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:06.494858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57960a3-a403-49ed-89cc-24ae2fbf8677 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:06.496253 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 752/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 22:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:28:06.501433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9301da-de8f-4581-8be7-19de9ef3c543 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:06.501834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9301da-de8f-4581-8be7-19de9ef3c543 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:06.501986 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9301da-de8f-4581-8be7-19de9ef3c543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:06.519474 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9a9301da-de8f-4581-8be7-19de9ef3c543 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:28:06.520656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9a9301da-de8f-4581-8be7-19de9ef3c543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:28:06.528908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 786/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 22:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:28:06.832192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57960a3-a403-49ed-89cc-24ae2fbf8677 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:28:06.833880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f57960a3-a403-49ed-89cc-24ae2fbf8677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:28:06.847080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57960a3-a403-49ed-89cc-24ae2fbf8677 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:28:06.850563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6847b6-bb60-49d2-822d-6d14ec7b2990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:28:06.851192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6847b6-bb60-49d2-822d-6d14ec7b2990 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:28:06.851477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6847b6-bb60-49d2-822d-6d14ec7b2990 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:28:06.851746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6847b6-bb60-49d2-822d-6d14ec7b2990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:28:06.860458 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6847b6-bb60-49d2-822d-6d14ec7b2990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:28:06.861905 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6847b6-bb60-49d2-822d-6d14ec7b2990 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:28:06.871030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 753/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:28:16.514522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=11 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:16.866988 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=8 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:38.625196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b096a37-0b16-4748-a899-9b6895a27a8c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:38.626299 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b096a37-0b16-4748-a899-9b6895a27a8c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:38.626817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b096a37-0b16-4748-a899-9b6895a27a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:38.661322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2b096a37-0b16-4748-a899-9b6895a27a8c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:38.662582 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2b096a37-0b16-4748-a899-9b6895a27a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:38.678096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 787/1540] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:29:38.687347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb76ea-5589-4618-809a-a7fe1f8c4073 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:38.688664 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb76ea-5589-4618-809a-a7fe1f8c4073 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:38.688664 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb76ea-5589-4618-809a-a7fe1f8c4073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:38.722224 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-a4cb76ea-5589-4618-809a-a7fe1f8c4073 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:38.723508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a4cb76ea-5589-4618-809a-a7fe1f8c4073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:38.734754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 754/1541] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:38.734979 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36dc5d-c16f-4cc8-8408-253f81726e86 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:38.735882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36dc5d-c16f-4cc8-8408-253f81726e86 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:38.736170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36dc5d-c16f-4cc8-8408-253f81726e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:38.740753 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb76ea-5589-4618-809a-a7fe1f8c4073 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:38.751756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb76ea-5589-4618-809a-a7fe1f8c4073 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:38.761712 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ef36dc5d-c16f-4cc8-8408-253f81726e86 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:38.763123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ef36dc5d-c16f-4cc8-8408-253f81726e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:38.764492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fd599-2d2b-4b5f-a8ed-17a9b871d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:38.765210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fd599-2d2b-4b5f-a8ed-17a9b871d191 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:38.765493 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fd599-2d2b-4b5f-a8ed-17a9b871d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:38.765778 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fd599-2d2b-4b5f-a8ed-17a9b871d191 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:38.767386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977fd599-2d2b-4b5f-a8ed-17a9b871d191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:29:38.767707 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977fd599-2d2b-4b5f-a8ed-17a9b871d191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:38.768756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: WARNING py.warnings [None req-977fd599-2d2b-4b5f-a8ed-17a9b871d191 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:29:38.768756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: warnings.warn(msg) Jul 21 22:29:38.768756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: Jul 21 22:29:38.774181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977fd599-2d2b-4b5f-a8ed-17a9b871d191 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:38.777586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 788/1542] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:29:38.787423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a71157-e033-4423-9f7d-1bf46729058d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:38.787763 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a71157-e033-4423-9f7d-1bf46729058d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:38.787998 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a71157-e033-4423-9f7d-1bf46729058d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:38.793612 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 755/1543] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:29:38.802678 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fd599-2d2b-4b5f-a8ed-17a9b871d191 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:38.818038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-95a71157-e033-4423-9f7d-1bf46729058d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:38.819268 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-95a71157-e033-4423-9f7d-1bf46729058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:38.822359 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fd599-2d2b-4b5f-a8ed-17a9b871d191 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:38.835477 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 789/1544] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:29:38.835874 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76931833-a612-4564-99dc-3ee19993ddd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:38.837090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76931833-a612-4564-99dc-3ee19993ddd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:38.837383 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76931833-a612-4564-99dc-3ee19993ddd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:38.837667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76931833-a612-4564-99dc-3ee19993ddd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:38.838435 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76931833-a612-4564-99dc-3ee19993ddd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:38.839957 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a71157-e033-4423-9f7d-1bf46729058d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:38.840375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76931833-a612-4564-99dc-3ee19993ddd1 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:38.853822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a71157-e033-4423-9f7d-1bf46729058d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:38.858678 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf42281-9e24-495e-a145-b3be029fb5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:38.859353 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf42281-9e24-495e-a145-b3be029fb5fc admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:38.859638 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf42281-9e24-495e-a145-b3be029fb5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:38.859918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf42281-9e24-495e-a145-b3be029fb5fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:38.861474 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf42281-9e24-495e-a145-b3be029fb5fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:29:38.861828 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf42281-9e24-495e-a145-b3be029fb5fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:38.864098 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf42281-9e24-495e-a145-b3be029fb5fc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:38.892502 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 790/1545] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:29:38.902148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf42281-9e24-495e-a145-b3be029fb5fc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:38.912258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 756/1546] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:29:38 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:38.916607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76931833-a612-4564-99dc-3ee19993ddd1 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:38.921192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf42281-9e24-495e-a145-b3be029fb5fc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.007513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76931833-a612-4564-99dc-3ee19993ddd1 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.022726 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94ed5e-e09c-4fdb-aef0-3ed06423f99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.023804 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94ed5e-e09c-4fdb-aef0-3ed06423f99c admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.024304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94ed5e-e09c-4fdb-aef0-3ed06423f99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.024802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94ed5e-e09c-4fdb-aef0-3ed06423f99c admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.025904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94ed5e-e09c-4fdb-aef0-3ed06423f99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.027138 dv-cinder-850697-1-smb devstack@keystone.service[80107]: WARNING py.warnings [None req-3c94ed5e-e09c-4fdb-aef0-3ed06423f99c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:29:39.027138 dv-cinder-850697-1-smb devstack@keystone.service[80107]: warnings.warn(msg) Jul 21 22:29:39.027138 dv-cinder-850697-1-smb devstack@keystone.service[80107]: Jul 21 22:29:39.028721 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94ed5e-e09c-4fdb-aef0-3ed06423f99c admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.081798 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bc6a5-f1e5-4d60-83e3-84a946940155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.082623 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bc6a5-f1e5-4d60-83e3-84a946940155 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.082915 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bc6a5-f1e5-4d60-83e3-84a946940155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.083332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bc6a5-f1e5-4d60-83e3-84a946940155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.084108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bc6a5-f1e5-4d60-83e3-84a946940155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.084527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 757/1547] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:29:38 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:39.085186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-407bc6a5-f1e5-4d60-83e3-84a946940155 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:29:39.085186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: warnings.warn(msg) Jul 21 22:29:39.085186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: Jul 21 22:29:39.085904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186a959-b969-452f-b089-007431823e3a None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.086341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186a959-b969-452f-b089-007431823e3a None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.086459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bc6a5-f1e5-4d60-83e3-84a946940155 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.086672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186a959-b969-452f-b089-007431823e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.128071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-2186a959-b969-452f-b089-007431823e3a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:39.129300 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2186a959-b969-452f-b089-007431823e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:39.150512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 758/1548] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:39.151476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186a959-b969-452f-b089-007431823e3a None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.159454 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 791/1549] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:29:38 2022] POST /identity/v3/projects => generated 375 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:29:39.165276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bc6a5-f1e5-4d60-83e3-84a946940155 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.171724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186a959-b969-452f-b089-007431823e3a None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.254051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04e206-bc61-4a44-8dac-49dd9fd8e392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.255128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04e206-bc61-4a44-8dac-49dd9fd8e392 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.257680 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bc6a5-f1e5-4d60-83e3-84a946940155 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.259557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04e206-bc61-4a44-8dac-49dd9fd8e392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.259840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04e206-bc61-4a44-8dac-49dd9fd8e392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.260577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04e206-bc61-4a44-8dac-49dd9fd8e392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.262211 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04e206-bc61-4a44-8dac-49dd9fd8e392 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.262474 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd14ac-3cb3-4755-abb4-7750b295ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.263144 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd14ac-3cb3-4755-abb4-7750b295ef56 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.263438 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd14ac-3cb3-4755-abb4-7750b295ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.263715 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd14ac-3cb3-4755-abb4-7750b295ef56 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.264404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd14ac-3cb3-4755-abb4-7750b295ef56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.266364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd14ac-3cb3-4755-abb4-7750b295ef56 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.281641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 759/1550] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:39.283720 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a8a1c-8b8b-4bd8-b7c0-762dbb214142 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.284007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a8a1c-8b8b-4bd8-b7c0-762dbb214142 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.284285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a8a1c-8b8b-4bd8-b7c0-762dbb214142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.292455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 792/1551] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:39.292455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852fc0d-5651-4955-8077-7bb81a1b6237 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.292455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852fc0d-5651-4955-8077-7bb81a1b6237 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.292455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852fc0d-5651-4955-8077-7bb81a1b6237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.306034 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-3b1a8a1c-8b8b-4bd8-b7c0-762dbb214142 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:39.307221 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-3b1a8a1c-8b8b-4bd8-b7c0-762dbb214142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:39.310232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f852fc0d-5651-4955-8077-7bb81a1b6237 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:39.311414 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f852fc0d-5651-4955-8077-7bb81a1b6237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:39.315510 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 760/1552] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:39.316584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53818524-5cdb-482b-b0d1-dd83f8642fd6 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.316869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53818524-5cdb-482b-b0d1-dd83f8642fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.317176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53818524-5cdb-482b-b0d1-dd83f8642fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.323054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 793/1553] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:39.323054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d515e4a-f6b0-4ec0-802d-eda91f0979ec None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.323054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d515e4a-f6b0-4ec0-802d-eda91f0979ec None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.323054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d515e4a-f6b0-4ec0-802d-eda91f0979ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.338407 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-53818524-5cdb-482b-b0d1-dd83f8642fd6 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:39.339395 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9d515e4a-f6b0-4ec0-802d-eda91f0979ec None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:39.339593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-53818524-5cdb-482b-b0d1-dd83f8642fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:39.340651 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9d515e4a-f6b0-4ec0-802d-eda91f0979ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:39.347865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 761/1554] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:39.349135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 794/1555] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:39.350193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9fe07-1e19-4715-b897-163677ad5b42 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.350481 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9fe07-1e19-4715-b897-163677ad5b42 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.350766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9fe07-1e19-4715-b897-163677ad5b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.353047 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bd36d-004e-4065-bf17-6613eb0d39ae None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.353688 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bd36d-004e-4065-bf17-6613eb0d39ae None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.354297 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bd36d-004e-4065-bf17-6613eb0d39ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.368844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-10f9fe07-1e19-4715-b897-163677ad5b42 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:39.370058 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-10f9fe07-1e19-4715-b897-163677ad5b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:39.373533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-598bd36d-004e-4065-bf17-6613eb0d39ae None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:39.374673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-598bd36d-004e-4065-bf17-6613eb0d39ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:39.378010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 795/1556] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:39.378886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9fe07-1e19-4715-b897-163677ad5b42 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.388174 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9fe07-1e19-4715-b897-163677ad5b42 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.389826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 762/1557] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:39.390614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bd36d-004e-4065-bf17-6613eb0d39ae None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.400206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ba13e-1703-4d0d-9394-d524e61739fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.400912 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ba13e-1703-4d0d-9394-d524e61739fa admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.401051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bd36d-004e-4065-bf17-6613eb0d39ae None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.401209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ba13e-1703-4d0d-9394-d524e61739fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.401490 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ba13e-1703-4d0d-9394-d524e61739fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.402214 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ba13e-1703-4d0d-9394-d524e61739fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.403814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ba13e-1703-4d0d-9394-d524e61739fa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.405668 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f3c18-68d6-4fb8-b2fa-d17ed27bf85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.406560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f3c18-68d6-4fb8-b2fa-d17ed27bf85f admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.406838 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f3c18-68d6-4fb8-b2fa-d17ed27bf85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.407635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f3c18-68d6-4fb8-b2fa-d17ed27bf85f admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.408356 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f3c18-68d6-4fb8-b2fa-d17ed27bf85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.409978 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f3c18-68d6-4fb8-b2fa-d17ed27bf85f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.412031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:39.418420 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 796/1558] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:39.418420 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a25ab1-9e76-4104-a0e6-db5ede7fb916 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.418420 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a25ab1-9e76-4104-a0e6-db5ede7fb916 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.418420 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a25ab1-9e76-4104-a0e6-db5ede7fb916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.423290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 763/1559] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:39.424290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f3c18-68d6-4fb8-b2fa-d17ed27bf85f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.436345 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f3c18-68d6-4fb8-b2fa-d17ed27bf85f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.436761 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-15a25ab1-9e76-4104-a0e6-db5ede7fb916 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:39.437990 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-15a25ab1-9e76-4104-a0e6-db5ede7fb916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:39.441077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5172b35-bb77-4e1a-848b-beb60425b3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.441733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5172b35-bb77-4e1a-848b-beb60425b3be admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.442017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5172b35-bb77-4e1a-848b-beb60425b3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.442296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5172b35-bb77-4e1a-848b-beb60425b3be admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.443055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5172b35-bb77-4e1a-848b-beb60425b3be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:29:39.443363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5172b35-bb77-4e1a-848b-beb60425b3be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.444962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5172b35-bb77-4e1a-848b-beb60425b3be admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.445972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 797/1560] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:39.447162 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bb60d-2a27-49ae-8f4a-43847cdf17d3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.447445 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bb60d-2a27-49ae-8f4a-43847cdf17d3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.447718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bb60d-2a27-49ae-8f4a-43847cdf17d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.455027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:39.461341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 764/1561] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:29:39.462675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8b4ec-1dff-4f60-869d-f67c1501db7b None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.462973 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8b4ec-1dff-4f60-869d-f67c1501db7b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.463249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8b4ec-1dff-4f60-869d-f67c1501db7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.473585 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-075bb60d-2a27-49ae-8f4a-43847cdf17d3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:39.475247 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-075bb60d-2a27-49ae-8f4a-43847cdf17d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:39.481725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-dec8b4ec-1dff-4f60-869d-f67c1501db7b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:39.482908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-dec8b4ec-1dff-4f60-869d-f67c1501db7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:39.483562 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 798/1562] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:39.484820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db4016-d245-4cac-a962-22b8b8f0c54d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.485170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db4016-d245-4cac-a962-22b8b8f0c54d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.485451 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db4016-d245-4cac-a962-22b8b8f0c54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.494265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 765/1563] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:39.495493 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62562b9-4e3a-4165-9664-f38059c56624 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.495778 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62562b9-4e3a-4165-9664-f38059c56624 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.496056 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62562b9-4e3a-4165-9664-f38059c56624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.503959 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-72db4016-d245-4cac-a962-22b8b8f0c54d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:39.505180 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-72db4016-d245-4cac-a962-22b8b8f0c54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:39.512982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 799/1564] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:39.513721 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db4016-d245-4cac-a962-22b8b8f0c54d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.514320 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-c62562b9-4e3a-4165-9664-f38059c56624 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:39.515473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c62562b9-4e3a-4165-9664-f38059c56624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:39.523285 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db4016-d245-4cac-a962-22b8b8f0c54d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.523754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 766/1565] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:39.524514 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62562b9-4e3a-4165-9664-f38059c56624 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.530848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3c8ad-a1a0-4c51-981e-3f6d68f19f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.532009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3c8ad-a1a0-4c51-981e-3f6d68f19f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.532891 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3c8ad-a1a0-4c51-981e-3f6d68f19f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.533198 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3c8ad-a1a0-4c51-981e-3f6d68f19f48 admin admin] PATH_INFO: `/v3/projects/6de0bef5eb0249dca3b456a89e8b3fa9/users/b1855c6320b4438aaa04013d863e789d/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.534581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62562b9-4e3a-4165-9664-f38059c56624 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.540176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d85b8-29f4-4591-9d1a-5e6442925c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.540867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d85b8-29f4-4591-9d1a-5e6442925c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.541193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d85b8-29f4-4591-9d1a-5e6442925c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.541474 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d85b8-29f4-4591-9d1a-5e6442925c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.542208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d85b8-29f4-4591-9d1a-5e6442925c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.543936 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d85b8-29f4-4591-9d1a-5e6442925c98 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.549197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3c8ad-a1a0-4c51-981e-3f6d68f19f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de0bef5eb0249dca3b456a89e8b3fa9, user_id=b1855c6320b4438aaa04013d863e789d, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.550769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-e9f3c8ad-a1a0-4c51-981e-3f6d68f19f48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:29:39.550769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: warnings.warn(msg) Jul 21 22:29:39.550769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: Jul 21 22:29:39.553746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3c8ad-a1a0-4c51-981e-3f6d68f19f48 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.554384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 767/1566] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:39.555183 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d85b8-29f4-4591-9d1a-5e6442925c98 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.565527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d85b8-29f4-4591-9d1a-5e6442925c98 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.571123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 800/1567] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:39 2022] PUT /identity/v3/projects/6de0bef5eb0249dca3b456a89e8b3fa9/users/b1855c6320b4438aaa04013d863e789d/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:39.571903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3c8ad-a1a0-4c51-981e-3f6d68f19f48 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.627372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f03656-9351-408a-ab67-211a87813a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.628053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f03656-9351-408a-ab67-211a87813a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.628436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f03656-9351-408a-ab67-211a87813a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.628640 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f03656-9351-408a-ab67-211a87813a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.629433 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f03656-9351-408a-ab67-211a87813a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:29:39.629743 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f03656-9351-408a-ab67-211a87813a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.631399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f03656-9351-408a-ab67-211a87813a13 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.638293 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3c8ad-a1a0-4c51-981e-3f6d68f19f48 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.643888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae60428-2fdb-47f6-87d5-40b5d501075b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.644660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 768/1568] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:29:39.644794 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae60428-2fdb-47f6-87d5-40b5d501075b admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.645176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae60428-2fdb-47f6-87d5-40b5d501075b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.645176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae60428-2fdb-47f6-87d5-40b5d501075b admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.645560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f03656-9351-408a-ab67-211a87813a13 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.645895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae60428-2fdb-47f6-87d5-40b5d501075b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.647847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae60428-2fdb-47f6-87d5-40b5d501075b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.659929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f03656-9351-408a-ab67-211a87813a13 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.664747 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51079ba1-9fd4-43a0-93fd-f0c8d4c19404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.665512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51079ba1-9fd4-43a0-93fd-f0c8d4c19404 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.665884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51079ba1-9fd4-43a0-93fd-f0c8d4c19404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.666128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51079ba1-9fd4-43a0-93fd-f0c8d4c19404 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.666920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51079ba1-9fd4-43a0-93fd-f0c8d4c19404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:29:39.667236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51079ba1-9fd4-43a0-93fd-f0c8d4c19404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.669009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51079ba1-9fd4-43a0-93fd-f0c8d4c19404 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.675564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 801/1569] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:39.676777 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae60428-2fdb-47f6-87d5-40b5d501075b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.682239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 769/1570] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:29:39.683077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51079ba1-9fd4-43a0-93fd-f0c8d4c19404 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.694229 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51079ba1-9fd4-43a0-93fd-f0c8d4c19404 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.740615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae60428-2fdb-47f6-87d5-40b5d501075b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.745981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6139ed9-ce5a-44b7-9914-87d43526c098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.746764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6139ed9-ce5a-44b7-9914-87d43526c098 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.747057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6139ed9-ce5a-44b7-9914-87d43526c098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.747335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6139ed9-ce5a-44b7-9914-87d43526c098 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.748063 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6139ed9-ce5a-44b7-9914-87d43526c098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:29:39.748374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6139ed9-ce5a-44b7-9914-87d43526c098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.750006 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6139ed9-ce5a-44b7-9914-87d43526c098 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.751567 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e95f5-9e72-40ba-b853-a9da885d32ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.752234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e95f5-9e72-40ba-b853-a9da885d32ac admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.752514 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e95f5-9e72-40ba-b853-a9da885d32ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.752790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e95f5-9e72-40ba-b853-a9da885d32ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.753576 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e95f5-9e72-40ba-b853-a9da885d32ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:29:39.753886 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e95f5-9e72-40ba-b853-a9da885d32ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.755523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e95f5-9e72-40ba-b853-a9da885d32ac admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.762492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 802/1571] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:29:39.765956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6139ed9-ce5a-44b7-9914-87d43526c098 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.775563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 770/1572] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:29:39.775563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e95f5-9e72-40ba-b853-a9da885d32ac admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.776825 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6139ed9-ce5a-44b7-9914-87d43526c098 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.780821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e95f5-9e72-40ba-b853-a9da885d32ac admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.782008 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d881643-851f-478e-9eca-b04321392027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.782676 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d881643-851f-478e-9eca-b04321392027 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.782965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d881643-851f-478e-9eca-b04321392027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.783248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d881643-851f-478e-9eca-b04321392027 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.784135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d881643-851f-478e-9eca-b04321392027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:29:39.784447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d881643-851f-478e-9eca-b04321392027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.785825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d7a6e-0771-4361-83fd-aef359cf2036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.786115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d881643-851f-478e-9eca-b04321392027 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.786695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d7a6e-0771-4361-83fd-aef359cf2036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.786978 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d7a6e-0771-4361-83fd-aef359cf2036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.787254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d7a6e-0771-4361-83fd-aef359cf2036 admin admin] PATH_INFO: `/v3/projects/53fd701459624b60b0d3e5fc72e76a17/users/985006f41c1d484aac532ed38b03e3df/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.798884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 803/1573] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:29:39.800111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcb613-dcea-4308-9bda-b6375df2d77b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.800406 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcb613-dcea-4308-9bda-b6375df2d77b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.800687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcb613-dcea-4308-9bda-b6375df2d77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.806356 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d7a6e-0771-4361-83fd-aef359cf2036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53fd701459624b60b0d3e5fc72e76a17, user_id=985006f41c1d484aac532ed38b03e3df, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.809069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d7a6e-0771-4361-83fd-aef359cf2036 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.822262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-bfdcb613-dcea-4308-9bda-b6375df2d77b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:39.823151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 771/1574] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:39 2022] PUT /identity/v3/projects/53fd701459624b60b0d3e5fc72e76a17/users/985006f41c1d484aac532ed38b03e3df/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:39.823478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bfdcb613-dcea-4308-9bda-b6375df2d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:39.823756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d7a6e-0771-4361-83fd-aef359cf2036 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.835862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:39.854691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:39.889281 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d7a6e-0771-4361-83fd-aef359cf2036 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.893932 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab58de-8c67-447d-89e9-34ff7626bec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.894625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab58de-8c67-447d-89e9-34ff7626bec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.894764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 804/1575] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:39.894975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab58de-8c67-447d-89e9-34ff7626bec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.895166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab58de-8c67-447d-89e9-34ff7626bec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.895860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab58de-8c67-447d-89e9-34ff7626bec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.897791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab58de-8c67-447d-89e9-34ff7626bec3 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.897922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcb613-dcea-4308-9bda-b6375df2d77b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.910673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcb613-dcea-4308-9bda-b6375df2d77b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.915905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e4578-cc61-4fa9-9c99-6501e31d3659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.916645 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e4578-cc61-4fa9-9c99-6501e31d3659 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.916985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e4578-cc61-4fa9-9c99-6501e31d3659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.917345 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e4578-cc61-4fa9-9c99-6501e31d3659 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.918047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e4578-cc61-4fa9-9c99-6501e31d3659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.920044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e4578-cc61-4fa9-9c99-6501e31d3659 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:39.929530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 772/1576] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:39.929530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab58de-8c67-447d-89e9-34ff7626bec3 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.943832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 805/1577] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:39.943832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e4578-cc61-4fa9-9c99-6501e31d3659 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:39.951012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e4578-cc61-4fa9-9c99-6501e31d3659 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.991423 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab58de-8c67-447d-89e9-34ff7626bec3 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:39.996029 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e7e74-1aa8-4ccb-9277-bf71655e960c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:39.996691 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e7e74-1aa8-4ccb-9277-bf71655e960c admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:39.997006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e7e74-1aa8-4ccb-9277-bf71655e960c admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:39.997288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e7e74-1aa8-4ccb-9277-bf71655e960c admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:39.997980 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e7e74-1aa8-4ccb-9277-bf71655e960c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:39.999886 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e7e74-1aa8-4ccb-9277-bf71655e960c admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.007625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6aad0-1a86-4352-98dc-2ca037ca4461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.008286 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6aad0-1a86-4352-98dc-2ca037ca4461 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.008585 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6aad0-1a86-4352-98dc-2ca037ca4461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.008847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6aad0-1a86-4352-98dc-2ca037ca4461 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.009570 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6aad0-1a86-4352-98dc-2ca037ca4461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.011463 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6aad0-1a86-4352-98dc-2ca037ca4461 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.027070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 773/1578] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:40.027918 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e7e74-1aa8-4ccb-9277-bf71655e960c admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.041153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 806/1579] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:29:39 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:40.045198 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6aad0-1a86-4352-98dc-2ca037ca4461 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.093469 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e7e74-1aa8-4ccb-9277-bf71655e960c admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.108147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6aad0-1a86-4352-98dc-2ca037ca4461 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.113005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d576474-065c-4c10-b9be-daf585064ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.113668 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d576474-065c-4c10-b9be-daf585064ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.113952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d576474-065c-4c10-b9be-daf585064ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.114234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d576474-065c-4c10-b9be-daf585064ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.114913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d576474-065c-4c10-b9be-daf585064ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.116825 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d576474-065c-4c10-b9be-daf585064ec0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.118417 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:40.142172 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 807/1580] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:29:40 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:40.143763 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eb5d7-18a4-4539-969e-89f68f763478 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.144053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eb5d7-18a4-4539-969e-89f68f763478 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.144333 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eb5d7-18a4-4539-969e-89f68f763478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.154040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032491a-8829-4a90-b4c1-b770f2b46a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.154755 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032491a-8829-4a90-b4c1-b770f2b46a9f admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.155040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032491a-8829-4a90-b4c1-b770f2b46a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.155319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032491a-8829-4a90-b4c1-b770f2b46a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.156265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032491a-8829-4a90-b4c1-b770f2b46a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.158232 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032491a-8829-4a90-b4c1-b770f2b46a9f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.161354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d67eb5d7-18a4-4539-969e-89f68f763478 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:40.162551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d67eb5d7-18a4-4539-969e-89f68f763478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:40.183525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:40.184876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 774/1581] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:29:40 2022] POST /identity/v3/projects => generated 405 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:40.185862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032491a-8829-4a90-b4c1-b770f2b46a9f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.224152 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 808/1582] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:40.225242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eb5d7-18a4-4539-969e-89f68f763478 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.235615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eb5d7-18a4-4539-969e-89f68f763478 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.244047 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032491a-8829-4a90-b4c1-b770f2b46a9f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.247753 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83cd01-d14b-44b5-abfd-163b763c2846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.248413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83cd01-d14b-44b5-abfd-163b763c2846 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.248699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83cd01-d14b-44b5-abfd-163b763c2846 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.249004 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83cd01-d14b-44b5-abfd-163b763c2846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.290578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca778311-18b7-4ce6-9565-3759ce2c78e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.291244 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca778311-18b7-4ce6-9565-3759ce2c78e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.291529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca778311-18b7-4ce6-9565-3759ce2c78e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.291811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca778311-18b7-4ce6-9565-3759ce2c78e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.292495 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca778311-18b7-4ce6-9565-3759ce2c78e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.294442 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca778311-18b7-4ce6-9565-3759ce2c78e9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.311671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83cd01-d14b-44b5-abfd-163b763c2846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.313873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83cd01-d14b-44b5-abfd-163b763c2846 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.316740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 809/1583] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:29:40 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:40.317583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca778311-18b7-4ce6-9565-3759ce2c78e9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.327192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 775/1584] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:40.327401 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca778311-18b7-4ce6-9565-3759ce2c78e9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.327984 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83cd01-d14b-44b5-abfd-163b763c2846 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.332064 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58c25d-d6b2-488e-877f-816aa22b440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.332741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58c25d-d6b2-488e-877f-816aa22b440b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.333057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58c25d-d6b2-488e-877f-816aa22b440b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.333338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58c25d-d6b2-488e-877f-816aa22b440b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.334078 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58c25d-d6b2-488e-877f-816aa22b440b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.335671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58c25d-d6b2-488e-877f-816aa22b440b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.337709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83cd01-d14b-44b5-abfd-163b763c2846 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.343802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb3c64-33eb-475e-882b-1113f57d08cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.344606 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb3c64-33eb-475e-882b-1113f57d08cf admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.345127 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb3c64-33eb-475e-882b-1113f57d08cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.345589 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb3c64-33eb-475e-882b-1113f57d08cf admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.346344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb3c64-33eb-475e-882b-1113f57d08cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.349983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 810/1585] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:40.349983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58c25d-d6b2-488e-877f-816aa22b440b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.350204 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb3c64-33eb-475e-882b-1113f57d08cf admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.361222 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58c25d-d6b2-488e-877f-816aa22b440b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.366982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d5702-7674-4aad-90ac-cb40cbb197c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.367807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d5702-7674-4aad-90ac-cb40cbb197c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.368118 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d5702-7674-4aad-90ac-cb40cbb197c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.368633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d5702-7674-4aad-90ac-cb40cbb197c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.369148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d5702-7674-4aad-90ac-cb40cbb197c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.371115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d5702-7674-4aad-90ac-cb40cbb197c9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.377150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 776/1586] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:29:40 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:40.377150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb3c64-33eb-475e-882b-1113f57d08cf admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.387748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb3c64-33eb-475e-882b-1113f57d08cf admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.393669 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af986796-e0d6-446b-93b9-f777009660fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.394241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af986796-e0d6-446b-93b9-f777009660fb admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.397857 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 811/1587] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:29:40 2022] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:40.398009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af986796-e0d6-446b-93b9-f777009660fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.398009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af986796-e0d6-446b-93b9-f777009660fb admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.398220 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d5702-7674-4aad-90ac-cb40cbb197c9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.398322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af986796-e0d6-446b-93b9-f777009660fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.398322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af986796-e0d6-446b-93b9-f777009660fb admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.408261 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d5702-7674-4aad-90ac-cb40cbb197c9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.415642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b01896-b803-4261-8c07-a0eccca0b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.416386 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b01896-b803-4261-8c07-a0eccca0b924 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.416673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b01896-b803-4261-8c07-a0eccca0b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.417060 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b01896-b803-4261-8c07-a0eccca0b924 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.417767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b01896-b803-4261-8c07-a0eccca0b924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.419807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b01896-b803-4261-8c07-a0eccca0b924 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.423692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 777/1588] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:29:40 2022] POST /identity/v3/users => generated 296 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:40.424784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af986796-e0d6-446b-93b9-f777009660fb admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.428096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-af986796-e0d6-446b-93b9-f777009660fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:40.441588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af986796-e0d6-446b-93b9-f777009660fb admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.445456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198eb4d-78d8-46c7-8cb8-0a8a0ff013c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.446108 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198eb4d-78d8-46c7-8cb8-0a8a0ff013c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.446417 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198eb4d-78d8-46c7-8cb8-0a8a0ff013c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.446735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198eb4d-78d8-46c7-8cb8-0a8a0ff013c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.450544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 812/1589] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:29:40 2022] POST /identity/v3/users => generated 303 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:40.451581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b01896-b803-4261-8c07-a0eccca0b924 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.456728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198eb4d-78d8-46c7-8cb8-0a8a0ff013c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.458302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198eb4d-78d8-46c7-8cb8-0a8a0ff013c8 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.466350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b01896-b803-4261-8c07-a0eccca0b924 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.469732 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 778/1590] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:40.471911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349f292-e3a4-4184-a6f5-98d7bdea54fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.472608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349f292-e3a4-4184-a6f5-98d7bdea54fd admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.472897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349f292-e3a4-4184-a6f5-98d7bdea54fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.473215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349f292-e3a4-4184-a6f5-98d7bdea54fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.473944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349f292-e3a4-4184-a6f5-98d7bdea54fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.475698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349f292-e3a4-4184-a6f5-98d7bdea54fd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.479269 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198eb4d-78d8-46c7-8cb8-0a8a0ff013c8 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.492624 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 813/1591] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:40.493532 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198eb4d-78d8-46c7-8cb8-0a8a0ff013c8 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.494448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349f292-e3a4-4184-a6f5-98d7bdea54fd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.499758 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f009c3a-fd20-4caa-b5e1-62c860454ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.500501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f009c3a-fd20-4caa-b5e1-62c860454ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.500887 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f009c3a-fd20-4caa-b5e1-62c860454ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.501232 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f009c3a-fd20-4caa-b5e1-62c860454ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.501990 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f009c3a-fd20-4caa-b5e1-62c860454ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.503596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f009c3a-fd20-4caa-b5e1-62c860454ca2 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.507842 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349f292-e3a4-4184-a6f5-98d7bdea54fd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.515532 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 779/1592] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:40.515831 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a4b9c-ce55-49c3-aa5c-578da9c57d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.516918 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f009c3a-fd20-4caa-b5e1-62c860454ca2 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.517588 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a4b9c-ce55-49c3-aa5c-578da9c57d92 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.518140 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a4b9c-ce55-49c3-aa5c-578da9c57d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.518728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a4b9c-ce55-49c3-aa5c-578da9c57d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.522989 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a4b9c-ce55-49c3-aa5c-578da9c57d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.524596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:40.526018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a4b9c-ce55-49c3-aa5c-578da9c57d92 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.528936 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f009c3a-fd20-4caa-b5e1-62c860454ca2 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.536966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea9e1e-8fe5-4711-ba8b-0e9a5d83a042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.537763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9e1e-8fe5-4711-ba8b-0e9a5d83a042 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.538115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9e1e-8fe5-4711-ba8b-0e9a5d83a042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.538482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9e1e-8fe5-4711-ba8b-0e9a5d83a042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.539374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea9e1e-8fe5-4711-ba8b-0e9a5d83a042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.541439 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea9e1e-8fe5-4711-ba8b-0e9a5d83a042 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.546200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 814/1593] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:40.547202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a4b9c-ce55-49c3-aa5c-578da9c57d92 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.560134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 780/1594] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:40.560772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a4b9c-ce55-49c3-aa5c-578da9c57d92 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.561294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea9e1e-8fe5-4711-ba8b-0e9a5d83a042 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.568808 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75239ef6-9fd1-4234-a9a9-81dbac67f56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.569649 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75239ef6-9fd1-4234-a9a9-81dbac67f56a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.570053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75239ef6-9fd1-4234-a9a9-81dbac67f56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.570583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75239ef6-9fd1-4234-a9a9-81dbac67f56a admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.571421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75239ef6-9fd1-4234-a9a9-81dbac67f56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.573314 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75239ef6-9fd1-4234-a9a9-81dbac67f56a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.573986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea9e1e-8fe5-4711-ba8b-0e9a5d83a042 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.580914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c066628-05ea-421b-8e3b-a1e1aef286be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.581913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c066628-05ea-421b-8e3b-a1e1aef286be admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.582366 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c066628-05ea-421b-8e3b-a1e1aef286be admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.582912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c066628-05ea-421b-8e3b-a1e1aef286be admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.583851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c066628-05ea-421b-8e3b-a1e1aef286be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.585835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c066628-05ea-421b-8e3b-a1e1aef286be admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.588844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 815/1595] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:40.589910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75239ef6-9fd1-4234-a9a9-81dbac67f56a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.602540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 781/1596] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:40.603200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75239ef6-9fd1-4234-a9a9-81dbac67f56a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.603421 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c066628-05ea-421b-8e3b-a1e1aef286be admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.609446 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13293008-b23a-44be-8ab4-534039a6d505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.611092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13293008-b23a-44be-8ab4-534039a6d505 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.611482 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13293008-b23a-44be-8ab4-534039a6d505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.612056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13293008-b23a-44be-8ab4-534039a6d505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.612910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13293008-b23a-44be-8ab4-534039a6d505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.614567 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c066628-05ea-421b-8e3b-a1e1aef286be admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.616957 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13293008-b23a-44be-8ab4-534039a6d505 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.622629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6571fbe-ee42-4274-aa45-418ff48682a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.623756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571fbe-ee42-4274-aa45-418ff48682a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.624211 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571fbe-ee42-4274-aa45-418ff48682a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.624850 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571fbe-ee42-4274-aa45-418ff48682a3 admin admin] PATH_INFO: `/v3/projects/26ea7972dae048e3882c0542a0295300/users/17eceb8b4f114afe81ed68ee640174e4/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.629804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 816/1597] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:40.630806 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13293008-b23a-44be-8ab4-534039a6d505 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.642282 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13293008-b23a-44be-8ab4-534039a6d505 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.647950 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6571fbe-ee42-4274-aa45-418ff48682a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ea7972dae048e3882c0542a0295300, user_id=17eceb8b4f114afe81ed68ee640174e4, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.648077 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea83203-0ca8-4168-a899-6b0c0b6ca9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.648773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea83203-0ca8-4168-a899-6b0c0b6ca9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.649165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea83203-0ca8-4168-a899-6b0c0b6ca9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.649509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea83203-0ca8-4168-a899-6b0c0b6ca9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.650934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6571fbe-ee42-4274-aa45-418ff48682a3 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.651226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea83203-0ca8-4168-a899-6b0c0b6ca9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.652906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea83203-0ca8-4168-a899-6b0c0b6ca9e7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.668011 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 817/1598] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:40.668011 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea83203-0ca8-4168-a899-6b0c0b6ca9e7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.679669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea83203-0ca8-4168-a899-6b0c0b6ca9e7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.681320 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 782/1599] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:40 2022] PUT /identity/v3/projects/26ea7972dae048e3882c0542a0295300/users/17eceb8b4f114afe81ed68ee640174e4/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:40.683191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6571fbe-ee42-4274-aa45-418ff48682a3 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.700347 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:40.769082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f497dd6-8580-41b1-adbb-780739c20456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.769893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f497dd6-8580-41b1-adbb-780739c20456 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.770274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f497dd6-8580-41b1-adbb-780739c20456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.770647 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f497dd6-8580-41b1-adbb-780739c20456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.771478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f497dd6-8580-41b1-adbb-780739c20456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.773370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6571fbe-ee42-4274-aa45-418ff48682a3 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.774133 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f497dd6-8580-41b1-adbb-780739c20456 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.780509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a71f0-61d1-4a2a-a7bb-d5a7ab9b2b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.781486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a71f0-61d1-4a2a-a7bb-d5a7ab9b2b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.781783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a71f0-61d1-4a2a-a7bb-d5a7ab9b2b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.782562 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a71f0-61d1-4a2a-a7bb-d5a7ab9b2b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.783544 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a71f0-61d1-4a2a-a7bb-d5a7ab9b2b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.785330 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a71f0-61d1-4a2a-a7bb-d5a7ab9b2b50 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.795057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 818/1600] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:40.796409 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f497dd6-8580-41b1-adbb-780739c20456 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.797072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 783/1601] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:40.798982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a71f0-61d1-4a2a-a7bb-d5a7ab9b2b50 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.812307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a71f0-61d1-4a2a-a7bb-d5a7ab9b2b50 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.815082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f497dd6-8580-41b1-adbb-780739c20456 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.820432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104f6bd-19a3-4e9a-8749-0e78a2010a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.821383 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104f6bd-19a3-4e9a-8749-0e78a2010a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.822131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104f6bd-19a3-4e9a-8749-0e78a2010a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.822131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104f6bd-19a3-4e9a-8749-0e78a2010a9b admin admin] PATH_INFO: `/v3/projects/d4169b85337e4c758716b520fee5db82/users/351452a1182d491494aac5e8fdef41db/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.824193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b27002-cb58-4aed-917f-7290a7430eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.825269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b27002-cb58-4aed-917f-7290a7430eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.826638 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b27002-cb58-4aed-917f-7290a7430eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.827228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b27002-cb58-4aed-917f-7290a7430eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.828528 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b27002-cb58-4aed-917f-7290a7430eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.831305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b27002-cb58-4aed-917f-7290a7430eb6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.839914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104f6bd-19a3-4e9a-8749-0e78a2010a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4169b85337e4c758716b520fee5db82, user_id=351452a1182d491494aac5e8fdef41db, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:40.843554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104f6bd-19a3-4e9a-8749-0e78a2010a9b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:40.854078 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 819/1602] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:40.855143 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b27002-cb58-4aed-917f-7290a7430eb6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:40.868882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b27002-cb58-4aed-917f-7290a7430eb6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:40.873477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 784/1603] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:40 2022] PUT /identity/v3/projects/d4169b85337e4c758716b520fee5db82/users/351452a1182d491494aac5e8fdef41db/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:40.878447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69dea5-b683-44ea-a6d0-dd8b17d84e3d None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.878844 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69dea5-b683-44ea-a6d0-dd8b17d84e3d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.879228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69dea5-b683-44ea-a6d0-dd8b17d84e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:40.919083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-0f69dea5-b683-44ea-a6d0-dd8b17d84e3d None None] MFA Rules not processed for user `17eceb8b4f114afe81ed68ee640174e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:40.920360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0f69dea5-b683-44ea-a6d0-dd8b17d84e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:40.973388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8823783-b2db-4972-a603-e11da69323ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:40.974398 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8823783-b2db-4972-a603-e11da69323ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:40.974711 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8823783-b2db-4972-a603-e11da69323ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:40.974954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8823783-b2db-4972-a603-e11da69323ec admin admin] PATH_INFO: `/v3/projects/998e34a4434240f28c48cde8f99f974a/users/0ab0db1bbc72471a90bbfc2e47561a26/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.007469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8823783-b2db-4972-a603-e11da69323ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=998e34a4434240f28c48cde8f99f974a, user_id=0ab0db1bbc72471a90bbfc2e47561a26, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:41.010475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8823783-b2db-4972-a603-e11da69323ec admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:41.027076 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 785/1604] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:41.028413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69dea5-b683-44ea-a6d0-dd8b17d84e3d None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:41.037908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 820/1605] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:40 2022] PUT /identity/v3/projects/998e34a4434240f28c48cde8f99f974a/users/0ab0db1bbc72471a90bbfc2e47561a26/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:41.037908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8823783-b2db-4972-a603-e11da69323ec admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:41.056388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69dea5-b683-44ea-a6d0-dd8b17d84e3d None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:41.084967 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:41.136174 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bc2f9-9b7f-4ea0-8a8b-eed0d4243fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:41.137312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bc2f9-9b7f-4ea0-8a8b-eed0d4243fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.137577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bc2f9-9b7f-4ea0-8a8b-eed0d4243fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.137896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bc2f9-9b7f-4ea0-8a8b-eed0d4243fe0 admin admin] PATH_INFO: `/v3/projects/ab913bcc118d4629bc5056cded841663/users/8263e9d4deae42849293088c47439093/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.153251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8823783-b2db-4972-a603-e11da69323ec admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:41.155294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bc2f9-9b7f-4ea0-8a8b-eed0d4243fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab913bcc118d4629bc5056cded841663, user_id=8263e9d4deae42849293088c47439093, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:41.159216 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bc2f9-9b7f-4ea0-8a8b-eed0d4243fe0 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:41.160392 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402161d2-9e08-460c-b27b-80e9b18fe061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:41.161515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402161d2-9e08-460c-b27b-80e9b18fe061 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.161918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402161d2-9e08-460c-b27b-80e9b18fe061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.162268 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402161d2-9e08-460c-b27b-80e9b18fe061 admin admin] PATH_INFO: `/v3/projects/2bf549cae6ec41c2a5638ca0d10d4a99/users/1e24364e59144eae846d5a5efa260dba/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.188798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 786/1606] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:41 2022] PUT /identity/v3/projects/ab913bcc118d4629bc5056cded841663/users/8263e9d4deae42849293088c47439093/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:41.188798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bc2f9-9b7f-4ea0-8a8b-eed0d4243fe0 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:41.194417 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402161d2-9e08-460c-b27b-80e9b18fe061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf549cae6ec41c2a5638ca0d10d4a99, user_id=1e24364e59144eae846d5a5efa260dba, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:41.199621 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402161d2-9e08-460c-b27b-80e9b18fe061 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:41.216275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 821/1607] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:41 2022] PUT /identity/v3/projects/2bf549cae6ec41c2a5638ca0d10d4a99/users/1e24364e59144eae846d5a5efa260dba/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:41.221941 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e129ad-a1bc-45a7-bee7-90bc1767e0bc None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.222230 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e129ad-a1bc-45a7-bee7-90bc1767e0bc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.222570 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e129ad-a1bc-45a7-bee7-90bc1767e0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.236311 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:41.267343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c0e129ad-a1bc-45a7-bee7-90bc1767e0bc None None] MFA Rules not processed for user `351452a1182d491494aac5e8fdef41db`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:41.269164 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c0e129ad-a1bc-45a7-bee7-90bc1767e0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:41.286119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bc2f9-9b7f-4ea0-8a8b-eed0d4243fe0 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:41.375554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 822/1608] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:41.375554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e129ad-a1bc-45a7-bee7-90bc1767e0bc None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:41.380665 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb833653-99c6-4bf8-a1b5-b9b1740a33bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:41.381921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb833653-99c6-4bf8-a1b5-b9b1740a33bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.383301 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb833653-99c6-4bf8-a1b5-b9b1740a33bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.383759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb833653-99c6-4bf8-a1b5-b9b1740a33bf admin admin] PATH_INFO: `/v3/projects/17ef5dffe957476dae7f714a35a3805e/users/236b373627eb41d385fcf53696da039d/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.402422 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e129ad-a1bc-45a7-bee7-90bc1767e0bc None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:41.412077 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67394782-0dc2-436c-afe1-ed17441a91d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:41.413056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67394782-0dc2-436c-afe1-ed17441a91d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.413503 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67394782-0dc2-436c-afe1-ed17441a91d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.413937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67394782-0dc2-436c-afe1-ed17441a91d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.414929 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67394782-0dc2-436c-afe1-ed17441a91d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:41.416400 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb833653-99c6-4bf8-a1b5-b9b1740a33bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ef5dffe957476dae7f714a35a3805e, user_id=236b373627eb41d385fcf53696da039d, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:41.417419 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67394782-0dc2-436c-afe1-ed17441a91d8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:41.420410 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb833653-99c6-4bf8-a1b5-b9b1740a33bf admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:41.462681 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 787/1609] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:41 2022] PUT /identity/v3/projects/17ef5dffe957476dae7f714a35a3805e/users/236b373627eb41d385fcf53696da039d/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:41.464392 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b99ed-f7e4-4a18-80bd-aa67976c51e3 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.464853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b99ed-f7e4-4a18-80bd-aa67976c51e3 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.465305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b99ed-f7e4-4a18-80bd-aa67976c51e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.481198 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 823/1610] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:29:41 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:41.488451 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e046e-b030-479e-aaff-e3d873d38823 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.488745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e046e-b030-479e-aaff-e3d873d38823 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.489097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e046e-b030-479e-aaff-e3d873d38823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.496523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-0c0b99ed-f7e4-4a18-80bd-aa67976c51e3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:41.498109 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0c0b99ed-f7e4-4a18-80bd-aa67976c51e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:41.552438 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-410e046e-b030-479e-aaff-e3d873d38823 None None] MFA Rules not processed for user `8263e9d4deae42849293088c47439093`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:41.554242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-410e046e-b030-479e-aaff-e3d873d38823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:41.571143 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:41.634540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 788/1611] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:41.634540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8904912-b002-4826-b440-8003fb2d6297 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.634540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8904912-b002-4826-b440-8003fb2d6297 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.634540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8904912-b002-4826-b440-8003fb2d6297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.665134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-d8904912-b002-4826-b440-8003fb2d6297 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:41.667309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-d8904912-b002-4826-b440-8003fb2d6297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:41.678166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 789/1612] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:41.679433 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8904912-b002-4826-b440-8003fb2d6297 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:41.691022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 824/1613] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:41.692318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2c2dc-6921-4260-883b-e0ed871e4ff8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.692604 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2c2dc-6921-4260-883b-e0ed871e4ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.692882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2c2dc-6921-4260-883b-e0ed871e4ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.730106 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0cd2c2dc-6921-4260-883b-e0ed871e4ff8 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:41.731380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0cd2c2dc-6921-4260-883b-e0ed871e4ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:41.752362 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 825/1614] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:41.756523 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2c2dc-6921-4260-883b-e0ed871e4ff8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:41.780812 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2c2dc-6921-4260-883b-e0ed871e4ff8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:41.792879 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a83c3-0c17-4b01-82ec-d4896ac1f6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:41.793705 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a83c3-0c17-4b01-82ec-d4896ac1f6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.795106 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a83c3-0c17-4b01-82ec-d4896ac1f6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.796745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a83c3-0c17-4b01-82ec-d4896ac1f6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.796745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a83c3-0c17-4b01-82ec-d4896ac1f6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:41.802818 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a83c3-0c17-4b01-82ec-d4896ac1f6c8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:41.804448 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8904912-b002-4826-b440-8003fb2d6297 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:41.810994 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bb9ce-33c1-47d0-b4fc-f786a0d7c3cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:41.812826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bb9ce-33c1-47d0-b4fc-f786a0d7c3cd service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.813193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bb9ce-33c1-47d0-b4fc-f786a0d7c3cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.814205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bb9ce-33c1-47d0-b4fc-f786a0d7c3cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.848793 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 826/1615] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:29:41 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:41.849794 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a83c3-0c17-4b01-82ec-d4896ac1f6c8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:41.949878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:41.964685 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bb9ce-33c1-47d0-b4fc-f786a0d7c3cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:41.966940 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bb9ce-33c1-47d0-b4fc-f786a0d7c3cd service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:41.967431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a83c3-0c17-4b01-82ec-d4896ac1f6c8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:41.979490 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48e696-7900-4767-878a-62ae0629daaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:41.980257 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48e696-7900-4767-878a-62ae0629daaf service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.980603 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48e696-7900-4767-878a-62ae0629daaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.980965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48e696-7900-4767-878a-62ae0629daaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.981630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 790/1616] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:41.983250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b2857-455c-4bd3-a6bf-6377d00d18b7 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:41.983549 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b2857-455c-4bd3-a6bf-6377d00d18b7 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:41.983836 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b2857-455c-4bd3-a6bf-6377d00d18b7 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:41.986014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 791/1617] 10.222.0.43 () {54 vars in 962 bytes} [Thu Jul 21 22:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:41.986169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b2857-455c-4bd3-a6bf-6377d00d18b7 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:42.009001 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b2857-455c-4bd3-a6bf-6377d00d18b7 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:42.012172 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48e696-7900-4767-878a-62ae0629daaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:42.017684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098e85c-2f68-4fb3-9557-ae0ed21027cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:42.018369 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098e85c-2f68-4fb3-9557-ae0ed21027cb service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:42.018766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098e85c-2f68-4fb3-9557-ae0ed21027cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:42.019049 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098e85c-2f68-4fb3-9557-ae0ed21027cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:42.033456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48e696-7900-4767-878a-62ae0629daaf service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:42.047300 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098e85c-2f68-4fb3-9557-ae0ed21027cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:42.049120 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098e85c-2f68-4fb3-9557-ae0ed21027cb service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:42.068242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 827/1618] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:42.070675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48e696-7900-4767-878a-62ae0629daaf service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:42.080181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 792/1619] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:42.081203 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098e85c-2f68-4fb3-9557-ae0ed21027cb service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:42.090352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48e696-7900-4767-878a-62ae0629daaf service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:42.093071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098e85c-2f68-4fb3-9557-ae0ed21027cb service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:42.098907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611abc2-ed8f-455a-9c9e-282ba366d6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:42.099823 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611abc2-ed8f-455a-9c9e-282ba366d6af admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:42.100470 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611abc2-ed8f-455a-9c9e-282ba366d6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:42.101024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611abc2-ed8f-455a-9c9e-282ba366d6af admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:42.101343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a0dd7-2189-41f9-a5cc-eb5e3dfc72c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:42.102116 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a0dd7-2189-41f9-a5cc-eb5e3dfc72c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:42.102305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611abc2-ed8f-455a-9c9e-282ba366d6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:42.102586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a0dd7-2189-41f9-a5cc-eb5e3dfc72c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:42.102958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a0dd7-2189-41f9-a5cc-eb5e3dfc72c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:42.104646 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611abc2-ed8f-455a-9c9e-282ba366d6af admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:42.121327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 793/1620] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:42.123582 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14c34c-a598-4ca3-adf3-b02272b48ba7 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:42.124057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14c34c-a598-4ca3-adf3-b02272b48ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:42.124816 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14c34c-a598-4ca3-adf3-b02272b48ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:42.131480 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a0dd7-2189-41f9-a5cc-eb5e3dfc72c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:42.133314 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a0dd7-2189-41f9-a5cc-eb5e3dfc72c0 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:42.158821 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 828/1621] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:42.160379 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a0dd7-2189-41f9-a5cc-eb5e3dfc72c0 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:42.179696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a0dd7-2189-41f9-a5cc-eb5e3dfc72c0 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:42.187885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca2fce-cbb8-4e2e-ad25-55d61f0bf854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:42.190339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca2fce-cbb8-4e2e-ad25-55d61f0bf854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:42.190633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca2fce-cbb8-4e2e-ad25-55d61f0bf854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:42.190916 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca2fce-cbb8-4e2e-ad25-55d61f0bf854 admin admin] PATH_INFO: `/v3/projects/90dc47c0420346a3919844402066ae70/users/83e6c6a7f0e44ffc8a12de61e1afca35/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:42.227299 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-9e14c34c-a598-4ca3-adf3-b02272b48ba7 None None] MFA Rules not processed for user `2c04dc3ee4484afaab388cbb306974af`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:42.234985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9e14c34c-a598-4ca3-adf3-b02272b48ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:42.247455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca2fce-cbb8-4e2e-ad25-55d61f0bf854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90dc47c0420346a3919844402066ae70, user_id=83e6c6a7f0e44ffc8a12de61e1afca35, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:42.250304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca2fce-cbb8-4e2e-ad25-55d61f0bf854 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:42.284079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 829/1622] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:42 2022] PUT /identity/v3/projects/90dc47c0420346a3919844402066ae70/users/83e6c6a7f0e44ffc8a12de61e1afca35/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:42.287416 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca2fce-cbb8-4e2e-ad25-55d61f0bf854 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:42.343971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:42.393877 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca2fce-cbb8-4e2e-ad25-55d61f0bf854 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:42.399580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e40b3-87b5-4c1e-be36-88b40b4ebf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:42.400625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e40b3-87b5-4c1e-be36-88b40b4ebf0a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:42.401292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e40b3-87b5-4c1e-be36-88b40b4ebf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:42.401676 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e40b3-87b5-4c1e-be36-88b40b4ebf0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:42.402556 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e40b3-87b5-4c1e-be36-88b40b4ebf0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:42.405115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e40b3-87b5-4c1e-be36-88b40b4ebf0a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:42.418966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 794/1623] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Jul 21 22:29:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:42.420733 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 830/1624] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:42.425232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e40b3-87b5-4c1e-be36-88b40b4ebf0a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:42.430992 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14c34c-a598-4ca3-adf3-b02272b48ba7 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:42.439753 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e40b3-87b5-4c1e-be36-88b40b4ebf0a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:42.447631 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e90c52-0285-48a8-939c-15a7aba51e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:42.449498 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e90c52-0285-48a8-939c-15a7aba51e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:42.450339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e90c52-0285-48a8-939c-15a7aba51e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:42.450844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e90c52-0285-48a8-939c-15a7aba51e2d admin admin] PATH_INFO: `/v3/projects/90dc47c0420346a3919844402066ae70/users/83e6c6a7f0e44ffc8a12de61e1afca35/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:42.455719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e90c52-0285-48a8-939c-15a7aba51e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90dc47c0420346a3919844402066ae70, user_id=83e6c6a7f0e44ffc8a12de61e1afca35, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:42.460041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e90c52-0285-48a8-939c-15a7aba51e2d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:42.460578 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14c34c-a598-4ca3-adf3-b02272b48ba7 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:42.491591 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 831/1625] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:42 2022] PUT /identity/v3/projects/90dc47c0420346a3919844402066ae70/users/83e6c6a7f0e44ffc8a12de61e1afca35/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:29:42.493781 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccaa9c-81d2-461c-af4c-9ff3afe3d0b3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:42.494230 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccaa9c-81d2-461c-af4c-9ff3afe3d0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:42.494692 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccaa9c-81d2-461c-af4c-9ff3afe3d0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:42.574159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b0633-06d0-4b77-b102-cac17ad42964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:42.574981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b0633-06d0-4b77-b102-cac17ad42964 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:42.575320 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b0633-06d0-4b77-b102-cac17ad42964 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:42.575737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b0633-06d0-4b77-b102-cac17ad42964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:42.590430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1eccaa9c-81d2-461c-af4c-9ff3afe3d0b3 None None] MFA Rules not processed for user `83e6c6a7f0e44ffc8a12de61e1afca35`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:42.593849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1eccaa9c-81d2-461c-af4c-9ff3afe3d0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:42.655252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b0633-06d0-4b77-b102-cac17ad42964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:42.659336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b0633-06d0-4b77-b102-cac17ad42964 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:42.684548 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 795/1626] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:42.802603 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 832/1627] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:29:42.823576 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b0633-06d0-4b77-b102-cac17ad42964 service nova] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:42.952716 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b0633-06d0-4b77-b102-cac17ad42964 service nova] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:43.007182 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:43.032919 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973c1a7-8db3-461b-8e9e-b8c6d4415728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:43.033632 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973c1a7-8db3-461b-8e9e-b8c6d4415728 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:43.033918 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973c1a7-8db3-461b-8e9e-b8c6d4415728 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:43.034577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973c1a7-8db3-461b-8e9e-b8c6d4415728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:43.076751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973c1a7-8db3-461b-8e9e-b8c6d4415728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:43.079607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973c1a7-8db3-461b-8e9e-b8c6d4415728 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:43.104947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 796/1628] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:43.338398 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccaa9c-81d2-461c-af4c-9ff3afe3d0b3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:43.353709 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccaa9c-81d2-461c-af4c-9ff3afe3d0b3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:43.357747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feace2f6-f4f4-4a81-94da-045b6f075da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:43.359875 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feace2f6-f4f4-4a81-94da-045b6f075da5 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:43.360725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feace2f6-f4f4-4a81-94da-045b6f075da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:43.361534 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feace2f6-f4f4-4a81-94da-045b6f075da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:43.379047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:43.471589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feace2f6-f4f4-4a81-94da-045b6f075da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:43.473584 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feace2f6-f4f4-4a81-94da-045b6f075da5 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:43.485768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 833/1629] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:43.607090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d2589-6ca4-4ef5-b87f-6b05816097e4 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:43.607090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d2589-6ca4-4ef5-b87f-6b05816097e4 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:43.607090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d2589-6ca4-4ef5-b87f-6b05816097e4 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:43.607090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 797/1630] 10.222.0.43 () {54 vars in 962 bytes} [Thu Jul 21 22:29:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:43.608126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660a556-8ffb-4eb4-8d6c-5b69c3fe0f8e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:43.608126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660a556-8ffb-4eb4-8d6c-5b69c3fe0f8e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:43.608126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660a556-8ffb-4eb4-8d6c-5b69c3fe0f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:43.608126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3660a556-8ffb-4eb4-8d6c-5b69c3fe0f8e None None] MFA Rules not processed for user `2c04dc3ee4484afaab388cbb306974af`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:43.610901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3660a556-8ffb-4eb4-8d6c-5b69c3fe0f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:43.725966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 834/1631] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Jul 21 22:29:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:43.732212 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574a7ad-d886-4573-a350-03df2034177f None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:43.732546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574a7ad-d886-4573-a350-03df2034177f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:43.732793 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574a7ad-d886-4573-a350-03df2034177f None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:43.735742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 798/1632] 10.222.0.43 () {54 vars in 912 bytes} [Thu Jul 21 22:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:43.748308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd8b0e-8d4e-4336-a1a1-b1174cb3eaed None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:43.748908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd8b0e-8d4e-4336-a1a1-b1174cb3eaed None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:43.749581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd8b0e-8d4e-4336-a1a1-b1174cb3eaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:43.796512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6bdd8b0e-8d4e-4336-a1a1-b1174cb3eaed None None] MFA Rules not processed for user `2c04dc3ee4484afaab388cbb306974af`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:43.798324 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6bdd8b0e-8d4e-4336-a1a1-b1174cb3eaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:43.830260 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 835/1633] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jul 21 22:29:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:43.850575 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574a7ad-d886-4573-a350-03df2034177f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:43.868540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574a7ad-d886-4573-a350-03df2034177f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:43.879632 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ea843-4459-4935-abb6-f21c64362373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:43.880486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ea843-4459-4935-abb6-f21c64362373 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:43.880954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ea843-4459-4935-abb6-f21c64362373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:43.881403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ea843-4459-4935-abb6-f21c64362373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:43.908757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ea843-4459-4935-abb6-f21c64362373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:43.911671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ea843-4459-4935-abb6-f21c64362373 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:43.939506 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 799/1634] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:44.109134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dce43c-955f-4d7e-ba3a-2789a64f758e None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:44.109487 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dce43c-955f-4d7e-ba3a-2789a64f758e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:44.109767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dce43c-955f-4d7e-ba3a-2789a64f758e None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:44.112433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 836/1635] 10.222.0.43 () {54 vars in 912 bytes} [Thu Jul 21 22:29:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:29:44.127733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10e9d5-6bc7-48b1-bc9f-ddb52b118b1d None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:44.127933 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10e9d5-6bc7-48b1-bc9f-ddb52b118b1d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:44.128359 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10e9d5-6bc7-48b1-bc9f-ddb52b118b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:44.168859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-2f10e9d5-6bc7-48b1-bc9f-ddb52b118b1d None None] MFA Rules not processed for user `2c04dc3ee4484afaab388cbb306974af`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:44.170574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2f10e9d5-6bc7-48b1-bc9f-ddb52b118b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:44.183360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 800/1636] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jul 21 22:29:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:44.196636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dce43c-955f-4d7e-ba3a-2789a64f758e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:44.211231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dce43c-955f-4d7e-ba3a-2789a64f758e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:44.225772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f378d7-01b9-4094-bd21-93fa0722f51f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:44.228613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f378d7-01b9-4094-bd21-93fa0722f51f service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:44.229907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f378d7-01b9-4094-bd21-93fa0722f51f service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:44.231824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f378d7-01b9-4094-bd21-93fa0722f51f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:44.271687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f378d7-01b9-4094-bd21-93fa0722f51f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:44.275576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f378d7-01b9-4094-bd21-93fa0722f51f service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:44.306085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 837/1637] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:44.470803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10e9d5-6bc7-48b1-bc9f-ddb52b118b1d None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:44.621960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10e9d5-6bc7-48b1-bc9f-ddb52b118b1d None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:44.637106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a669d0-af37-4deb-bd7a-a2606077309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:44.638026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a669d0-af37-4deb-bd7a-a2606077309d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:44.638313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a669d0-af37-4deb-bd7a-a2606077309d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:44.638594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a669d0-af37-4deb-bd7a-a2606077309d admin admin] PATH_INFO: `/v3/users/8263e9d4deae42849293088c47439093` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:44.639861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a669d0-af37-4deb-bd7a-a2606077309d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8263e9d4deae42849293088c47439093)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:44.642521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a669d0-af37-4deb-bd7a-a2606077309d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:44.814992 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-29a669d0-af37-4deb-bd7a-a2606077309d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8263e9d4deae42849293088c47439093'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:44.836421 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-29a669d0-af37-4deb-bd7a-a2606077309d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8263e9d4deae42849293088c47439093'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:44.842019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-29a669d0-af37-4deb-bd7a-a2606077309d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8263e9d4deae42849293088c47439093'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:44.888597 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-29a669d0-af37-4deb-bd7a-a2606077309d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8263e9d4deae42849293088c47439093'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:44.917050 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-29a669d0-af37-4deb-bd7a-a2606077309d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8263e9d4deae42849293088c47439093'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:44.926813 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 801/1638] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:29:44 2022] DELETE /identity/v3/users/8263e9d4deae42849293088c47439093 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:44.931342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83576ceb-e04e-429a-8cc4-5235ef3fcec9 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:44.931858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83576ceb-e04e-429a-8cc4-5235ef3fcec9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:44.932027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83576ceb-e04e-429a-8cc4-5235ef3fcec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:44.991378 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-83576ceb-e04e-429a-8cc4-5235ef3fcec9 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:44.994158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-83576ceb-e04e-429a-8cc4-5235ef3fcec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:45.112352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 838/1639] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:45.208862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a669d0-af37-4deb-bd7a-a2606077309d admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:45.210635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-29a669d0-af37-4deb-bd7a-a2606077309d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:45.258717 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c14e6-d9ee-4fe0-83b8-10ae1e951b4c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:45.259014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c14e6-d9ee-4fe0-83b8-10ae1e951b4c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:45.259334 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c14e6-d9ee-4fe0-83b8-10ae1e951b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:45.292944 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:45.327373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3b3c14e6-d9ee-4fe0-83b8-10ae1e951b4c None None] MFA Rules not processed for user `236b373627eb41d385fcf53696da039d`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:45.329642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3b3c14e6-d9ee-4fe0-83b8-10ae1e951b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:45.360385 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a669d0-af37-4deb-bd7a-a2606077309d admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:45.360846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:45.371851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89033c05-31f6-4de3-a1e4-d43e75400ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:45.372536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89033c05-31f6-4de3-a1e4-d43e75400ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:45.372818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89033c05-31f6-4de3-a1e4-d43e75400ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:45.373122 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89033c05-31f6-4de3-a1e4-d43e75400ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:45.392728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89033c05-31f6-4de3-a1e4-d43e75400ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:45.400711 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89033c05-31f6-4de3-a1e4-d43e75400ca3 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:45.426847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 802/1640] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:45.519610 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 839/1641] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:45.522161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89033c05-31f6-4de3-a1e4-d43e75400ca3 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:45.524148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-89033c05-31f6-4de3-a1e4-d43e75400ca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:45.548705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89033c05-31f6-4de3-a1e4-d43e75400ca3 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:45.568070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2d90f-da0b-41d3-8663-35f13a04f5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:45.569081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2d90f-da0b-41d3-8663-35f13a04f5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:45.569507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2d90f-da0b-41d3-8663-35f13a04f5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:45.570282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2d90f-da0b-41d3-8663-35f13a04f5e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:45.571239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2d90f-da0b-41d3-8663-35f13a04f5e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:45.573971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2d90f-da0b-41d3-8663-35f13a04f5e1 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:45.660638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 803/1642] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:29:45 2022] POST /identity/v3/projects => generated 403 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:45.665967 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c14e6-d9ee-4fe0-83b8-10ae1e951b4c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:45.687580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c14e6-d9ee-4fe0-83b8-10ae1e951b4c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:45.897202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda08a4-22ad-466b-bd77-da85804d3867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:45.898241 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda08a4-22ad-466b-bd77-da85804d3867 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:45.898781 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda08a4-22ad-466b-bd77-da85804d3867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:45.899308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda08a4-22ad-466b-bd77-da85804d3867 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:45.900206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda08a4-22ad-466b-bd77-da85804d3867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:45.908329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda08a4-22ad-466b-bd77-da85804d3867 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:45.963268 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 840/1643] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:29:45 2022] POST /identity/v3/users => generated 308 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:45.967015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2d90f-da0b-41d3-8663-35f13a04f5e1 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:45.992870 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2d90f-da0b-41d3-8663-35f13a04f5e1 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:45.999179 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728ab65-6053-4858-8d99-0812aa1cc063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:46.000663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728ab65-6053-4858-8d99-0812aa1cc063 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:46.001266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728ab65-6053-4858-8d99-0812aa1cc063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:46.001744 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728ab65-6053-4858-8d99-0812aa1cc063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:46.002717 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728ab65-6053-4858-8d99-0812aa1cc063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:46.004751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728ab65-6053-4858-8d99-0812aa1cc063 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:46.028704 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 804/1644] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:46.033952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda08a4-22ad-466b-bd77-da85804d3867 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:46.061445 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda08a4-22ad-466b-bd77-da85804d3867 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:46.068836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890f055-d542-4b8e-9eb1-e95fbc2b2405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:46.073374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890f055-d542-4b8e-9eb1-e95fbc2b2405 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:46.073374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890f055-d542-4b8e-9eb1-e95fbc2b2405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:46.073374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890f055-d542-4b8e-9eb1-e95fbc2b2405 admin admin] PATH_INFO: `/v3/projects/10219f66f9434d3e915a27f2342e6ba9/users/f1e270cffa1d4e9a8953a29cf001495a/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:46.136150 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890f055-d542-4b8e-9eb1-e95fbc2b2405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10219f66f9434d3e915a27f2342e6ba9, user_id=f1e270cffa1d4e9a8953a29cf001495a, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:46.140325 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890f055-d542-4b8e-9eb1-e95fbc2b2405 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:46.178826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 841/1645] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:46 2022] PUT /identity/v3/projects/10219f66f9434d3e915a27f2342e6ba9/users/f1e270cffa1d4e9a8953a29cf001495a/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:46.183308 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728ab65-6053-4858-8d99-0812aa1cc063 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:46.196750 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728ab65-6053-4858-8d99-0812aa1cc063 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:46.326488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981307ec-4f31-432b-9c60-d31e1b9e816f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:46.327200 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981307ec-4f31-432b-9c60-d31e1b9e816f admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:46.327486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981307ec-4f31-432b-9c60-d31e1b9e816f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:46.327768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981307ec-4f31-432b-9c60-d31e1b9e816f admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:46.331756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981307ec-4f31-432b-9c60-d31e1b9e816f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:46.335608 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981307ec-4f31-432b-9c60-d31e1b9e816f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:46.367244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 805/1646] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:46.371637 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890f055-d542-4b8e-9eb1-e95fbc2b2405 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:46.401886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890f055-d542-4b8e-9eb1-e95fbc2b2405 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:46.416441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68176ea6-1d34-41d0-a1b1-d429e781c9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:46.417908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68176ea6-1d34-41d0-a1b1-d429e781c9d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:46.418203 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68176ea6-1d34-41d0-a1b1-d429e781c9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:46.418486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68176ea6-1d34-41d0-a1b1-d429e781c9d3 admin admin] PATH_INFO: `/v3/projects/10219f66f9434d3e915a27f2342e6ba9/users/f1e270cffa1d4e9a8953a29cf001495a/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:46.420687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68176ea6-1d34-41d0-a1b1-d429e781c9d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10219f66f9434d3e915a27f2342e6ba9, user_id=f1e270cffa1d4e9a8953a29cf001495a, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:46.423986 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68176ea6-1d34-41d0-a1b1-d429e781c9d3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:46.441407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 842/1647] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:46 2022] PUT /identity/v3/projects/10219f66f9434d3e915a27f2342e6ba9/users/f1e270cffa1d4e9a8953a29cf001495a/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:48.186767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981307ec-4f31-432b-9c60-d31e1b9e816f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:48.191441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-981307ec-4f31-432b-9c60-d31e1b9e816f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:48.248100 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981307ec-4f31-432b-9c60-d31e1b9e816f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:48.355868 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a2dbf-d23d-454a-856a-f2749ce83d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:48.356960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a2dbf-d23d-454a-856a-f2749ce83d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:48.357827 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a2dbf-d23d-454a-856a-f2749ce83d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:48.358112 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a2dbf-d23d-454a-856a-f2749ce83d0e admin admin] PATH_INFO: `/v3/projects/ab913bcc118d4629bc5056cded841663` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:48.361530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a2dbf-d23d-454a-856a-f2749ce83d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab913bcc118d4629bc5056cded841663)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:48.362599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: WARNING py.warnings [None req-e17a2dbf-d23d-454a-856a-f2749ce83d0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:29:48.362599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: warnings.warn(msg) Jul 21 22:29:48.362599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: Jul 21 22:29:48.363863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a2dbf-d23d-454a-856a-f2749ce83d0e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:48.474648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:48.512245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e17a2dbf-d23d-454a-856a-f2749ce83d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab913bcc118d4629bc5056cded841663', 'request_id': 'req-e17a2dbf-d23d-454a-856a-f2749ce83d0e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:48.535432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e17a2dbf-d23d-454a-856a-f2749ce83d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab913bcc118d4629bc5056cded841663', 'request_id': 'req-e17a2dbf-d23d-454a-856a-f2749ce83d0e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:48.543332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e17a2dbf-d23d-454a-856a-f2749ce83d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab913bcc118d4629bc5056cded841663', 'request_id': 'req-e17a2dbf-d23d-454a-856a-f2749ce83d0e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:48.590002 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e17a2dbf-d23d-454a-856a-f2749ce83d0e admin admin] The token cache is being invalidate because project ab913bcc118d4629bc5056cded841663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:29:48.590413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e17a2dbf-d23d-454a-856a-f2749ce83d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:48.592843 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e17a2dbf-d23d-454a-856a-f2749ce83d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:48.596080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 806/1648] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:29:48 2022] DELETE /identity/v3/projects/ab913bcc118d4629bc5056cded841663 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:48.601211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f0cd1-b21a-461b-a1ad-cd693ec29eac None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:48.602342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f0cd1-b21a-461b-a1ad-cd693ec29eac None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:48.602915 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f0cd1-b21a-461b-a1ad-cd693ec29eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:48.695983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7b9f0cd1-b21a-461b-a1ad-cd693ec29eac None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:48.702638 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7b9f0cd1-b21a-461b-a1ad-cd693ec29eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:48.861628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 843/1649] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:48.872025 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090b67b-d068-4577-bea9-464526d2a04f None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:48.872025 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090b67b-d068-4577-bea9-464526d2a04f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:48.872025 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090b67b-d068-4577-bea9-464526d2a04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:48.910672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-4090b67b-d068-4577-bea9-464526d2a04f None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:48.913712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4090b67b-d068-4577-bea9-464526d2a04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:48.935903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f0cd1-b21a-461b-a1ad-cd693ec29eac None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:48.941585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 807/1650] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:48.949298 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f0cd1-b21a-461b-a1ad-cd693ec29eac None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:48.963835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf83a4-0ff8-42f1-af63-bafd0206d15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:48.964429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf83a4-0ff8-42f1-af63-bafd0206d15f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:48.964716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf83a4-0ff8-42f1-af63-bafd0206d15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:48.965021 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf83a4-0ff8-42f1-af63-bafd0206d15f admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:48.965810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf83a4-0ff8-42f1-af63-bafd0206d15f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:29:48.966160 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf83a4-0ff8-42f1-af63-bafd0206d15f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:48.967976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf83a4-0ff8-42f1-af63-bafd0206d15f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:48.969827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:49.004054 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090b67b-d068-4577-bea9-464526d2a04f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:49.014633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 844/1651] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:29:49.020102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090b67b-d068-4577-bea9-464526d2a04f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:49.034690 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4ba27-6298-41c9-95d6-2634b72dead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:49.036901 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4ba27-6298-41c9-95d6-2634b72dead5 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:49.039636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4ba27-6298-41c9-95d6-2634b72dead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:49.039870 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4ba27-6298-41c9-95d6-2634b72dead5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:49.044449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4ba27-6298-41c9-95d6-2634b72dead5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:49.053958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4ba27-6298-41c9-95d6-2634b72dead5 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:49.135574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 808/1652] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:29:49 2022] POST /identity/v3/projects => generated 405 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:29:49.139407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf83a4-0ff8-42f1-af63-bafd0206d15f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:49.155413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf83a4-0ff8-42f1-af63-bafd0206d15f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:49.348223 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bdeea-ebcf-478f-b4d1-03f59871ccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:49.349031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bdeea-ebcf-478f-b4d1-03f59871ccc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:49.349397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bdeea-ebcf-478f-b4d1-03f59871ccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:49.349762 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bdeea-ebcf-478f-b4d1-03f59871ccc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:49.350663 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bdeea-ebcf-478f-b4d1-03f59871ccc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:49.353652 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bdeea-ebcf-478f-b4d1-03f59871ccc2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:49.417835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 845/1653] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:29:49 2022] POST /identity/v3/users => generated 303 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:49.422084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4ba27-6298-41c9-95d6-2634b72dead5 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:49.440692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4ba27-6298-41c9-95d6-2634b72dead5 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:49.483542 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5f2c6-62ad-4cd0-9f0e-91cd71076cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:49.488650 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5f2c6-62ad-4cd0-9f0e-91cd71076cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:49.489149 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5f2c6-62ad-4cd0-9f0e-91cd71076cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:49.489581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5f2c6-62ad-4cd0-9f0e-91cd71076cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:49.490552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5f2c6-62ad-4cd0-9f0e-91cd71076cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:49.492384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5f2c6-62ad-4cd0-9f0e-91cd71076cd5 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:49.537813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bdeea-ebcf-478f-b4d1-03f59871ccc2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:49.545601 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 809/1654] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:49.555600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bdeea-ebcf-478f-b4d1-03f59871ccc2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:49.566321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18367f10-4f85-490e-afa6-1dbea0a06ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:49.567312 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18367f10-4f85-490e-afa6-1dbea0a06ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:49.567790 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18367f10-4f85-490e-afa6-1dbea0a06ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:49.569899 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18367f10-4f85-490e-afa6-1dbea0a06ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:49.570925 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18367f10-4f85-490e-afa6-1dbea0a06ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:49.577805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18367f10-4f85-490e-afa6-1dbea0a06ee1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:49.605228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 846/1655] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:49.608732 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5f2c6-62ad-4cd0-9f0e-91cd71076cd5 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:49.631384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5f2c6-62ad-4cd0-9f0e-91cd71076cd5 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:49.648216 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843473fa-3de3-4b48-8aed-55b29bfcb068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:49.649964 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843473fa-3de3-4b48-8aed-55b29bfcb068 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:49.651574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843473fa-3de3-4b48-8aed-55b29bfcb068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:49.652064 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843473fa-3de3-4b48-8aed-55b29bfcb068 admin admin] PATH_INFO: `/v3/projects/7ec872e2db8b4ddf89fb13031df06ee7/users/84ea9788d0a7450d8a1223d6ea8b37b7/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:49.695030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843473fa-3de3-4b48-8aed-55b29bfcb068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec872e2db8b4ddf89fb13031df06ee7, user_id=84ea9788d0a7450d8a1223d6ea8b37b7, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:49.698924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843473fa-3de3-4b48-8aed-55b29bfcb068 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:49.742025 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 810/1656] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:49 2022] PUT /identity/v3/projects/7ec872e2db8b4ddf89fb13031df06ee7/users/84ea9788d0a7450d8a1223d6ea8b37b7/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:49.752914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106f162-9576-42c4-8764-1c2280211123 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:49.753204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106f162-9576-42c4-8764-1c2280211123 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:49.753655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106f162-9576-42c4-8764-1c2280211123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:49.821329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0106f162-9576-42c4-8764-1c2280211123 None None] MFA Rules not processed for user `84ea9788d0a7450d8a1223d6ea8b37b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:49.822846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0106f162-9576-42c4-8764-1c2280211123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:50.007288 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 847/1657] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:50.011825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843473fa-3de3-4b48-8aed-55b29bfcb068 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:50.176172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843473fa-3de3-4b48-8aed-55b29bfcb068 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:50.198053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09f511-2463-42c4-937b-42b9e23b7904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:50.198777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09f511-2463-42c4-937b-42b9e23b7904 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:50.199202 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09f511-2463-42c4-937b-42b9e23b7904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:50.199490 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09f511-2463-42c4-937b-42b9e23b7904 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:50.200853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09f511-2463-42c4-937b-42b9e23b7904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:50.202835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09f511-2463-42c4-937b-42b9e23b7904 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:50.263127 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 811/1658] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:29:50 2022] POST /identity/v3/projects => generated 405 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:29:50.266944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106f162-9576-42c4-8764-1c2280211123 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:50.285901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106f162-9576-42c4-8764-1c2280211123 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:50.338988 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aa018-a2f7-45d5-9dd2-346c0bac5d9b None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:50.339280 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aa018-a2f7-45d5-9dd2-346c0bac5d9b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:50.339563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aa018-a2f7-45d5-9dd2-346c0bac5d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:50.381194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-420aa018-a2f7-45d5-9dd2-346c0bac5d9b None None] MFA Rules not processed for user `f1e270cffa1d4e9a8953a29cf001495a`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:50.383038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-420aa018-a2f7-45d5-9dd2-346c0bac5d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:50.427895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c496573-3ea5-4983-b765-169013fedd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:50.428607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c496573-3ea5-4983-b765-169013fedd61 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:50.429164 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c496573-3ea5-4983-b765-169013fedd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:50.429458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c496573-3ea5-4983-b765-169013fedd61 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:50.430180 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c496573-3ea5-4983-b765-169013fedd61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:50.432113 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c496573-3ea5-4983-b765-169013fedd61 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:50.442778 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:50.461352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:50.489035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 848/1659] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:29:50 2022] POST /identity/v3/users => generated 309 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:50.492707 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c496573-3ea5-4983-b765-169013fedd61 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:50.502576 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 812/1660] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:50.519095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c496573-3ea5-4983-b765-169013fedd61 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:50.538273 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f37dca-2785-4f4d-9182-f1bb52600391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:50.538985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f37dca-2785-4f4d-9182-f1bb52600391 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:50.539278 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f37dca-2785-4f4d-9182-f1bb52600391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:50.539583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f37dca-2785-4f4d-9182-f1bb52600391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:50.540298 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f37dca-2785-4f4d-9182-f1bb52600391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:50.542117 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f37dca-2785-4f4d-9182-f1bb52600391 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:50.567791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 849/1661] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:29:50.571871 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420aa018-a2f7-45d5-9dd2-346c0bac5d9b None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:50.589558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420aa018-a2f7-45d5-9dd2-346c0bac5d9b None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:50.597701 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5c90c-8745-471f-82a6-c210f267b905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:50.598636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5c90c-8745-471f-82a6-c210f267b905 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:50.599064 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5c90c-8745-471f-82a6-c210f267b905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:50.599226 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5c90c-8745-471f-82a6-c210f267b905 admin admin] PATH_INFO: `/v3/projects/8fd2acaeb29e4f4885bae616e592af49/users/8a7d9d92f9494f018e754d13087bbb56/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:50.619032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5c90c-8745-471f-82a6-c210f267b905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd2acaeb29e4f4885bae616e592af49, user_id=8a7d9d92f9494f018e754d13087bbb56, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:50.621958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5c90c-8745-471f-82a6-c210f267b905 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:50.649307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 813/1662] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:50 2022] PUT /identity/v3/projects/8fd2acaeb29e4f4885bae616e592af49/users/8a7d9d92f9494f018e754d13087bbb56/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:29:50.650658 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f37dca-2785-4f4d-9182-f1bb52600391 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:50.664005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f37dca-2785-4f4d-9182-f1bb52600391 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:50.818640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a243346-dd2d-47b0-a4d3-5fd6552b5ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:50.819345 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a243346-dd2d-47b0-a4d3-5fd6552b5ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:50.819629 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a243346-dd2d-47b0-a4d3-5fd6552b5ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:50.819908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a243346-dd2d-47b0-a4d3-5fd6552b5ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:50.820757 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a243346-dd2d-47b0-a4d3-5fd6552b5ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:50.822522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a243346-dd2d-47b0-a4d3-5fd6552b5ab5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:50.842102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 850/1663] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:50.846438 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5c90c-8745-471f-82a6-c210f267b905 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:50.861323 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5c90c-8745-471f-82a6-c210f267b905 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:50.879160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8451e6-5ded-4bd7-806a-5433c9ed743a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:50.881430 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8451e6-5ded-4bd7-806a-5433c9ed743a admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:50.887975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8451e6-5ded-4bd7-806a-5433c9ed743a admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:50.887975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8451e6-5ded-4bd7-806a-5433c9ed743a admin admin] PATH_INFO: `/v3/projects/8fd2acaeb29e4f4885bae616e592af49/users/8a7d9d92f9494f018e754d13087bbb56/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:50.887975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8451e6-5ded-4bd7-806a-5433c9ed743a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd2acaeb29e4f4885bae616e592af49, user_id=8a7d9d92f9494f018e754d13087bbb56, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:50.896907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8451e6-5ded-4bd7-806a-5433c9ed743a admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:50.949982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 814/1664] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:50 2022] PUT /identity/v3/projects/8fd2acaeb29e4f4885bae616e592af49/users/8a7d9d92f9494f018e754d13087bbb56/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:50.956753 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6c7e0-5928-4f71-8efd-74fd57e04b9a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:50.957316 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6c7e0-5928-4f71-8efd-74fd57e04b9a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:50.957779 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6c7e0-5928-4f71-8efd-74fd57e04b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:51.015896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4ad6c7e0-5928-4f71-8efd-74fd57e04b9a None None] MFA Rules not processed for user `8a7d9d92f9494f018e754d13087bbb56`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:51.021032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4ad6c7e0-5928-4f71-8efd-74fd57e04b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:51.177186 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dd588-071a-41b7-87f8-ffa7095eb2e3 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:51.177464 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dd588-071a-41b7-87f8-ffa7095eb2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:51.177743 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dd588-071a-41b7-87f8-ffa7095eb2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:51.202656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 851/1665] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:51.215275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6c7e0-5928-4f71-8efd-74fd57e04b9a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:51.218051 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4ad6c7e0-5928-4f71-8efd-74fd57e04b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:51.233565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-602dd588-071a-41b7-87f8-ffa7095eb2e3 None None] MFA Rules not processed for user `985006f41c1d484aac532ed38b03e3df`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:51.235405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-602dd588-071a-41b7-87f8-ffa7095eb2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:51.301764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6c7e0-5928-4f71-8efd-74fd57e04b9a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:51.306744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e9307-64e1-4b26-925a-10431923c6c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:51.307424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e9307-64e1-4b26-925a-10431923c6c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:51.308300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e9307-64e1-4b26-925a-10431923c6c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:51.308614 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e9307-64e1-4b26-925a-10431923c6c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:51.323226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e9307-64e1-4b26-925a-10431923c6c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:51.324773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e9307-64e1-4b26-925a-10431923c6c5 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:51.353788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 852/1666] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:51 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:51.384629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 815/1667] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:51.399538 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e9307-64e1-4b26-925a-10431923c6c5 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:51.401245 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-889e9307-64e1-4b26-925a-10431923c6c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:51.418167 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:51.611339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e9307-64e1-4b26-925a-10431923c6c5 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:51.627314 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f846fe-800e-4567-9082-fb73944e8972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:51.629905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f846fe-800e-4567-9082-fb73944e8972 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:51.630560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f846fe-800e-4567-9082-fb73944e8972 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:51.632392 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f846fe-800e-4567-9082-fb73944e8972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:51.660167 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f846fe-800e-4567-9082-fb73944e8972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:51.664554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f846fe-800e-4567-9082-fb73944e8972 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:51.690843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 853/1668] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:51.943914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dd588-071a-41b7-87f8-ffa7095eb2e3 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:52.104418 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dd588-071a-41b7-87f8-ffa7095eb2e3 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:52.116762 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080d48e-73bc-45df-9bb3-36ee48a52f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:52.118208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080d48e-73bc-45df-9bb3-36ee48a52f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:52.118631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080d48e-73bc-45df-9bb3-36ee48a52f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:52.119082 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080d48e-73bc-45df-9bb3-36ee48a52f8e admin admin] PATH_INFO: `/v3/users/84ea9788d0a7450d8a1223d6ea8b37b7` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:52.121482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080d48e-73bc-45df-9bb3-36ee48a52f8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ea9788d0a7450d8a1223d6ea8b37b7)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:52.129303 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080d48e-73bc-45df-9bb3-36ee48a52f8e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:52.206992 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:52.242028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7080d48e-73bc-45df-9bb3-36ee48a52f8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ea9788d0a7450d8a1223d6ea8b37b7'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:52.255871 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7080d48e-73bc-45df-9bb3-36ee48a52f8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ea9788d0a7450d8a1223d6ea8b37b7'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:52.256758 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7080d48e-73bc-45df-9bb3-36ee48a52f8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ea9788d0a7450d8a1223d6ea8b37b7'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:52.325915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7080d48e-73bc-45df-9bb3-36ee48a52f8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ea9788d0a7450d8a1223d6ea8b37b7'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:52.351052 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7080d48e-73bc-45df-9bb3-36ee48a52f8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ea9788d0a7450d8a1223d6ea8b37b7'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:52.362843 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 816/1669] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:29:51 2022] DELETE /identity/v3/users/84ea9788d0a7450d8a1223d6ea8b37b7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:52.368623 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fc58f-aa72-43c0-801a-1511eefeee09 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:52.369033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fc58f-aa72-43c0-801a-1511eefeee09 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:52.369576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fc58f-aa72-43c0-801a-1511eefeee09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:52.409899 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-082fc58f-aa72-43c0-801a-1511eefeee09 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:52.413252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-082fc58f-aa72-43c0-801a-1511eefeee09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:52.523811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 854/1670] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:52.541463 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080d48e-73bc-45df-9bb3-36ee48a52f8e admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:52.543422 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-7080d48e-73bc-45df-9bb3-36ee48a52f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:52.653968 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080d48e-73bc-45df-9bb3-36ee48a52f8e admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:52.665974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af92d5e-5e49-426b-a918-cd0e35a361e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:52.666797 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af92d5e-5e49-426b-a918-cd0e35a361e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:52.667185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af92d5e-5e49-426b-a918-cd0e35a361e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:52.667598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af92d5e-5e49-426b-a918-cd0e35a361e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:52.679838 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af92d5e-5e49-426b-a918-cd0e35a361e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:52.682390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af92d5e-5e49-426b-a918-cd0e35a361e7 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:52.702962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 817/1671] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:52.817901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92054f19-6eae-4eaf-8b2a-9555a4070eef None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:52.818437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92054f19-6eae-4eaf-8b2a-9555a4070eef None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:52.818437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92054f19-6eae-4eaf-8b2a-9555a4070eef None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:52.819840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 855/1672] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jul 21 22:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:52.868992 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1465c5-a41e-48ec-87da-96e63a1cb6d6 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:52.869341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1465c5-a41e-48ec-87da-96e63a1cb6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:52.869573 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1465c5-a41e-48ec-87da-96e63a1cb6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:52.888984 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-fa1465c5-a41e-48ec-87da-96e63a1cb6d6 None None] MFA Rules not processed for user `5ba75bf6ef954eb59d8db1efa6c73d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:52.890201 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-fa1465c5-a41e-48ec-87da-96e63a1cb6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:53.027955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 818/1673] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jul 21 22:29:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:53.135956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9907f4-3a0d-449b-aeb3-398eb7137fe2 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:53.136243 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9907f4-3a0d-449b-aeb3-398eb7137fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:53.136747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9907f4-3a0d-449b-aeb3-398eb7137fe2 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:53.138688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 856/1674] 10.222.0.43 () {54 vars in 961 bytes} [Thu Jul 21 22:29:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:53.154876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e937d51-1330-4932-bab7-be7a342c19fd None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:53.155468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e937d51-1330-4932-bab7-be7a342c19fd None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:53.156218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e937d51-1330-4932-bab7-be7a342c19fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:53.200963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-8e937d51-1330-4932-bab7-be7a342c19fd None None] MFA Rules not processed for user `5ba75bf6ef954eb59d8db1efa6c73d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:53.205660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8e937d51-1330-4932-bab7-be7a342c19fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:53.259022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9907f4-3a0d-449b-aeb3-398eb7137fe2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:53.263091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 819/1675] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Jul 21 22:29:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:53.285067 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9907f4-3a0d-449b-aeb3-398eb7137fe2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:53.299542 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ea3bf-7a72-4ff0-b786-87eddcd7cfd8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba75bf6ef954eb59d8db1efa6c73d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:53.300394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ea3bf-7a72-4ff0-b786-87eddcd7cfd8 service placement] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:53.300682 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ea3bf-7a72-4ff0-b786-87eddcd7cfd8 service placement] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:53.300999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ea3bf-7a72-4ff0-b786-87eddcd7cfd8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:53.334027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ea3bf-7a72-4ff0-b786-87eddcd7cfd8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:53.335740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ea3bf-7a72-4ff0-b786-87eddcd7cfd8 service placement] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:53.363383 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e937d51-1330-4932-bab7-be7a342c19fd None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:53.368706 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8e937d51-1330-4932-bab7-be7a342c19fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:53.379937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 857/1676] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:53.404049 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e937d51-1330-4932-bab7-be7a342c19fd None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:53.420920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af5254-916e-4a74-b8e6-c6fd738ae638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:53.422003 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af5254-916e-4a74-b8e6-c6fd738ae638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:53.422415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af5254-916e-4a74-b8e6-c6fd738ae638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:53.422681 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af5254-916e-4a74-b8e6-c6fd738ae638 admin admin] PATH_INFO: `/v3/users/17eceb8b4f114afe81ed68ee640174e4` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:53.425495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af5254-916e-4a74-b8e6-c6fd738ae638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17eceb8b4f114afe81ed68ee640174e4)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:53.427652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af5254-916e-4a74-b8e6-c6fd738ae638 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:53.542282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:53.574090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-32af5254-916e-4a74-b8e6-c6fd738ae638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17eceb8b4f114afe81ed68ee640174e4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:53.587682 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-32af5254-916e-4a74-b8e6-c6fd738ae638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17eceb8b4f114afe81ed68ee640174e4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:53.590123 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-32af5254-916e-4a74-b8e6-c6fd738ae638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17eceb8b4f114afe81ed68ee640174e4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:53.622825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-32af5254-916e-4a74-b8e6-c6fd738ae638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17eceb8b4f114afe81ed68ee640174e4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:53.646138 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-32af5254-916e-4a74-b8e6-c6fd738ae638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17eceb8b4f114afe81ed68ee640174e4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:53.656984 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 820/1677] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:29:53 2022] DELETE /identity/v3/users/17eceb8b4f114afe81ed68ee640174e4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:29:53.661579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f9dff-6772-4837-830d-34b29e607529 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:53.661871 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f9dff-6772-4837-830d-34b29e607529 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:53.662152 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f9dff-6772-4837-830d-34b29e607529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:53.710786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-bf8f9dff-6772-4837-830d-34b29e607529 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:53.712044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bf8f9dff-6772-4837-830d-34b29e607529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:54.036787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 858/1678] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:54.104210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af5254-916e-4a74-b8e6-c6fd738ae638 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:54.106508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-32af5254-916e-4a74-b8e6-c6fd738ae638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:54.142459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f9dff-6772-4837-830d-34b29e607529 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:54.144100 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bf8f9dff-6772-4837-830d-34b29e607529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:54.170293 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f9dff-6772-4837-830d-34b29e607529 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:54.185928 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5210a7-267e-471c-a910-3209f1dba70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:54.186851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5210a7-267e-471c-a910-3209f1dba70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:54.187298 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5210a7-267e-471c-a910-3209f1dba70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:54.188757 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5210a7-267e-471c-a910-3209f1dba70c admin admin] PATH_INFO: `/v3/users/351452a1182d491494aac5e8fdef41db` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:54.194549 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5210a7-267e-471c-a910-3209f1dba70c admin admin] RBAC: Authorizing `identity:delete_user(user_id=351452a1182d491494aac5e8fdef41db)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:54.195921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-2b5210a7-267e-471c-a910-3209f1dba70c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:29:54.195921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: warnings.warn(msg) Jul 21 22:29:54.195921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: Jul 21 22:29:54.197292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5210a7-267e-471c-a910-3209f1dba70c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:54.243674 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:54.276816 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af5254-916e-4a74-b8e6-c6fd738ae638 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:54.290235 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ca6dc-c259-41b1-94f5-d70fa615ffba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:54.290985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ca6dc-c259-41b1-94f5-d70fa615ffba service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:54.291274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ca6dc-c259-41b1-94f5-d70fa615ffba service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:54.291581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ca6dc-c259-41b1-94f5-d70fa615ffba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:54.335875 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ca6dc-c259-41b1-94f5-d70fa615ffba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:54.337422 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ca6dc-c259-41b1-94f5-d70fa615ffba service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:54.365245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 821/1679] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:54.365705 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2b5210a7-267e-471c-a910-3209f1dba70c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351452a1182d491494aac5e8fdef41db'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:54.424298 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2b5210a7-267e-471c-a910-3209f1dba70c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351452a1182d491494aac5e8fdef41db'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:54.457644 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2b5210a7-267e-471c-a910-3209f1dba70c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351452a1182d491494aac5e8fdef41db'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:54.460444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2b5210a7-267e-471c-a910-3209f1dba70c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351452a1182d491494aac5e8fdef41db'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:54.483701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2b5210a7-267e-471c-a910-3209f1dba70c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351452a1182d491494aac5e8fdef41db'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:54.492310 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 859/1680] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:29:54 2022] DELETE /identity/v3/users/351452a1182d491494aac5e8fdef41db => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:54.497441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981567e-c4c0-4509-bc41-62ec8680b21e None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:54.498000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981567e-c4c0-4509-bc41-62ec8680b21e None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:54.498457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981567e-c4c0-4509-bc41-62ec8680b21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:54.533296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-6981567e-c4c0-4509-bc41-62ec8680b21e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:54.534831 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6981567e-c4c0-4509-bc41-62ec8680b21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:54.671366 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 822/1681] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:54.695040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5210a7-267e-471c-a910-3209f1dba70c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:54.696560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2b5210a7-267e-471c-a910-3209f1dba70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:54.796192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5210a7-267e-471c-a910-3209f1dba70c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:54.804335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2eff75-8256-40bd-b4ae-5d4d9db2ee24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:54.805049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eff75-8256-40bd-b4ae-5d4d9db2ee24 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:54.805334 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eff75-8256-40bd-b4ae-5d4d9db2ee24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:54.805615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eff75-8256-40bd-b4ae-5d4d9db2ee24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:54.821968 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2eff75-8256-40bd-b4ae-5d4d9db2ee24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:54.823317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2eff75-8256-40bd-b4ae-5d4d9db2ee24 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:54.855602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 860/1682] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:54.881614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f39dc-88de-42f5-b4a1-4aae6218746b None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:54.882267 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f39dc-88de-42f5-b4a1-4aae6218746b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:54.882739 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f39dc-88de-42f5-b4a1-4aae6218746b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:54.938230 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2eff75-8256-40bd-b4ae-5d4d9db2ee24 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:54.939995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ae2eff75-8256-40bd-b4ae-5d4d9db2ee24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:54.964429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2eff75-8256-40bd-b4ae-5d4d9db2ee24 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:54.974786 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-8e7f39dc-88de-42f5-b4a1-4aae6218746b None None] MFA Rules not processed for user `b1855c6320b4438aaa04013d863e789d`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:54.977839 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8e7f39dc-88de-42f5-b4a1-4aae6218746b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:54.978644 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ac529-19fd-4533-b498-54a67ea258bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:54.979780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ac529-19fd-4533-b498-54a67ea258bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:54.981961 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ac529-19fd-4533-b498-54a67ea258bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:54.982471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ac529-19fd-4533-b498-54a67ea258bb admin admin] PATH_INFO: `/v3/users/236b373627eb41d385fcf53696da039d` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:54.991044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ac529-19fd-4533-b498-54a67ea258bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=236b373627eb41d385fcf53696da039d)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:54.995011 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ac529-19fd-4533-b498-54a67ea258bb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:55.160607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:55.218473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-228ac529-19fd-4533-b498-54a67ea258bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236b373627eb41d385fcf53696da039d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:55.247371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 823/1683] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:55.259937 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed4aee-3b97-4c98-8021-b96ba3d7fecb None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:55.260369 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed4aee-3b97-4c98-8021-b96ba3d7fecb None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:55.260744 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed4aee-3b97-4c98-8021-b96ba3d7fecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:55.266893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-228ac529-19fd-4533-b498-54a67ea258bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236b373627eb41d385fcf53696da039d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:55.277097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-228ac529-19fd-4533-b498-54a67ea258bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236b373627eb41d385fcf53696da039d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:55.278151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-228ac529-19fd-4533-b498-54a67ea258bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236b373627eb41d385fcf53696da039d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:55.290130 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-228ac529-19fd-4533-b498-54a67ea258bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236b373627eb41d385fcf53696da039d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:55.303014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 861/1684] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:29:54 2022] DELETE /identity/v3/users/236b373627eb41d385fcf53696da039d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:55.318190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-52ed4aee-3b97-4c98-8021-b96ba3d7fecb None None] MFA Rules not processed for user `b1855c6320b4438aaa04013d863e789d`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:55.320074 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-52ed4aee-3b97-4c98-8021-b96ba3d7fecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:55.479602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 824/1685] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:55.493694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ac529-19fd-4533-b498-54a67ea258bb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:55.495958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-228ac529-19fd-4533-b498-54a67ea258bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:55.524199 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:55.677051 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ac529-19fd-4533-b498-54a67ea258bb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:55.684317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc09de-bfb4-4b17-8fe6-fe1ae6ee57f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:55.685869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc09de-bfb4-4b17-8fe6-fe1ae6ee57f8 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:55.688233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc09de-bfb4-4b17-8fe6-fe1ae6ee57f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:55.688233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc09de-bfb4-4b17-8fe6-fe1ae6ee57f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:55.690295 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f3dc09de-bfb4-4b17-8fe6-fe1ae6ee57f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:55.704764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc09de-bfb4-4b17-8fe6-fe1ae6ee57f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:55.706950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc09de-bfb4-4b17-8fe6-fe1ae6ee57f8 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:55.734529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 862/1686] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:56.391291 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed4aee-3b97-4c98-8021-b96ba3d7fecb None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:56.392804 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-52ed4aee-3b97-4c98-8021-b96ba3d7fecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:56.425670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc09de-bfb4-4b17-8fe6-fe1ae6ee57f8 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:56.427158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f3dc09de-bfb4-4b17-8fe6-fe1ae6ee57f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:56.581236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed4aee-3b97-4c98-8021-b96ba3d7fecb None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:56.597746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba455375-b82a-43c8-bf86-5079b81fce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:56.598643 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba455375-b82a-43c8-bf86-5079b81fce5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:56.598923 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba455375-b82a-43c8-bf86-5079b81fce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:56.599196 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba455375-b82a-43c8-bf86-5079b81fce5c admin admin] PATH_INFO: `/v3/projects/17ef5dffe957476dae7f714a35a3805e` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:56.601574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba455375-b82a-43c8-bf86-5079b81fce5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=17ef5dffe957476dae7f714a35a3805e)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:56.603528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba455375-b82a-43c8-bf86-5079b81fce5c admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:56.608173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc09de-bfb4-4b17-8fe6-fe1ae6ee57f8 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:56.621614 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630cb8f-bba9-4c26-8904-633da7376c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:56.622511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630cb8f-bba9-4c26-8904-633da7376c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:56.623037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630cb8f-bba9-4c26-8904-633da7376c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:56.623037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630cb8f-bba9-4c26-8904-633da7376c99 admin admin] PATH_INFO: `/v3/projects/26ea7972dae048e3882c0542a0295300` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:56.624972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630cb8f-bba9-4c26-8904-633da7376c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ea7972dae048e3882c0542a0295300)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:56.627479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630cb8f-bba9-4c26-8904-633da7376c99 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:56.710282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ba455375-b82a-43c8-bf86-5079b81fce5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17ef5dffe957476dae7f714a35a3805e', 'request_id': 'req-ba455375-b82a-43c8-bf86-5079b81fce5c'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:56.740338 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ba455375-b82a-43c8-bf86-5079b81fce5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17ef5dffe957476dae7f714a35a3805e', 'request_id': 'req-ba455375-b82a-43c8-bf86-5079b81fce5c'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:56.760659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0630cb8f-bba9-4c26-8904-633da7376c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ea7972dae048e3882c0542a0295300', 'request_id': 'req-0630cb8f-bba9-4c26-8904-633da7376c99'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:56.761908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ba455375-b82a-43c8-bf86-5079b81fce5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17ef5dffe957476dae7f714a35a3805e', 'request_id': 'req-ba455375-b82a-43c8-bf86-5079b81fce5c'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:56.772604 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0630cb8f-bba9-4c26-8904-633da7376c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ea7972dae048e3882c0542a0295300', 'request_id': 'req-0630cb8f-bba9-4c26-8904-633da7376c99'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:56.780719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0630cb8f-bba9-4c26-8904-633da7376c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ea7972dae048e3882c0542a0295300', 'request_id': 'req-0630cb8f-bba9-4c26-8904-633da7376c99'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:56.791283 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ba455375-b82a-43c8-bf86-5079b81fce5c admin admin] The token cache is being invalidate because project 17ef5dffe957476dae7f714a35a3805e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:29:56.791474 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ba455375-b82a-43c8-bf86-5079b81fce5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:56.792776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ba455375-b82a-43c8-bf86-5079b81fce5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:56.794493 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 825/1687] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:29:56 2022] DELETE /identity/v3/projects/17ef5dffe957476dae7f714a35a3805e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:56.795258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba455375-b82a-43c8-bf86-5079b81fce5c admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:56.799015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ba455375-b82a-43c8-bf86-5079b81fce5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:56.806693 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0630cb8f-bba9-4c26-8904-633da7376c99 admin admin] The token cache is being invalidate because project 26ea7972dae048e3882c0542a0295300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:29:56.807314 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0630cb8f-bba9-4c26-8904-633da7376c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:56.808214 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0630cb8f-bba9-4c26-8904-633da7376c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:56.814154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 863/1688] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:29:56 2022] DELETE /identity/v3/projects/26ea7972dae048e3882c0542a0295300 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:56.819090 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cccdf-a63e-4535-bedd-8620783845bd None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:56.819762 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cccdf-a63e-4535-bedd-8620783845bd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:56.820253 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cccdf-a63e-4535-bedd-8620783845bd None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:56.838227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 864/1689] 10.222.0.43 () {54 vars in 912 bytes} [Thu Jul 21 22:29:56 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:29:56.840301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cccdf-a63e-4535-bedd-8620783845bd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:56.842037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:56.849728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b89cccdf-a63e-4535-bedd-8620783845bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:56.911382 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:56.963662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba455375-b82a-43c8-bf86-5079b81fce5c admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:56.977813 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:56.978598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cccdf-a63e-4535-bedd-8620783845bd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:56.978736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:56.979026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:56.979310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e admin admin] PATH_INFO: `/v3/projects/7ec872e2db8b4ddf89fb13031df06ee7` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:56.980631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec872e2db8b4ddf89fb13031df06ee7)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:56.982600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:56.985279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196f777-0d10-40f4-bf54-92b1cf38ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:56.986252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196f777-0d10-40f4-bf54-92b1cf38ee60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:56.987073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196f777-0d10-40f4-bf54-92b1cf38ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:56.988435 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196f777-0d10-40f4-bf54-92b1cf38ee60 admin admin] PATH_INFO: `/v3/users/f1e270cffa1d4e9a8953a29cf001495a` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:56.990313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196f777-0d10-40f4-bf54-92b1cf38ee60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e270cffa1d4e9a8953a29cf001495a)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:56.995200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196f777-0d10-40f4-bf54-92b1cf38ee60 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:57.085208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec872e2db8b4ddf89fb13031df06ee7', 'request_id': 'req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.108337 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec872e2db8b4ddf89fb13031df06ee7', 'request_id': 'req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.115213 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec872e2db8b4ddf89fb13031df06ee7', 'request_id': 'req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.137453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7196f777-0d10-40f4-bf54-92b1cf38ee60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e270cffa1d4e9a8953a29cf001495a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.143876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e admin admin] The token cache is being invalidate because project 7ec872e2db8b4ddf89fb13031df06ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:29:57.144184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.149473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.154194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 826/1690] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:29:56 2022] DELETE /identity/v3/projects/7ec872e2db8b4ddf89fb13031df06ee7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:57.154194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:57.155432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:57.190508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7196f777-0d10-40f4-bf54-92b1cf38ee60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e270cffa1d4e9a8953a29cf001495a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.201218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7196f777-0d10-40f4-bf54-92b1cf38ee60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e270cffa1d4e9a8953a29cf001495a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.204580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7196f777-0d10-40f4-bf54-92b1cf38ee60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e270cffa1d4e9a8953a29cf001495a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.226451 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7196f777-0d10-40f4-bf54-92b1cf38ee60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e270cffa1d4e9a8953a29cf001495a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.240384 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 865/1691] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:29:56 2022] DELETE /identity/v3/users/f1e270cffa1d4e9a8953a29cf001495a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:57.243911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cba8c-6b16-43cc-88e9-c42465a91db1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:57.244204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cba8c-6b16-43cc-88e9-c42465a91db1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:57.244488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cba8c-6b16-43cc-88e9-c42465a91db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:57.368603 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af1f5a-ad53-4ba9-97ef-73b09d5cfe1e admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:57.401875 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1e6cba8c-6b16-43cc-88e9-c42465a91db1 None None] MFA Rules not processed for user `23aaef489c0948fe8bc10acb8e76c84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:57.411469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1e6cba8c-6b16-43cc-88e9-c42465a91db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:57.511965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:57.529435 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef27ae7-25a6-4cf1-9fd2-c7d662c45620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:57.530225 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef27ae7-25a6-4cf1-9fd2-c7d662c45620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:57.530459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef27ae7-25a6-4cf1-9fd2-c7d662c45620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:57.530788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef27ae7-25a6-4cf1-9fd2-c7d662c45620 admin admin] PATH_INFO: `/v3/users/83e6c6a7f0e44ffc8a12de61e1afca35` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:57.532897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef27ae7-25a6-4cf1-9fd2-c7d662c45620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e6c6a7f0e44ffc8a12de61e1afca35)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:57.535037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef27ae7-25a6-4cf1-9fd2-c7d662c45620 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:57.553571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 866/1692] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jul 21 22:29:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:57.555102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cba8c-6b16-43cc-88e9-c42465a91db1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:57.556716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1e6cba8c-6b16-43cc-88e9-c42465a91db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:57.575515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cba8c-6b16-43cc-88e9-c42465a91db1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:57.583957 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5256c64-067b-4775-8240-14c0e3f7db26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:57.586428 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5256c64-067b-4775-8240-14c0e3f7db26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:57.586977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5256c64-067b-4775-8240-14c0e3f7db26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:57.587596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5256c64-067b-4775-8240-14c0e3f7db26 admin admin] PATH_INFO: `/v3/projects/d4169b85337e4c758716b520fee5db82` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:57.590421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5256c64-067b-4775-8240-14c0e3f7db26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4169b85337e4c758716b520fee5db82)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:57.594479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5256c64-067b-4775-8240-14c0e3f7db26 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:57.623790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-eef27ae7-25a6-4cf1-9fd2-c7d662c45620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e6c6a7f0e44ffc8a12de61e1afca35'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.641872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-eef27ae7-25a6-4cf1-9fd2-c7d662c45620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e6c6a7f0e44ffc8a12de61e1afca35'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.642679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-eef27ae7-25a6-4cf1-9fd2-c7d662c45620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e6c6a7f0e44ffc8a12de61e1afca35'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.656914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:57.679784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-eef27ae7-25a6-4cf1-9fd2-c7d662c45620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e6c6a7f0e44ffc8a12de61e1afca35'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.694043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-eef27ae7-25a6-4cf1-9fd2-c7d662c45620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e6c6a7f0e44ffc8a12de61e1afca35'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.695647 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a5256c64-067b-4775-8240-14c0e3f7db26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4169b85337e4c758716b520fee5db82', 'request_id': 'req-a5256c64-067b-4775-8240-14c0e3f7db26'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.703469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a5256c64-067b-4775-8240-14c0e3f7db26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4169b85337e4c758716b520fee5db82', 'request_id': 'req-a5256c64-067b-4775-8240-14c0e3f7db26'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.704540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 827/1693] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:29:57 2022] DELETE /identity/v3/users/83e6c6a7f0e44ffc8a12de61e1afca35 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:57.705503 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef27ae7-25a6-4cf1-9fd2-c7d662c45620 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:57.710317 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-eef27ae7-25a6-4cf1-9fd2-c7d662c45620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:57.711122 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a5256c64-067b-4775-8240-14c0e3f7db26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4169b85337e4c758716b520fee5db82', 'request_id': 'req-a5256c64-067b-4775-8240-14c0e3f7db26'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.728918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a5256c64-067b-4775-8240-14c0e3f7db26 admin admin] The token cache is being invalidate because project d4169b85337e4c758716b520fee5db82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:29:57.729390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a5256c64-067b-4775-8240-14c0e3f7db26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.730539 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a5256c64-067b-4775-8240-14c0e3f7db26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:57.732430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 867/1694] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:29:57 2022] DELETE /identity/v3/projects/d4169b85337e4c758716b520fee5db82 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:57.733253 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5256c64-067b-4775-8240-14c0e3f7db26 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:57.735202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a5256c64-067b-4775-8240-14c0e3f7db26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:57.808229 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5256c64-067b-4775-8240-14c0e3f7db26 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:57.871954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d71b40-e608-4ba3-b74b-9665a50a16e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:57.873405 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d71b40-e608-4ba3-b74b-9665a50a16e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:57.873837 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d71b40-e608-4ba3-b74b-9665a50a16e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:57.873937 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef27ae7-25a6-4cf1-9fd2-c7d662c45620 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:57.874227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d71b40-e608-4ba3-b74b-9665a50a16e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:57.876415 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f0d71b40-e608-4ba3-b74b-9665a50a16e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:57.887841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d71b40-e608-4ba3-b74b-9665a50a16e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:57.889622 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d71b40-e608-4ba3-b74b-9665a50a16e2 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:57.891909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e326f9-52c1-47c9-af2f-00c3b4f575ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:57.892827 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e326f9-52c1-47c9-af2f-00c3b4f575ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:57.894417 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e326f9-52c1-47c9-af2f-00c3b4f575ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:57.894417 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e326f9-52c1-47c9-af2f-00c3b4f575ea admin admin] PATH_INFO: `/v3/users/8a7d9d92f9494f018e754d13087bbb56` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:57.895830 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e326f9-52c1-47c9-af2f-00c3b4f575ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a7d9d92f9494f018e754d13087bbb56)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:57.898377 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e326f9-52c1-47c9-af2f-00c3b4f575ea admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:57.903953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 868/1695] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:29:57.905089 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e69c2-c901-496c-89c3-7810a83bed3a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:57.905460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e69c2-c901-496c-89c3-7810a83bed3a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:57.906908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e69c2-c901-496c-89c3-7810a83bed3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:57.933888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-208e69c2-c901-496c-89c3-7810a83bed3a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:57.935708 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-208e69c2-c901-496c-89c3-7810a83bed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:57.946097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 869/1696] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:57.953866 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b8bae-733a-4873-bf88-73f1fcf94d12 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:57.954571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b8bae-733a-4873-bf88-73f1fcf94d12 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:57.955011 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b8bae-733a-4873-bf88-73f1fcf94d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:58.000674 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-667b8bae-733a-4873-bf88-73f1fcf94d12 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:58.002072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-667b8bae-733a-4873-bf88-73f1fcf94d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:58.013371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-52e326f9-52c1-47c9-af2f-00c3b4f575ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a7d9d92f9494f018e754d13087bbb56'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:58.021807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 870/1697] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:58.025942 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b8bae-733a-4873-bf88-73f1fcf94d12 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:58.034302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-52e326f9-52c1-47c9-af2f-00c3b4f575ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a7d9d92f9494f018e754d13087bbb56'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:58.035772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-52e326f9-52c1-47c9-af2f-00c3b4f575ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a7d9d92f9494f018e754d13087bbb56'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:58.049432 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b8bae-733a-4873-bf88-73f1fcf94d12 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:58.065193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905bed2-a785-416b-a30a-dbb235e579ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:58.065678 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905bed2-a785-416b-a30a-dbb235e579ca admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:58.066160 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905bed2-a785-416b-a30a-dbb235e579ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:58.066346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905bed2-a785-416b-a30a-dbb235e579ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:58.067198 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905bed2-a785-416b-a30a-dbb235e579ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:29:58.067515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905bed2-a785-416b-a30a-dbb235e579ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:58.069575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905bed2-a785-416b-a30a-dbb235e579ca admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:58.070493 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-52e326f9-52c1-47c9-af2f-00c3b4f575ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a7d9d92f9494f018e754d13087bbb56'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:58.075691 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:58.092132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-52e326f9-52c1-47c9-af2f-00c3b4f575ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a7d9d92f9494f018e754d13087bbb56'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:58.104485 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 828/1698] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:29:57 2022] DELETE /identity/v3/users/8a7d9d92f9494f018e754d13087bbb56 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:58.114458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 871/1699] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:29:58.119639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e326f9-52c1-47c9-af2f-00c3b4f575ea admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:58.122059 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-52e326f9-52c1-47c9-af2f-00c3b4f575ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:58.273933 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e326f9-52c1-47c9-af2f-00c3b4f575ea admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:58.284819 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519f34-a3d3-47f0-9f45-57d0547aa711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:58.285537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519f34-a3d3-47f0-9f45-57d0547aa711 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:58.285822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519f34-a3d3-47f0-9f45-57d0547aa711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:58.286099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519f34-a3d3-47f0-9f45-57d0547aa711 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:58.286806 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d519f34-a3d3-47f0-9f45-57d0547aa711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:58.288797 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d519f34-a3d3-47f0-9f45-57d0547aa711 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:58.346326 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 829/1700] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:29:58 2022] POST /identity/v3/projects => generated 363 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:58.351283 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905bed2-a785-416b-a30a-dbb235e579ca admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:58.370076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905bed2-a785-416b-a30a-dbb235e579ca admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:58.385132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519f34-a3d3-47f0-9f45-57d0547aa711 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:58.387459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8d519f34-a3d3-47f0-9f45-57d0547aa711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:58.501359 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:58.529018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bbc7a-aca9-41f7-bbbc-e9e11771a333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:58.529717 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bbc7a-aca9-41f7-bbbc-e9e11771a333 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:58.534977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bbc7a-aca9-41f7-bbbc-e9e11771a333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:58.535357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bbc7a-aca9-41f7-bbbc-e9e11771a333 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:58.536120 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bbc7a-aca9-41f7-bbbc-e9e11771a333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:58.538772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bbc7a-aca9-41f7-bbbc-e9e11771a333 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:58.551654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519f34-a3d3-47f0-9f45-57d0547aa711 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:58.564722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191fe3c-e13b-4afc-b5b1-b3d12dd22012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:58.566008 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191fe3c-e13b-4afc-b5b1-b3d12dd22012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:58.566515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191fe3c-e13b-4afc-b5b1-b3d12dd22012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:58.566993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191fe3c-e13b-4afc-b5b1-b3d12dd22012 admin admin] PATH_INFO: `/v3/projects/10219f66f9434d3e915a27f2342e6ba9` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:58.569881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191fe3c-e13b-4afc-b5b1-b3d12dd22012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10219f66f9434d3e915a27f2342e6ba9)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:58.573721 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191fe3c-e13b-4afc-b5b1-b3d12dd22012 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:58.591431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 872/1701] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:29:58 2022] POST /identity/v3/users => generated 282 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:58.595977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bbc7a-aca9-41f7-bbbc-e9e11771a333 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:58.617361 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bbc7a-aca9-41f7-bbbc-e9e11771a333 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:58.630564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210482d-5119-4d2e-98e5-0267a7cc7526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:58.661555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210482d-5119-4d2e-98e5-0267a7cc7526 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:58.665466 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210482d-5119-4d2e-98e5-0267a7cc7526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:58.666518 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210482d-5119-4d2e-98e5-0267a7cc7526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:58.671927 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210482d-5119-4d2e-98e5-0267a7cc7526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:58.679228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210482d-5119-4d2e-98e5-0267a7cc7526 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:58.718600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0191fe3c-e13b-4afc-b5b1-b3d12dd22012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10219f66f9434d3e915a27f2342e6ba9', 'request_id': 'req-0191fe3c-e13b-4afc-b5b1-b3d12dd22012'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:58.720113 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 873/1702] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:29:58.722575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210482d-5119-4d2e-98e5-0267a7cc7526 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:58.748351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0191fe3c-e13b-4afc-b5b1-b3d12dd22012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10219f66f9434d3e915a27f2342e6ba9', 'request_id': 'req-0191fe3c-e13b-4afc-b5b1-b3d12dd22012'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:58.758960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210482d-5119-4d2e-98e5-0267a7cc7526 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:58.771658 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0191fe3c-e13b-4afc-b5b1-b3d12dd22012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10219f66f9434d3e915a27f2342e6ba9', 'request_id': 'req-0191fe3c-e13b-4afc-b5b1-b3d12dd22012'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:58.798585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0191fe3c-e13b-4afc-b5b1-b3d12dd22012 admin admin] The token cache is being invalidate because project 10219f66f9434d3e915a27f2342e6ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:29:58.801578 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0191fe3c-e13b-4afc-b5b1-b3d12dd22012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:58.802685 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0191fe3c-e13b-4afc-b5b1-b3d12dd22012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:29:58.807280 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 830/1703] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:29:58 2022] DELETE /identity/v3/projects/10219f66f9434d3e915a27f2342e6ba9 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:58.813555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735cb74-733c-4854-8534-d23494dd4b5d None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:58.813846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735cb74-733c-4854-8534-d23494dd4b5d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:58.814124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735cb74-733c-4854-8534-d23494dd4b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:58.853182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ec39c-e939-413c-a205-4b4d9a95726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:58.853875 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ec39c-e939-413c-a205-4b4d9a95726e admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:58.854155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ec39c-e939-413c-a205-4b4d9a95726e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:58.854430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ec39c-e939-413c-a205-4b4d9a95726e admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:58.855306 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ec39c-e939-413c-a205-4b4d9a95726e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:58.857287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ec39c-e939-413c-a205-4b4d9a95726e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:58.862029 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-3735cb74-733c-4854-8534-d23494dd4b5d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:58.863927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-3735cb74-733c-4854-8534-d23494dd4b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:58.878811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 874/1704] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:58.880948 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 831/1705] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:58.888341 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ec39c-e939-413c-a205-4b4d9a95726e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:58.889629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abdfa8-c370-4219-82d2-39674bf19fe5 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:58.889932 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abdfa8-c370-4219-82d2-39674bf19fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:58.890448 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abdfa8-c370-4219-82d2-39674bf19fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:58.892504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5c8ec39c-e939-413c-a205-4b4d9a95726e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:58.902285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:58.934700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-87abdfa8-c370-4219-82d2-39674bf19fe5 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:58.939361 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ec39c-e939-413c-a205-4b4d9a95726e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:58.939790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-87abdfa8-c370-4219-82d2-39674bf19fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:58.959804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d964f8-19e0-415e-bcec-86cd548a82f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:58.962033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d964f8-19e0-415e-bcec-86cd548a82f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:58.962536 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d964f8-19e0-415e-bcec-86cd548a82f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:58.964663 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d964f8-19e0-415e-bcec-86cd548a82f4 admin admin] PATH_INFO: `/v3/projects/08f6748a038d4c5baf674340129540ee/users/9937016384614c7e866eb76d19dc0feb/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:58.968313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 832/1706] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:29:58.971684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abdfa8-c370-4219-82d2-39674bf19fe5 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:58.992978 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abdfa8-c370-4219-82d2-39674bf19fe5 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:59.008803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04884820-417c-4b47-ae0a-b7bd58ad1913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:59.009993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04884820-417c-4b47-ae0a-b7bd58ad1913 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:59.010281 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04884820-417c-4b47-ae0a-b7bd58ad1913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:59.010558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04884820-417c-4b47-ae0a-b7bd58ad1913 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:59.011332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04884820-417c-4b47-ae0a-b7bd58ad1913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:29:59.011885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04884820-417c-4b47-ae0a-b7bd58ad1913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:59.012621 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d964f8-19e0-415e-bcec-86cd548a82f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f6748a038d4c5baf674340129540ee, user_id=9937016384614c7e866eb76d19dc0feb, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:59.013260 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04884820-417c-4b47-ae0a-b7bd58ad1913 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:59.025679 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d964f8-19e0-415e-bcec-86cd548a82f4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:59.051107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 833/1707] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:29:59.055496 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04884820-417c-4b47-ae0a-b7bd58ad1913 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:59.093068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 875/1708] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:29:58 2022] PUT /identity/v3/projects/08f6748a038d4c5baf674340129540ee/users/9937016384614c7e866eb76d19dc0feb/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:29:59.093765 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04884820-417c-4b47-ae0a-b7bd58ad1913 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:59.096464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8933d-2faa-43f1-bd6e-b47853d372c4 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:59.098183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8933d-2faa-43f1-bd6e-b47853d372c4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:59.098613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8933d-2faa-43f1-bd6e-b47853d372c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:59.177913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f6b8933d-2faa-43f1-bd6e-b47853d372c4 None None] MFA Rules not processed for user `9937016384614c7e866eb76d19dc0feb`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:29:59.179151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f6b8933d-2faa-43f1-bd6e-b47853d372c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:59.315859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f9aeb-8dee-4bed-9176-be35538b1d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:59.316662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f9aeb-8dee-4bed-9176-be35538b1d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:59.317030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f9aeb-8dee-4bed-9176-be35538b1d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:59.317324 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f9aeb-8dee-4bed-9176-be35538b1d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:59.317974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f9aeb-8dee-4bed-9176-be35538b1d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:59.320346 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f9aeb-8dee-4bed-9176-be35538b1d0d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:59.388002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 876/1709] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:29:59 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:29:59.392278 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8933d-2faa-43f1-bd6e-b47853d372c4 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:59.412294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8933d-2faa-43f1-bd6e-b47853d372c4 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:59.431227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 834/1710] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:29:59 2022] POST /identity/v3/projects => generated 369 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:29:59.433096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9efb2-69ef-4603-bdef-dee95022f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:59.433898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9efb2-69ef-4603-bdef-dee95022f951 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:59.434281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9efb2-69ef-4603-bdef-dee95022f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:59.434663 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9efb2-69ef-4603-bdef-dee95022f951 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:59.435495 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9efb2-69ef-4603-bdef-dee95022f951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:59.439390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9efb2-69ef-4603-bdef-dee95022f951 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:59.439776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f9aeb-8dee-4bed-9176-be35538b1d0d admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:59.503131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 877/1711] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:29:59 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:29:59.504302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9efb2-69ef-4603-bdef-dee95022f951 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:59.549044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:59.630370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f9aeb-8dee-4bed-9176-be35538b1d0d admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:59.716671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9efb2-69ef-4603-bdef-dee95022f951 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:59.742890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48451fb1-2bb6-46e5-86e6-6fbc4c3cd0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:59.743598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48451fb1-2bb6-46e5-86e6-6fbc4c3cd0ab admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:59.743885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48451fb1-2bb6-46e5-86e6-6fbc4c3cd0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:59.744164 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48451fb1-2bb6-46e5-86e6-6fbc4c3cd0ab admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:59.744874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48451fb1-2bb6-46e5-86e6-6fbc4c3cd0ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:59.746870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48451fb1-2bb6-46e5-86e6-6fbc4c3cd0ab admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:59.767067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae33ca8-5a35-434e-a63d-31c2e54fba9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:59.767782 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae33ca8-5a35-434e-a63d-31c2e54fba9a admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:59.776617 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae33ca8-5a35-434e-a63d-31c2e54fba9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:59.777533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae33ca8-5a35-434e-a63d-31c2e54fba9a admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:59.778434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae33ca8-5a35-434e-a63d-31c2e54fba9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:59.780290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae33ca8-5a35-434e-a63d-31c2e54fba9a admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:59.804727 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 878/1712] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:29:59 2022] POST /identity/v3/users => generated 288 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:59.806799 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48451fb1-2bb6-46e5-86e6-6fbc4c3cd0ab admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:59.822439 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 835/1713] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:29:59 2022] POST /identity/v3/users => generated 285 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:29:59.823543 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae33ca8-5a35-434e-a63d-31c2e54fba9a admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:59.826539 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-48451fb1-2bb6-46e5-86e6-6fbc4c3cd0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:29:59.837766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:59.842715 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae33ca8-5a35-434e-a63d-31c2e54fba9a admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:59.850720 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c71ce6-227b-4fb5-8dc3-771544b4d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:59.851573 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c71ce6-227b-4fb5-8dc3-771544b4d835 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:59.852005 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c71ce6-227b-4fb5-8dc3-771544b4d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:59.853136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c71ce6-227b-4fb5-8dc3-771544b4d835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:59.854073 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c71ce6-227b-4fb5-8dc3-771544b4d835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:59.856241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c71ce6-227b-4fb5-8dc3-771544b4d835 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:59.860227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48451fb1-2bb6-46e5-86e6-6fbc4c3cd0ab admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:59.876271 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 836/1714] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:59.877384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c71ce6-227b-4fb5-8dc3-771544b4d835 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:59.879664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e07dc-6781-47c5-9a5a-66dbd87e030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:59.880561 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e07dc-6781-47c5-9a5a-66dbd87e030c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:59.880848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e07dc-6781-47c5-9a5a-66dbd87e030c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:59.881152 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e07dc-6781-47c5-9a5a-66dbd87e030c admin admin] PATH_INFO: `/v3/projects/90dc47c0420346a3919844402066ae70` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:59.888156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e07dc-6781-47c5-9a5a-66dbd87e030c admin admin] RBAC: Authorizing `identity:delete_project(project_id=90dc47c0420346a3919844402066ae70)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:59.890265 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e07dc-6781-47c5-9a5a-66dbd87e030c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:59.894476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c71ce6-227b-4fb5-8dc3-771544b4d835 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:29:59.907599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07355751-23d9-454f-a0f2-77d3aba5052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:29:59.908519 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07355751-23d9-454f-a0f2-77d3aba5052f admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:29:59.909016 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07355751-23d9-454f-a0f2-77d3aba5052f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:29:59.909431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07355751-23d9-454f-a0f2-77d3aba5052f admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:29:59.910316 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07355751-23d9-454f-a0f2-77d3aba5052f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:29:59.912109 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07355751-23d9-454f-a0f2-77d3aba5052f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:29:59.928991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 837/1715] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:29:59.930207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07355751-23d9-454f-a0f2-77d3aba5052f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:29:59.932352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-07355751-23d9-454f-a0f2-77d3aba5052f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:00.115341 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-594e07dc-6781-47c5-9a5a-66dbd87e030c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90dc47c0420346a3919844402066ae70', 'request_id': 'req-594e07dc-6781-47c5-9a5a-66dbd87e030c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:00.147695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-594e07dc-6781-47c5-9a5a-66dbd87e030c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90dc47c0420346a3919844402066ae70', 'request_id': 'req-594e07dc-6781-47c5-9a5a-66dbd87e030c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:00.175595 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07355751-23d9-454f-a0f2-77d3aba5052f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:00.176862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-594e07dc-6781-47c5-9a5a-66dbd87e030c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90dc47c0420346a3919844402066ae70', 'request_id': 'req-594e07dc-6781-47c5-9a5a-66dbd87e030c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:00.202162 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-594e07dc-6781-47c5-9a5a-66dbd87e030c admin admin] The token cache is being invalidate because project 90dc47c0420346a3919844402066ae70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:00.202508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-594e07dc-6781-47c5-9a5a-66dbd87e030c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:00.203529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-594e07dc-6781-47c5-9a5a-66dbd87e030c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:00.207370 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 879/1716] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:29:59 2022] DELETE /identity/v3/projects/90dc47c0420346a3919844402066ae70 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:00.208385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e07dc-6781-47c5-9a5a-66dbd87e030c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:00.214390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-594e07dc-6781-47c5-9a5a-66dbd87e030c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:00.355662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef8bbb-2ff3-44e6-88a3-3b799178ab13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba75bf6ef954eb59d8db1efa6c73d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:00.356379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef8bbb-2ff3-44e6-88a3-3b799178ab13 service placement] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:00.357116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef8bbb-2ff3-44e6-88a3-3b799178ab13 service placement] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:00.357116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef8bbb-2ff3-44e6-88a3-3b799178ab13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:00.363088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-66ef8bbb-2ff3-44e6-88a3-3b799178ab13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:00.379805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e07dc-6781-47c5-9a5a-66dbd87e030c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:00.392430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed717221-8b1a-40fc-b962-7cddd3d535a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:00.393381 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed717221-8b1a-40fc-b962-7cddd3d535a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:00.393724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed717221-8b1a-40fc-b962-7cddd3d535a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:00.394002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed717221-8b1a-40fc-b962-7cddd3d535a9 admin admin] PATH_INFO: `/v3/projects/ce763bbe26b74edf8fff8e9959026834/users/1a32ab8541cc4abab34663bfa24b3649/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:00.396129 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef8bbb-2ff3-44e6-88a3-3b799178ab13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:00.397788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef8bbb-2ff3-44e6-88a3-3b799178ab13 service placement] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:00.420751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed717221-8b1a-40fc-b962-7cddd3d535a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce763bbe26b74edf8fff8e9959026834, user_id=1a32ab8541cc4abab34663bfa24b3649, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:00.423747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed717221-8b1a-40fc-b962-7cddd3d535a9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:00.427333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 838/1717] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:29:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:00.428159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef8bbb-2ff3-44e6-88a3-3b799178ab13 service placement] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:00.430809 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-66ef8bbb-2ff3-44e6-88a3-3b799178ab13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:00.461981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef8bbb-2ff3-44e6-88a3-3b799178ab13 service placement] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:00.463131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 880/1718] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:00 2022] PUT /identity/v3/projects/ce763bbe26b74edf8fff8e9959026834/users/1a32ab8541cc4abab34663bfa24b3649/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:00.470217 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08430044-9def-4932-ab91-758781a62a94 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:00.470841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08430044-9def-4932-ab91-758781a62a94 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:00.471326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08430044-9def-4932-ab91-758781a62a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:00.501444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:00.538241 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-08430044-9def-4932-ab91-758781a62a94 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:00.539480 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-08430044-9def-4932-ab91-758781a62a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:00.638842 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82bc08-f735-4cda-b06e-edee47236f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:00.640155 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82bc08-f735-4cda-b06e-edee47236f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:00.640440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82bc08-f735-4cda-b06e-edee47236f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:00.641278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82bc08-f735-4cda-b06e-edee47236f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:00.642536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82bc08-f735-4cda-b06e-edee47236f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:00.651812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82bc08-f735-4cda-b06e-edee47236f71 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:00.681838 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 839/1719] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:00.683465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82bc08-f735-4cda-b06e-edee47236f71 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:00.688773 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-fc82bc08-f735-4cda-b06e-edee47236f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:00.705101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 881/1720] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:00.706959 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08430044-9def-4932-ab91-758781a62a94 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:00.742737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82bc08-f735-4cda-b06e-edee47236f71 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:00.744521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08430044-9def-4932-ab91-758781a62a94 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:00.754458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df516f-973f-4692-b9db-efd537bd02fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:00.755169 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df516f-973f-4692-b9db-efd537bd02fb admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:00.755456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df516f-973f-4692-b9db-efd537bd02fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:00.755729 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df516f-973f-4692-b9db-efd537bd02fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:00.756816 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df516f-973f-4692-b9db-efd537bd02fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:00.759475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df516f-973f-4692-b9db-efd537bd02fb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:00.772052 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:00.773082 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:00.775230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:00.775665 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9 admin admin] PATH_INFO: `/v3/projects/8fd2acaeb29e4f4885bae616e592af49` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:00.783701 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd2acaeb29e4f4885bae616e592af49)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:00.799740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:00.804595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 882/1721] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:00.805745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df516f-973f-4692-b9db-efd537bd02fb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:00.815063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:00.849937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df516f-973f-4692-b9db-efd537bd02fb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:00.870156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a37b5c-f3a1-4391-b0e5-eac1a12767b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:00.874500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a37b5c-f3a1-4391-b0e5-eac1a12767b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:00.875918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a37b5c-f3a1-4391-b0e5-eac1a12767b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:00.878024 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a37b5c-f3a1-4391-b0e5-eac1a12767b6 admin admin] PATH_INFO: `/v3/projects/e2618a357d6d4fee8b78b1812620d75c/users/08ae7d7fef224f579d47503150bd4862/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:00.950462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd2acaeb29e4f4885bae616e592af49', 'request_id': 'req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:00.953909 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a37b5c-f3a1-4391-b0e5-eac1a12767b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2618a357d6d4fee8b78b1812620d75c, user_id=08ae7d7fef224f579d47503150bd4862, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:00.956803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a37b5c-f3a1-4391-b0e5-eac1a12767b6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:00.976525 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd2acaeb29e4f4885bae616e592af49', 'request_id': 'req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:00.992235 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd2acaeb29e4f4885bae616e592af49', 'request_id': 'req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:01.008804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 883/1722] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:00 2022] PUT /identity/v3/projects/e2618a357d6d4fee8b78b1812620d75c/users/08ae7d7fef224f579d47503150bd4862/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:01.013693 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edeef5-9910-4b5a-853b-c929a9ce0924 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:01.014364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edeef5-9910-4b5a-853b-c929a9ce0924 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:01.014597 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edeef5-9910-4b5a-853b-c929a9ce0924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:01.043522 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9 admin admin] The token cache is being invalidate because project 8fd2acaeb29e4f4885bae616e592af49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:01.049331 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:01.052481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:01.066742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 840/1723] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:00 2022] DELETE /identity/v3/projects/8fd2acaeb29e4f4885bae616e592af49 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:01.068116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:01.070245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:01.099104 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-65edeef5-9910-4b5a-853b-c929a9ce0924 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:01.102196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-65edeef5-9910-4b5a-853b-c929a9ce0924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:01.271891 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb5729-40bb-46b9-88ed-65d5107cc5c9 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:01.277408 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99753ce5-5873-43c2-a87d-594283746658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:01.278470 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99753ce5-5873-43c2-a87d-594283746658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:01.278755 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99753ce5-5873-43c2-a87d-594283746658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:01.279028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99753ce5-5873-43c2-a87d-594283746658 admin admin] PATH_INFO: `/v3/projects/ce763bbe26b74edf8fff8e9959026834/users/1a32ab8541cc4abab34663bfa24b3649/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:01.279526 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 884/1724] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:01.284747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a51310-a22e-436e-98fe-aea5ce7e0164 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:01.285060 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a51310-a22e-436e-98fe-aea5ce7e0164 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:01.285341 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a51310-a22e-436e-98fe-aea5ce7e0164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:01.285840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99753ce5-5873-43c2-a87d-594283746658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce763bbe26b74edf8fff8e9959026834, user_id=1a32ab8541cc4abab34663bfa24b3649, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:01.290348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99753ce5-5873-43c2-a87d-594283746658 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:01.305400 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 841/1725] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:01 2022] PUT /identity/v3/projects/ce763bbe26b74edf8fff8e9959026834/users/1a32ab8541cc4abab34663bfa24b3649/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:01.307148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4408663-b8e4-4afa-bf44-d3b8919946c4 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:01.307489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4408663-b8e4-4afa-bf44-d3b8919946c4 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:01.307768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4408663-b8e4-4afa-bf44-d3b8919946c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:01.336848 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-e4408663-b8e4-4afa-bf44-d3b8919946c4 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:01.337902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d8a51310-a22e-436e-98fe-aea5ce7e0164 None None] MFA Rules not processed for user `08ae7d7fef224f579d47503150bd4862`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:01.338143 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e4408663-b8e4-4afa-bf44-d3b8919946c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:01.339581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d8a51310-a22e-436e-98fe-aea5ce7e0164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:01.418660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 842/1726] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:01.419999 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b03294-16b7-47e5-ba47-71bbd14990c5 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:01.420287 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b03294-16b7-47e5-ba47-71bbd14990c5 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:01.420565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b03294-16b7-47e5-ba47-71bbd14990c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:01.445623 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:01.462453 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-e7b03294-16b7-47e5-ba47-71bbd14990c5 None None] MFA Rules not processed for user `0ab0db1bbc72471a90bbfc2e47561a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:01.465311 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 885/1727] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:01.466394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e7b03294-16b7-47e5-ba47-71bbd14990c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:01.468155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a51310-a22e-436e-98fe-aea5ce7e0164 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:01.484319 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a51310-a22e-436e-98fe-aea5ce7e0164 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:01.491762 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506aed1f-cf77-4b7c-8c27-bdfe869bfa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:01.492536 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aed1f-cf77-4b7c-8c27-bdfe869bfa30 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:01.492937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aed1f-cf77-4b7c-8c27-bdfe869bfa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:01.493639 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506aed1f-cf77-4b7c-8c27-bdfe869bfa30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:01.494866 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506aed1f-cf77-4b7c-8c27-bdfe869bfa30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:01.494866 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506aed1f-cf77-4b7c-8c27-bdfe869bfa30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:01.496425 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506aed1f-cf77-4b7c-8c27-bdfe869bfa30 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:01.513890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 886/1728] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:01.513890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e8e00-5977-438b-8c80-52181ad06656 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:01.513890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e8e00-5977-438b-8c80-52181ad06656 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:01.513890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e8e00-5977-438b-8c80-52181ad06656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:01.517235 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:01.563557 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7d2e8e00-5977-438b-8c80-52181ad06656 None None] MFA Rules not processed for user `1a32ab8541cc4abab34663bfa24b3649`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:01.564755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7d2e8e00-5977-438b-8c80-52181ad06656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:01.696877 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 843/1729] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:01.696877 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ed1ff-15d4-43a4-abd3-6988d705be52 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:01.696877 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ed1ff-15d4-43a4-abd3-6988d705be52 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:01.696877 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ed1ff-15d4-43a4-abd3-6988d705be52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:01.697733 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 887/1730] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:01 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:01.702052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e8e00-5977-438b-8c80-52181ad06656 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:01.706362 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7d2e8e00-5977-438b-8c80-52181ad06656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:01.722536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-ac0ed1ff-15d4-43a4-abd3-6988d705be52 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:01.724298 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ac0ed1ff-15d4-43a4-abd3-6988d705be52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:01.726091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e8e00-5977-438b-8c80-52181ad06656 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:01.732612 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad1e0b-3a75-4fc2-939a-4b7d54c0cc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:01.733646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad1e0b-3a75-4fc2-939a-4b7d54c0cc1f admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:01.733937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad1e0b-3a75-4fc2-939a-4b7d54c0cc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:01.734222 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad1e0b-3a75-4fc2-939a-4b7d54c0cc1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:01.735292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad1e0b-3a75-4fc2-939a-4b7d54c0cc1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:01.737184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad1e0b-3a75-4fc2-939a-4b7d54c0cc1f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:01.739625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 844/1731] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:01.740637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ed1ff-15d4-43a4-abd3-6988d705be52 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:01.756092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ed1ff-15d4-43a4-abd3-6988d705be52 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:01.761861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3f06f-e51d-4fe5-b380-e3ca1eedbc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:01.762536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3f06f-e51d-4fe5-b380-e3ca1eedbc8f admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:01.762822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3f06f-e51d-4fe5-b380-e3ca1eedbc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:01.763095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3f06f-e51d-4fe5-b380-e3ca1eedbc8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:01.764170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3f06f-e51d-4fe5-b380-e3ca1eedbc8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:01.766751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3f06f-e51d-4fe5-b380-e3ca1eedbc8f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:01.773981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 888/1732] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:01 2022] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:01.775636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7d718-2329-4a84-8d36-470ffbac392d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:01.776111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7d718-2329-4a84-8d36-470ffbac392d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:01.776512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7d718-2329-4a84-8d36-470ffbac392d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:01.810136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 845/1733] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:01 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:01.810136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3f06f-e51d-4fe5-b380-e3ca1eedbc8f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:01.813597 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cec7d718-2329-4a84-8d36-470ffbac392d None None] MFA Rules not processed for user `985006f41c1d484aac532ed38b03e3df`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:01.814692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c0d3f06f-e51d-4fe5-b380-e3ca1eedbc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:01.819487 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cec7d718-2329-4a84-8d36-470ffbac392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:01.927852 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 889/1734] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:01.929065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7d718-2329-4a84-8d36-470ffbac392d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:01.930878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cec7d718-2329-4a84-8d36-470ffbac392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:01.974542 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3f06f-e51d-4fe5-b380-e3ca1eedbc8f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:01.992896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6f69a-050a-46e3-845a-cad095a20774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:01.993602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6f69a-050a-46e3-845a-cad095a20774 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:01.993892 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6f69a-050a-46e3-845a-cad095a20774 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:01.994772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6f69a-050a-46e3-845a-cad095a20774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:02.052621 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7d718-2329-4a84-8d36-470ffbac392d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:02.067576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50190614-4fe9-4e45-9ee8-a5630a6df403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:02.074158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50190614-4fe9-4e45-9ee8-a5630a6df403 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:02.074893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50190614-4fe9-4e45-9ee8-a5630a6df403 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:02.074893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50190614-4fe9-4e45-9ee8-a5630a6df403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:02.105074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:02.125521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6f69a-050a-46e3-845a-cad095a20774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:02.127365 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6f69a-050a-46e3-845a-cad095a20774 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:02.143789 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 846/1735] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:02.144958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6f69a-050a-46e3-845a-cad095a20774 service nova] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:02.207347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:02.249436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50190614-4fe9-4e45-9ee8-a5630a6df403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:02.255865 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50190614-4fe9-4e45-9ee8-a5630a6df403 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:02.266106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6f69a-050a-46e3-845a-cad095a20774 service nova] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:02.274077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1c6d1-7083-4300-86f9-fa199fcae164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:02.277154 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1c6d1-7083-4300-86f9-fa199fcae164 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:02.277448 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1c6d1-7083-4300-86f9-fa199fcae164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:02.277729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1c6d1-7083-4300-86f9-fa199fcae164 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:02.278471 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1c6d1-7083-4300-86f9-fa199fcae164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:02.278781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1c6d1-7083-4300-86f9-fa199fcae164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:02.283970 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1c6d1-7083-4300-86f9-fa199fcae164 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:02.298149 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 890/1736] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:01 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:02.300296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50190614-4fe9-4e45-9ee8-a5630a6df403 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:02.303730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 847/1737] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:02.308473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1c6d1-7083-4300-86f9-fa199fcae164 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:02.321497 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1c6d1-7083-4300-86f9-fa199fcae164 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:02.332126 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac330a4a-5acb-4314-a545-e399833a55b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:02.334025 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac330a4a-5acb-4314-a545-e399833a55b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:02.334347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac330a4a-5acb-4314-a545-e399833a55b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:02.334642 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac330a4a-5acb-4314-a545-e399833a55b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:02.339438 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50190614-4fe9-4e45-9ee8-a5630a6df403 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:02.343374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac330a4a-5acb-4314-a545-e399833a55b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:02.351732 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac330a4a-5acb-4314-a545-e399833a55b4 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:02.364725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556d337-f4fd-424c-a89c-1390598cbaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:02.368464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d337-f4fd-424c-a89c-1390598cbaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:02.372752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d337-f4fd-424c-a89c-1390598cbaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:02.373135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d337-f4fd-424c-a89c-1390598cbaa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:02.376554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556d337-f4fd-424c-a89c-1390598cbaa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:02.386203 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556d337-f4fd-424c-a89c-1390598cbaa5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:02.471777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 848/1738] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:02 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:02.476076 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac330a4a-5acb-4314-a545-e399833a55b4 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:02.490852 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 891/1739] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:02 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:02.492312 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556d337-f4fd-424c-a89c-1390598cbaa5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:02.508284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556d337-f4fd-424c-a89c-1390598cbaa5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:02.512053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac330a4a-5acb-4314-a545-e399833a55b4 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:02.521334 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d15f9-1b06-4fb8-b97e-36cb27a78380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:02.522421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d15f9-1b06-4fb8-b97e-36cb27a78380 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:02.523182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d15f9-1b06-4fb8-b97e-36cb27a78380 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:02.523891 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d15f9-1b06-4fb8-b97e-36cb27a78380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:02.526705 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-df9d15f9-1b06-4fb8-b97e-36cb27a78380 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:02.535589 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40095bc0-916b-4b33-baba-8928a5705bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:02.536421 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40095bc0-916b-4b33-baba-8928a5705bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:02.538370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40095bc0-916b-4b33-baba-8928a5705bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:02.538772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40095bc0-916b-4b33-baba-8928a5705bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:02.539616 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40095bc0-916b-4b33-baba-8928a5705bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:02.547668 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40095bc0-916b-4b33-baba-8928a5705bf8 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:02.630509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 849/1740] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:02 2022] POST /identity/v3/projects => generated 363 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:02.630509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40095bc0-916b-4b33-baba-8928a5705bf8 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:02.705917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d15f9-1b06-4fb8-b97e-36cb27a78380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:02.707400 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d15f9-1b06-4fb8-b97e-36cb27a78380 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:02.740246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 892/1741] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:02.746094 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d15f9-1b06-4fb8-b97e-36cb27a78380 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:02.786393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d15f9-1b06-4fb8-b97e-36cb27a78380 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:02.858808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40095bc0-916b-4b33-baba-8928a5705bf8 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:02.879423 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c2808-11f6-46cd-9a75-21ca45ffe4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:02.880126 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c2808-11f6-46cd-9a75-21ca45ffe4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:02.880416 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c2808-11f6-46cd-9a75-21ca45ffe4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:02.880703 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c2808-11f6-46cd-9a75-21ca45ffe4f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:02.886963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c2808-11f6-46cd-9a75-21ca45ffe4f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:02.888456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c2808-11f6-46cd-9a75-21ca45ffe4f9 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:02.958877 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 850/1742] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:02.962254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c2808-11f6-46cd-9a75-21ca45ffe4f9 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:03.001427 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c2808-11f6-46cd-9a75-21ca45ffe4f9 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:03.023500 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb571094-7e49-4d55-b0f1-f4f45c1b8256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:03.027956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb571094-7e49-4d55-b0f1-f4f45c1b8256 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:03.028869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0a21b-b507-42c9-b49c-385827e475e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:03.029649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb571094-7e49-4d55-b0f1-f4f45c1b8256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:03.029907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0a21b-b507-42c9-b49c-385827e475e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:03.031299 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb571094-7e49-4d55-b0f1-f4f45c1b8256 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:03.031743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0a21b-b507-42c9-b49c-385827e475e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:03.032327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0a21b-b507-42c9-b49c-385827e475e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:03.032965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0a21b-b507-42c9-b49c-385827e475e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:03.034201 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb571094-7e49-4d55-b0f1-f4f45c1b8256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:03.042053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb571094-7e49-4d55-b0f1-f4f45c1b8256 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:03.042455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0a21b-b507-42c9-b49c-385827e475e6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:03.071592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 893/1743] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:03.086696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0a21b-b507-42c9-b49c-385827e475e6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:03.142198 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0a21b-b507-42c9-b49c-385827e475e6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:03.153198 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781924d5-8831-449c-b3b9-7edac6bf3ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:03.153887 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781924d5-8831-449c-b3b9-7edac6bf3ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:03.154170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781924d5-8831-449c-b3b9-7edac6bf3ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:03.154443 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781924d5-8831-449c-b3b9-7edac6bf3ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:03.155486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781924d5-8831-449c-b3b9-7edac6bf3ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:03.157949 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781924d5-8831-449c-b3b9-7edac6bf3ce2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:03.166735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 851/1744] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:02 2022] POST /identity/v3/users => generated 282 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:03.170507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb571094-7e49-4d55-b0f1-f4f45c1b8256 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:03.204219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 894/1745] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:03.204219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781924d5-8831-449c-b3b9-7edac6bf3ce2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:03.217314 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb571094-7e49-4d55-b0f1-f4f45c1b8256 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:03.232485 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6f039-8751-461f-b141-d3d927d3bbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:03.233491 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6f039-8751-461f-b141-d3d927d3bbee admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:03.233767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6f039-8751-461f-b141-d3d927d3bbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:03.236693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6f039-8751-461f-b141-d3d927d3bbee admin admin] PATH_INFO: `/v3/projects/d364115b80bf4218ad7e324106010184/users/4026f851d26047f5b78ce5b7fa31ec71/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:03.238537 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781924d5-8831-449c-b3b9-7edac6bf3ce2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:03.257566 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0363ce-b1a4-4780-8425-adb851448c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:03.258270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0363ce-b1a4-4780-8425-adb851448c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:03.258558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0363ce-b1a4-4780-8425-adb851448c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:03.258838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0363ce-b1a4-4780-8425-adb851448c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:03.259827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0363ce-b1a4-4780-8425-adb851448c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:03.263219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0363ce-b1a4-4780-8425-adb851448c19 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:03.272953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:03.278717 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 895/1746] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:03.283019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0363ce-b1a4-4780-8425-adb851448c19 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:03.284416 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6f039-8751-461f-b141-d3d927d3bbee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d364115b80bf4218ad7e324106010184, user_id=4026f851d26047f5b78ce5b7fa31ec71, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:03.290034 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6f039-8751-461f-b141-d3d927d3bbee admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:03.296135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0363ce-b1a4-4780-8425-adb851448c19 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:03.303515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425be28-9074-4dae-87a5-1376d68e42fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:03.304423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425be28-9074-4dae-87a5-1376d68e42fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:03.304702 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425be28-9074-4dae-87a5-1376d68e42fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:03.305018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425be28-9074-4dae-87a5-1376d68e42fc admin admin] PATH_INFO: `/v3/projects/e3296bb2f8d34f1682603fd5c9e3d627/users/b3fa98c8a31a43a7b2b391f93020f2ba/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:03.326173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 852/1747] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:03 2022] PUT /identity/v3/projects/d364115b80bf4218ad7e324106010184/users/4026f851d26047f5b78ce5b7fa31ec71/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:03.330181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6f039-8751-461f-b141-d3d927d3bbee admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:03.333708 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425be28-9074-4dae-87a5-1376d68e42fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3296bb2f8d34f1682603fd5c9e3d627, user_id=b3fa98c8a31a43a7b2b391f93020f2ba, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:03.336448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425be28-9074-4dae-87a5-1376d68e42fc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:03.379541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 896/1748] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:03 2022] PUT /identity/v3/projects/e3296bb2f8d34f1682603fd5c9e3d627/users/b3fa98c8a31a43a7b2b391f93020f2ba/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:03.388845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425be28-9074-4dae-87a5-1376d68e42fc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:03.454057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:03.516411 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6f039-8751-461f-b141-d3d927d3bbee admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:03.663447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425be28-9074-4dae-87a5-1376d68e42fc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:03.675832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8c206-1719-472c-ab8d-a9c8a5e1b564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:03.677302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8c206-1719-472c-ab8d-a9c8a5e1b564 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:03.678158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8c206-1719-472c-ab8d-a9c8a5e1b564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:03.678464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8c206-1719-472c-ab8d-a9c8a5e1b564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:03.679274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8c206-1719-472c-ab8d-a9c8a5e1b564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:03.685170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86017503-a4c5-4727-bf7a-fdd35a9a0085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:03.686039 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86017503-a4c5-4727-bf7a-fdd35a9a0085 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:03.686329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86017503-a4c5-4727-bf7a-fdd35a9a0085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:03.686613 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86017503-a4c5-4727-bf7a-fdd35a9a0085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:03.689839 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86017503-a4c5-4727-bf7a-fdd35a9a0085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:03.693954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8c206-1719-472c-ab8d-a9c8a5e1b564 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:03.694489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86017503-a4c5-4727-bf7a-fdd35a9a0085 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:03.719390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 897/1749] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:03.719390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06b8b2-9d78-445b-b001-8daf6da95c50 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:03.719686 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 853/1750] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:03.721804 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86017503-a4c5-4727-bf7a-fdd35a9a0085 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:03.726959 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06b8b2-9d78-445b-b001-8daf6da95c50 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:03.730269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06b8b2-9d78-445b-b001-8daf6da95c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:03.747932 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86017503-a4c5-4727-bf7a-fdd35a9a0085 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:03.761110 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404e191-8f83-466f-b056-c8ed19d4f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:03.766162 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404e191-8f83-466f-b056-c8ed19d4f670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:03.767516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404e191-8f83-466f-b056-c8ed19d4f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:03.767818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404e191-8f83-466f-b056-c8ed19d4f670 admin admin] PATH_INFO: `/v3/projects/d364115b80bf4218ad7e324106010184/users/4026f851d26047f5b78ce5b7fa31ec71/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:03.775332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404e191-8f83-466f-b056-c8ed19d4f670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d364115b80bf4218ad7e324106010184, user_id=4026f851d26047f5b78ce5b7fa31ec71, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:03.781632 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404e191-8f83-466f-b056-c8ed19d4f670 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:03.803464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-bd06b8b2-9d78-445b-b001-8daf6da95c50 None None] MFA Rules not processed for user `b3fa98c8a31a43a7b2b391f93020f2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:03.806600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bd06b8b2-9d78-445b-b001-8daf6da95c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:03.828217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 854/1751] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:03 2022] PUT /identity/v3/projects/d364115b80bf4218ad7e324106010184/users/4026f851d26047f5b78ce5b7fa31ec71/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:03.828217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404e191-8f83-466f-b056-c8ed19d4f670 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:04.011487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404e191-8f83-466f-b056-c8ed19d4f670 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:04.028584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76150e-ec76-4207-8401-7e8657f1f9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:04.029546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76150e-ec76-4207-8401-7e8657f1f9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:04.029865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76150e-ec76-4207-8401-7e8657f1f9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:04.030222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76150e-ec76-4207-8401-7e8657f1f9ec admin admin] PATH_INFO: `/v3/projects/832e81d968914261b8ab541671c5fec8/users/a7e8b7cab8e44004ab421c5ea60afa0c/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:04.032624 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 898/1752] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:04.034464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ec913-a23d-48c3-85e7-85c6e4cf3230 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:04.034963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ec913-a23d-48c3-85e7-85c6e4cf3230 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:04.035434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ec913-a23d-48c3-85e7-85c6e4cf3230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:04.075178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76150e-ec76-4207-8401-7e8657f1f9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=832e81d968914261b8ab541671c5fec8, user_id=a7e8b7cab8e44004ab421c5ea60afa0c, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:04.078389 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76150e-ec76-4207-8401-7e8657f1f9ec admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:04.084434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-939ec913-a23d-48c3-85e7-85c6e4cf3230 None None] MFA Rules not processed for user `4026f851d26047f5b78ce5b7fa31ec71`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:04.091475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-939ec913-a23d-48c3-85e7-85c6e4cf3230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:04.112631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 855/1753] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:03 2022] PUT /identity/v3/projects/832e81d968914261b8ab541671c5fec8/users/a7e8b7cab8e44004ab421c5ea60afa0c/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:04.114218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373349c0-86be-4a04-8ff3-d67b67299efd None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:04.114509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373349c0-86be-4a04-8ff3-d67b67299efd None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:04.114797 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373349c0-86be-4a04-8ff3-d67b67299efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:04.185321 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-373349c0-86be-4a04-8ff3-d67b67299efd None None] MFA Rules not processed for user `1e24364e59144eae846d5a5efa260dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:04.186236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-373349c0-86be-4a04-8ff3-d67b67299efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:04.339940 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:04.365121 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:04.444977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 856/1754] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:04.444977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373349c0-86be-4a04-8ff3-d67b67299efd None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:04.456967 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 899/1755] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:04.462672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed5789-e6b9-430e-839b-36fb65f7c8d3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:04.462974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed5789-e6b9-430e-839b-36fb65f7c8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:04.463260 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed5789-e6b9-430e-839b-36fb65f7c8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:04.574625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-64ed5789-e6b9-430e-839b-36fb65f7c8d3 None None] MFA Rules not processed for user `a7e8b7cab8e44004ab421c5ea60afa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:04.581545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-64ed5789-e6b9-430e-839b-36fb65f7c8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:04.626629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373349c0-86be-4a04-8ff3-d67b67299efd None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:04.663414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491bca3-4dc0-4863-839e-708114a0b488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:04.667365 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491bca3-4dc0-4863-839e-708114a0b488 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:04.669371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491bca3-4dc0-4863-839e-708114a0b488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:04.669681 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491bca3-4dc0-4863-839e-708114a0b488 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:04.677277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491bca3-4dc0-4863-839e-708114a0b488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:04.681636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491bca3-4dc0-4863-839e-708114a0b488 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:04.794014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 857/1756] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:04 2022] POST /identity/v3/projects => generated 373 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:04.801561 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5638a-439d-4b80-901e-44bf6ce64734 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:04.806728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5638a-439d-4b80-901e-44bf6ce64734 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:04.807143 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5638a-439d-4b80-901e-44bf6ce64734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:04.836125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 900/1757] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:04.837810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d450-34fd-4bdd-b95c-2b499f3bc8ea None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:04.838106 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d450-34fd-4bdd-b95c-2b499f3bc8ea None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:04.838392 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d450-34fd-4bdd-b95c-2b499f3bc8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:04.950233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d745d450-34fd-4bdd-b95c-2b499f3bc8ea None None] MFA Rules not processed for user `1e24364e59144eae846d5a5efa260dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:04.958127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d745d450-34fd-4bdd-b95c-2b499f3bc8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:04.982145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-4bf5638a-439d-4b80-901e-44bf6ce64734 None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:04.983406 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4bf5638a-439d-4b80-901e-44bf6ce64734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:05.137909 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 901/1758] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:05.139109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745d450-34fd-4bdd-b95c-2b499f3bc8ea None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:05.282182 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 858/1759] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jul 21 22:30:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:05.284870 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5638a-439d-4b80-901e-44bf6ce64734 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:05.333172 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745d450-34fd-4bdd-b95c-2b499f3bc8ea None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:05.348423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db36f6-ca68-44ad-bd39-1a3155e445fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:05.351550 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db36f6-ca68-44ad-bd39-1a3155e445fd service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:05.351844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db36f6-ca68-44ad-bd39-1a3155e445fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:05.352683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db36f6-ca68-44ad-bd39-1a3155e445fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:05.428979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:05.487364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:05.519052 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5638a-439d-4b80-901e-44bf6ce64734 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:05.543141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b624383-51a7-47f2-8619-980c81b429e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:05.543917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b624383-51a7-47f2-8619-980c81b429e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:05.544244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b624383-51a7-47f2-8619-980c81b429e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:05.544520 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b624383-51a7-47f2-8619-980c81b429e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:05.545255 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b624383-51a7-47f2-8619-980c81b429e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:05.553292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b624383-51a7-47f2-8619-980c81b429e8 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:05.571952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db36f6-ca68-44ad-bd39-1a3155e445fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:05.574930 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db36f6-ca68-44ad-bd39-1a3155e445fd service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:05.628663 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 902/1760] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:05.630342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db36f6-ca68-44ad-bd39-1a3155e445fd service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:05.645163 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 859/1761] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:05 2022] POST /identity/v3/users => generated 293 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:05.647385 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b624383-51a7-47f2-8619-980c81b429e8 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:05.649272 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db36f6-ca68-44ad-bd39-1a3155e445fd service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:05.660281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a4a83-6ebb-4675-b889-9b7be73ddf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:05.662850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4a83-6ebb-4675-b889-9b7be73ddf0b admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:05.663151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4a83-6ebb-4675-b889-9b7be73ddf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:05.663437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a4a83-6ebb-4675-b889-9b7be73ddf0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:05.666358 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a4a83-6ebb-4675-b889-9b7be73ddf0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:05.671175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a4a83-6ebb-4675-b889-9b7be73ddf0b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:05.772619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 903/1762] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:05 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:05.773703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a4a83-6ebb-4675-b889-9b7be73ddf0b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:05.787344 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-687a4a83-6ebb-4675-b889-9b7be73ddf0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:05.873242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b624383-51a7-47f2-8619-980c81b429e8 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:06.034429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a4a83-6ebb-4675-b889-9b7be73ddf0b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:06.048368 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67e5da-775c-414d-bea1-5cdb465639ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:06.050711 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67e5da-775c-414d-bea1-5cdb465639ed service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:06.051226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67e5da-775c-414d-bea1-5cdb465639ed service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:06.051677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67e5da-775c-414d-bea1-5cdb465639ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:06.088525 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c022a5-bf46-493a-8b88-a77d047e51f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:06.093539 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c022a5-bf46-493a-8b88-a77d047e51f9 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:06.095324 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c022a5-bf46-493a-8b88-a77d047e51f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:06.095635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c022a5-bf46-493a-8b88-a77d047e51f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:06.192959 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67e5da-775c-414d-bea1-5cdb465639ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:06.194763 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67e5da-775c-414d-bea1-5cdb465639ed service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:06.210720 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 904/1763] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:30:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:30:06.211392 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67e5da-775c-414d-bea1-5cdb465639ed service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:06.292526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c022a5-bf46-493a-8b88-a77d047e51f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:06.292526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c022a5-bf46-493a-8b88-a77d047e51f9 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:06.308728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:06.345235 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:06.349564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 860/1764] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:06.357895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c022a5-bf46-493a-8b88-a77d047e51f9 service nova] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:06.367737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-20c022a5-bf46-493a-8b88-a77d047e51f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:06.541819 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67e5da-775c-414d-bea1-5cdb465639ed service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:06.564438 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688fcda-3c38-4521-9944-3bb583563c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:06.568342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688fcda-3c38-4521-9944-3bb583563c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:06.572569 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688fcda-3c38-4521-9944-3bb583563c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:06.573235 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688fcda-3c38-4521-9944-3bb583563c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:06.579114 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688fcda-3c38-4521-9944-3bb583563c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:06.583692 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688fcda-3c38-4521-9944-3bb583563c25 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:06.656711 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 905/1765] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:06.657824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688fcda-3c38-4521-9944-3bb583563c25 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:06.712205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688fcda-3c38-4521-9944-3bb583563c25 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:06.728205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4755a53-3f44-433e-ac61-144a61f18f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:06.729070 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4755a53-3f44-433e-ac61-144a61f18f57 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:06.729463 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4755a53-3f44-433e-ac61-144a61f18f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:06.729851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4755a53-3f44-433e-ac61-144a61f18f57 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:06.731715 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4755a53-3f44-433e-ac61-144a61f18f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:06.735474 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4755a53-3f44-433e-ac61-144a61f18f57 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:06.802101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 906/1766] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:06 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:06.802101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4755a53-3f44-433e-ac61-144a61f18f57 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:06.843454 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c022a5-bf46-493a-8b88-a77d047e51f9 service nova] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:06.858352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4755a53-3f44-433e-ac61-144a61f18f57 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:06.865099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ce5bb-08d0-4286-9efb-8af98918819c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:06.866107 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a1c89-7262-48d1-81ae-0a33269e8a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:06.867194 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a1c89-7262-48d1-81ae-0a33269e8a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:06.867559 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a1c89-7262-48d1-81ae-0a33269e8a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:06.867689 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ce5bb-08d0-4286-9efb-8af98918819c service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:06.867980 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a1c89-7262-48d1-81ae-0a33269e8a82 admin admin] PATH_INFO: `/v3/projects/cb83e64e01924fa6ae81f1fe3992f2ed/users/d345e53148c2434d9c4a3643d21828b2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:06.869963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ce5bb-08d0-4286-9efb-8af98918819c service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:06.870995 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ce5bb-08d0-4286-9efb-8af98918819c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:06.945644 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a1c89-7262-48d1-81ae-0a33269e8a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb83e64e01924fa6ae81f1fe3992f2ed, user_id=d345e53148c2434d9c4a3643d21828b2, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:06.966915 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a1c89-7262-48d1-81ae-0a33269e8a82 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:07.135115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 907/1767] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:06 2022] PUT /identity/v3/projects/cb83e64e01924fa6ae81f1fe3992f2ed/users/d345e53148c2434d9c4a3643d21828b2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:07.147271 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a1c89-7262-48d1-81ae-0a33269e8a82 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:07.255128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ce5bb-08d0-4286-9efb-8af98918819c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:07.257619 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ce5bb-08d0-4286-9efb-8af98918819c service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:07.275368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 861/1768] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 925 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:07.277767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ce5bb-08d0-4286-9efb-8af98918819c service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:07.314276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ce5bb-08d0-4286-9efb-8af98918819c service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:07.400107 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a1c89-7262-48d1-81ae-0a33269e8a82 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:07.412216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a108047-1b1a-49df-aaa1-de4016dd3629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:07.412917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a108047-1b1a-49df-aaa1-de4016dd3629 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:07.413230 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a108047-1b1a-49df-aaa1-de4016dd3629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:07.413690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a108047-1b1a-49df-aaa1-de4016dd3629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:07.414727 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a108047-1b1a-49df-aaa1-de4016dd3629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:07.422014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a108047-1b1a-49df-aaa1-de4016dd3629 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:07.454344 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 908/1769] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:07.459962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a108047-1b1a-49df-aaa1-de4016dd3629 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:07.485673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a108047-1b1a-49df-aaa1-de4016dd3629 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:07.504176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e396e-5ef1-4276-bf65-5a332461e510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:07.507007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e396e-5ef1-4276-bf65-5a332461e510 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:07.507312 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e396e-5ef1-4276-bf65-5a332461e510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:07.507810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e396e-5ef1-4276-bf65-5a332461e510 admin admin] PATH_INFO: `/v3/projects/402a197d313047318e24b82808d9ff88/users/f76124ce9370464592e8b67213cc2cda/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:07.582603 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e396e-5ef1-4276-bf65-5a332461e510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=402a197d313047318e24b82808d9ff88, user_id=f76124ce9370464592e8b67213cc2cda, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:07.591390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e396e-5ef1-4276-bf65-5a332461e510 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:07.597364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18908f4-77ca-4c46-a611-16d6a70ebf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:07.598218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18908f4-77ca-4c46-a611-16d6a70ebf74 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:07.598621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18908f4-77ca-4c46-a611-16d6a70ebf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:07.599009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18908f4-77ca-4c46-a611-16d6a70ebf74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:07.602697 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18908f4-77ca-4c46-a611-16d6a70ebf74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:07.608156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18908f4-77ca-4c46-a611-16d6a70ebf74 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:07.654709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 862/1770] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:07.656228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18908f4-77ca-4c46-a611-16d6a70ebf74 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:07.664252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 909/1771] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:07 2022] PUT /identity/v3/projects/402a197d313047318e24b82808d9ff88/users/f76124ce9370464592e8b67213cc2cda/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:07.668134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e396e-5ef1-4276-bf65-5a332461e510 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:07.698248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18908f4-77ca-4c46-a611-16d6a70ebf74 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:07.875915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:07.951986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188575f-8f8e-4f52-885f-8283904ad8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:07.955765 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188575f-8f8e-4f52-885f-8283904ad8eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:07.958219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188575f-8f8e-4f52-885f-8283904ad8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:07.960983 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188575f-8f8e-4f52-885f-8283904ad8eb admin admin] PATH_INFO: `/v3/projects/cb83e64e01924fa6ae81f1fe3992f2ed/users/d345e53148c2434d9c4a3643d21828b2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:07.971770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188575f-8f8e-4f52-885f-8283904ad8eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb83e64e01924fa6ae81f1fe3992f2ed, user_id=d345e53148c2434d9c4a3643d21828b2, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:07.985936 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188575f-8f8e-4f52-885f-8283904ad8eb admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:07.987968 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:08.008559 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e396e-5ef1-4276-bf65-5a332461e510 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:08.048412 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 863/1772] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:07 2022] PUT /identity/v3/projects/cb83e64e01924fa6ae81f1fe3992f2ed/users/d345e53148c2434d9c4a3643d21828b2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:08.051485 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06197af2-079e-4d4d-8413-1007c8765f5b None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:08.051725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06197af2-079e-4d4d-8413-1007c8765f5b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:08.052059 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06197af2-079e-4d4d-8413-1007c8765f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:08.118796 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-06197af2-079e-4d4d-8413-1007c8765f5b None None] MFA Rules not processed for user `23aaef489c0948fe8bc10acb8e76c84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:08.120129 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-06197af2-079e-4d4d-8413-1007c8765f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:08.233664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f67a7d-afe4-4706-98cd-544bdb7f5415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:08.236001 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f67a7d-afe4-4706-98cd-544bdb7f5415 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:08.236451 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f67a7d-afe4-4706-98cd-544bdb7f5415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:08.236970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f67a7d-afe4-4706-98cd-544bdb7f5415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:08.237944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f67a7d-afe4-4706-98cd-544bdb7f5415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:08.259665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f67a7d-afe4-4706-98cd-544bdb7f5415 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:08.333676 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 910/1773] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 666 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:08.352701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5f4a2-c7ca-4ce7-aa2d-a5dcb3ff585d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:08.352701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5f4a2-c7ca-4ce7-aa2d-a5dcb3ff585d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:08.352701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5f4a2-c7ca-4ce7-aa2d-a5dcb3ff585d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:08.447496 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 864/1774] 10.222.0.17 () {58 vars in 1015 bytes} [Thu Jul 21 22:30:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:08.448975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c1c37-1de5-4289-a832-818227f5c8f8 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:08.450369 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c1c37-1de5-4289-a832-818227f5c8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:08.454441 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c1c37-1de5-4289-a832-818227f5c8f8 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:08.457266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 865/1775] 10.222.0.43 () {54 vars in 912 bytes} [Thu Jul 21 22:30:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:08.459600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c1c37-1de5-4289-a832-818227f5c8f8 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:08.519657 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a1d5f4a2-c7ca-4ce7-aa2d-a5dcb3ff585d None None] MFA Rules not processed for user `d345e53148c2434d9c4a3643d21828b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:08.522874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a1d5f4a2-c7ca-4ce7-aa2d-a5dcb3ff585d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:08.541229 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c1c37-1de5-4289-a832-818227f5c8f8 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:08.558675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb7036-c79c-4ef1-8842-0db8ba4969a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:08.559773 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb7036-c79c-4ef1-8842-0db8ba4969a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:08.560141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb7036-c79c-4ef1-8842-0db8ba4969a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:08.560533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb7036-c79c-4ef1-8842-0db8ba4969a3 admin admin] PATH_INFO: `/v3/projects/402a197d313047318e24b82808d9ff88/users/f76124ce9370464592e8b67213cc2cda/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:08.564671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb7036-c79c-4ef1-8842-0db8ba4969a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=402a197d313047318e24b82808d9ff88, user_id=f76124ce9370464592e8b67213cc2cda, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:08.579581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb7036-c79c-4ef1-8842-0db8ba4969a3 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:08.643834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 866/1776] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:08 2022] PUT /identity/v3/projects/402a197d313047318e24b82808d9ff88/users/f76124ce9370464592e8b67213cc2cda/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:08.650329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804757d4-8213-4b46-8d14-5095f49a4ec9 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:08.651442 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804757d4-8213-4b46-8d14-5095f49a4ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:08.652153 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804757d4-8213-4b46-8d14-5095f49a4ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:08.731173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-804757d4-8213-4b46-8d14-5095f49a4ec9 None None] MFA Rules not processed for user `23aaef489c0948fe8bc10acb8e76c84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:08.736393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-804757d4-8213-4b46-8d14-5095f49a4ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:08.745416 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 911/1777] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:08.746990 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40e626-15fc-453b-9289-854e0dde071d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:08.747359 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40e626-15fc-453b-9289-854e0dde071d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:08.747713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40e626-15fc-453b-9289-854e0dde071d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:08.830627 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3f40e626-15fc-453b-9289-854e0dde071d None None] MFA Rules not processed for user `f76124ce9370464592e8b67213cc2cda`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:08.833495 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3f40e626-15fc-453b-9289-854e0dde071d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:08.881621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 867/1778] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jul 21 22:30:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:08.885077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804757d4-8213-4b46-8d14-5095f49a4ec9 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:08.889653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-804757d4-8213-4b46-8d14-5095f49a4ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:08.908398 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804757d4-8213-4b46-8d14-5095f49a4ec9 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:08.912564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f793404-0e8a-4563-926b-1d92b00f4394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:08.913796 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f793404-0e8a-4563-926b-1d92b00f4394 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:08.914240 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f793404-0e8a-4563-926b-1d92b00f4394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:08.914691 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f793404-0e8a-4563-926b-1d92b00f4394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:08.930569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f793404-0e8a-4563-926b-1d92b00f4394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:08.932593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f793404-0e8a-4563-926b-1d92b00f4394 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:08.943737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 868/1779] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:08.944587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f793404-0e8a-4563-926b-1d92b00f4394 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:09.102189 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 912/1780] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:08 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:09.103753 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40e626-15fc-453b-9289-854e0dde071d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:09.153923 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40e626-15fc-453b-9289-854e0dde071d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:09.181634 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c0db9-3558-43e7-8bbe-a896ef4a7300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:09.182276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f793404-0e8a-4563-926b-1d92b00f4394 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:09.182611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c0db9-3558-43e7-8bbe-a896ef4a7300 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:09.183010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c0db9-3558-43e7-8bbe-a896ef4a7300 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:09.183406 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c0db9-3558-43e7-8bbe-a896ef4a7300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:09.206032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f462295-6b74-47e7-8da7-b48e278120b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:09.207078 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f462295-6b74-47e7-8da7-b48e278120b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:09.207960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f462295-6b74-47e7-8da7-b48e278120b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:09.208594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f462295-6b74-47e7-8da7-b48e278120b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:09.209384 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c0db9-3558-43e7-8bbe-a896ef4a7300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:09.210993 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c0db9-3558-43e7-8bbe-a896ef4a7300 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:09.215814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:09.237785 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 913/1781] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:09.250973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8482525-7a7c-4633-ba34-40712aebdd57 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:09.251672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8482525-7a7c-4633-ba34-40712aebdd57 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:09.253046 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8482525-7a7c-4633-ba34-40712aebdd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:09.296474 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:09.313049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c8482525-7a7c-4633-ba34-40712aebdd57 None None] MFA Rules not processed for user `0ab0db1bbc72471a90bbfc2e47561a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:09.316774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c8482525-7a7c-4633-ba34-40712aebdd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:09.394571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f462295-6b74-47e7-8da7-b48e278120b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:09.399267 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f462295-6b74-47e7-8da7-b48e278120b9 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:09.425521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 869/1782] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:09.427664 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f462295-6b74-47e7-8da7-b48e278120b9 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:09.449020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f462295-6b74-47e7-8da7-b48e278120b9 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:09.449626 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 914/1783] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:09.470377 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc0ce3-3b7c-4745-a112-178a2a8c8b0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:09.475474 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc0ce3-3b7c-4745-a112-178a2a8c8b0a service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:09.476097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc0ce3-3b7c-4745-a112-178a2a8c8b0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:09.476810 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc0ce3-3b7c-4745-a112-178a2a8c8b0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:09.500882 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc0ce3-3b7c-4745-a112-178a2a8c8b0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:09.505262 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc0ce3-3b7c-4745-a112-178a2a8c8b0a service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:09.535164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 870/1784] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:09 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:09.889414 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8482525-7a7c-4633-ba34-40712aebdd57 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:09.914596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8482525-7a7c-4633-ba34-40712aebdd57 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:09.955592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b80092-32b8-48d7-b9c5-d4208afb5cfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:09.956534 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b80092-32b8-48d7-b9c5-d4208afb5cfa service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:09.957011 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b80092-32b8-48d7-b9c5-d4208afb5cfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:09.957478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b80092-32b8-48d7-b9c5-d4208afb5cfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:10.198150 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b80092-32b8-48d7-b9c5-d4208afb5cfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:10.206922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b80092-32b8-48d7-b9c5-d4208afb5cfa service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:10.241958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 915/1785] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:12.084947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc0ce3-3b7c-4745-a112-178a2a8c8b0a service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:12.684056 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc0ce3-3b7c-4745-a112-178a2a8c8b0a service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:12.745172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262c7b4-16ac-469a-9126-6e58a0a78d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:12.750355 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262c7b4-16ac-469a-9126-6e58a0a78d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:12.753737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262c7b4-16ac-469a-9126-6e58a0a78d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:12.758104 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262c7b4-16ac-469a-9126-6e58a0a78d4c admin admin] PATH_INFO: `/v3/users/9937016384614c7e866eb76d19dc0feb` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:12.773207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262c7b4-16ac-469a-9126-6e58a0a78d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9937016384614c7e866eb76d19dc0feb)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:12.791146 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262c7b4-16ac-469a-9126-6e58a0a78d4c admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:12.890962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b80092-32b8-48d7-b9c5-d4208afb5cfa service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:12.933531 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b80092-32b8-48d7-b9c5-d4208afb5cfa service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:12.981924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d656e-ca32-47b8-a601-c07f4fc037b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:12.989663 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d656e-ca32-47b8-a601-c07f4fc037b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:12.991040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d656e-ca32-47b8-a601-c07f4fc037b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:12.993650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d656e-ca32-47b8-a601-c07f4fc037b9 admin admin] PATH_INFO: `/v3/users/b3fa98c8a31a43a7b2b391f93020f2ba` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:13.028146 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d656e-ca32-47b8-a601-c07f4fc037b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3fa98c8a31a43a7b2b391f93020f2ba)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:13.039759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d656e-ca32-47b8-a601-c07f4fc037b9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:13.139711 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5262c7b4-16ac-469a-9126-6e58a0a78d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9937016384614c7e866eb76d19dc0feb'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:13.212593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5262c7b4-16ac-469a-9126-6e58a0a78d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9937016384614c7e866eb76d19dc0feb'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:13.229188 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5262c7b4-16ac-469a-9126-6e58a0a78d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9937016384614c7e866eb76d19dc0feb'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:13.344745 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5262c7b4-16ac-469a-9126-6e58a0a78d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9937016384614c7e866eb76d19dc0feb'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:13.379860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5262c7b4-16ac-469a-9126-6e58a0a78d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9937016384614c7e866eb76d19dc0feb'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:13.387371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9c5d656e-ca32-47b8-a601-c07f4fc037b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3fa98c8a31a43a7b2b391f93020f2ba'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:13.421249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 871/1786] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:12 2022] DELETE /identity/v3/users/9937016384614c7e866eb76d19dc0feb => generated 0 bytes in 1334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:13.430819 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102cce-a9ca-4687-8c15-7922b0c2caac None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:13.431312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102cce-a9ca-4687-8c15-7922b0c2caac None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:13.433822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102cce-a9ca-4687-8c15-7922b0c2caac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:13.466162 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9c5d656e-ca32-47b8-a601-c07f4fc037b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3fa98c8a31a43a7b2b391f93020f2ba'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:13.526452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9c5d656e-ca32-47b8-a601-c07f4fc037b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3fa98c8a31a43a7b2b391f93020f2ba'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:13.530530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9c5d656e-ca32-47b8-a601-c07f4fc037b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3fa98c8a31a43a7b2b391f93020f2ba'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:13.550287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9c5d656e-ca32-47b8-a601-c07f4fc037b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3fa98c8a31a43a7b2b391f93020f2ba'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:13.551057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-fb102cce-a9ca-4687-8c15-7922b0c2caac None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:13.554419 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-fb102cce-a9ca-4687-8c15-7922b0c2caac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:13.561420 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 916/1787] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:12 2022] DELETE /identity/v3/users/b3fa98c8a31a43a7b2b391f93020f2ba => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:13.566219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a57c0-6eba-41d1-8d7d-1dbf4cb1f341 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:13.566669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a57c0-6eba-41d1-8d7d-1dbf4cb1f341 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:13.567525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a57c0-6eba-41d1-8d7d-1dbf4cb1f341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:13.658881 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-dd7a57c0-6eba-41d1-8d7d-1dbf4cb1f341 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:13.662129 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:13.665500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dd7a57c0-6eba-41d1-8d7d-1dbf4cb1f341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:13.699677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:13.767161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 872/1788] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:13.894092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 917/1789] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:14.211944 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb102cce-a9ca-4687-8c15-7922b0c2caac None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:14.213412 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-fb102cce-a9ca-4687-8c15-7922b0c2caac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:14.215657 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a57c0-6eba-41d1-8d7d-1dbf4cb1f341 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:14.217102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dd7a57c0-6eba-41d1-8d7d-1dbf4cb1f341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:14.427811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a57c0-6eba-41d1-8d7d-1dbf4cb1f341 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:14.437932 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b96fc-926c-4569-9b74-6b2b5a6a6105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:14.443333 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b96fc-926c-4569-9b74-6b2b5a6a6105 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:14.443929 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b96fc-926c-4569-9b74-6b2b5a6a6105 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:14.444498 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b96fc-926c-4569-9b74-6b2b5a6a6105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:14.474613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b96fc-926c-4569-9b74-6b2b5a6a6105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:14.476420 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b96fc-926c-4569-9b74-6b2b5a6a6105 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:14.500590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb102cce-a9ca-4687-8c15-7922b0c2caac None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:14.522431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 918/1790] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:14.532588 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fbe20-358b-46e2-8f32-4b129a4c90b8 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:14.534394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fbe20-358b-46e2-8f32-4b129a4c90b8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:14.536809 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fbe20-358b-46e2-8f32-4b129a4c90b8 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:14.547442 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 919/1791] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jul 21 22:30:14 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:14.550477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea38573-32d1-4b30-bb1f-d944775fd4c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:14.555950 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38573-32d1-4b30-bb1f-d944775fd4c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:14.556337 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38573-32d1-4b30-bb1f-d944775fd4c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:14.556632 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38573-32d1-4b30-bb1f-d944775fd4c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:14.627474 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb071f-18a2-42fa-9274-189aed46767a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:14.627756 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb071f-18a2-42fa-9274-189aed46767a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:14.628041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb071f-18a2-42fa-9274-189aed46767a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:14.631621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea38573-32d1-4b30-bb1f-d944775fd4c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:14.633113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea38573-32d1-4b30-bb1f-d944775fd4c9 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:14.702794 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 873/1792] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:14.706387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-acdb071f-18a2-42fa-9274-189aed46767a None None] MFA Rules not processed for user `2c04dc3ee4484afaab388cbb306974af`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:14.724617 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-acdb071f-18a2-42fa-9274-189aed46767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:14.898319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea38573-32d1-4b30-bb1f-d944775fd4c9 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:14.900325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-eea38573-32d1-4b30-bb1f-d944775fd4c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:14.962748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea38573-32d1-4b30-bb1f-d944775fd4c9 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:15.010263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40de9f2-0f6b-4eeb-84db-c22cd6db9a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:15.024464 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40de9f2-0f6b-4eeb-84db-c22cd6db9a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:15.027227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40de9f2-0f6b-4eeb-84db-c22cd6db9a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:15.027821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40de9f2-0f6b-4eeb-84db-c22cd6db9a33 admin admin] PATH_INFO: `/v3/users/08ae7d7fef224f579d47503150bd4862` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:15.035012 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40de9f2-0f6b-4eeb-84db-c22cd6db9a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ae7d7fef224f579d47503150bd4862)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:15.040238 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40de9f2-0f6b-4eeb-84db-c22cd6db9a33 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:15.185919 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a40de9f2-0f6b-4eeb-84db-c22cd6db9a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ae7d7fef224f579d47503150bd4862'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:15.223138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 920/1793] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jul 21 22:30:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 597 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:15.229280 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a40de9f2-0f6b-4eeb-84db-c22cd6db9a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ae7d7fef224f579d47503150bd4862'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:15.232164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a40de9f2-0f6b-4eeb-84db-c22cd6db9a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ae7d7fef224f579d47503150bd4862'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:15.307684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a40de9f2-0f6b-4eeb-84db-c22cd6db9a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ae7d7fef224f579d47503150bd4862'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:15.335013 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a40de9f2-0f6b-4eeb-84db-c22cd6db9a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ae7d7fef224f579d47503150bd4862'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:15.353019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 874/1794] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:14 2022] DELETE /identity/v3/users/08ae7d7fef224f579d47503150bd4862 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:15.357819 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b392c-7004-46b6-9aec-92398af16a04 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:15.358354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b392c-7004-46b6-9aec-92398af16a04 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:15.358742 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b392c-7004-46b6-9aec-92398af16a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:15.428061 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4c8b392c-7004-46b6-9aec-92398af16a04 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:15.434357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4c8b392c-7004-46b6-9aec-92398af16a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:15.604066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:15.649510 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 921/1795] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:15.662440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40de9f2-0f6b-4eeb-84db-c22cd6db9a33 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:15.665164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a40de9f2-0f6b-4eeb-84db-c22cd6db9a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:15.873037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:15.886081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40de9f2-0f6b-4eeb-84db-c22cd6db9a33 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:15.925764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cebae4-6124-430d-b702-14b001208993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:15.926452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cebae4-6124-430d-b702-14b001208993 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:15.926739 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cebae4-6124-430d-b702-14b001208993 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:15.927019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cebae4-6124-430d-b702-14b001208993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:15.948406 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cebae4-6124-430d-b702-14b001208993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:15.950568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cebae4-6124-430d-b702-14b001208993 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:15.979674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 875/1796] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:16.209081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b392c-7004-46b6-9aec-92398af16a04 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:16.211264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4c8b392c-7004-46b6-9aec-92398af16a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:16.227296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b392c-7004-46b6-9aec-92398af16a04 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:16.245746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f9f60-d8a8-482d-bbc7-36298f063901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:16.247958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f9f60-d8a8-482d-bbc7-36298f063901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:16.249252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f9f60-d8a8-482d-bbc7-36298f063901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:16.250584 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f9f60-d8a8-482d-bbc7-36298f063901 admin admin] PATH_INFO: `/v3/users/a7e8b7cab8e44004ab421c5ea60afa0c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:16.256466 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f9f60-d8a8-482d-bbc7-36298f063901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e8b7cab8e44004ab421c5ea60afa0c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:16.264856 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f9f60-d8a8-482d-bbc7-36298f063901 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:16.399275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-606f9f60-d8a8-482d-bbc7-36298f063901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e8b7cab8e44004ab421c5ea60afa0c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:16.454222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cebae4-6124-430d-b702-14b001208993 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:16.455957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-43cebae4-6124-430d-b702-14b001208993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:16.473217 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-606f9f60-d8a8-482d-bbc7-36298f063901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e8b7cab8e44004ab421c5ea60afa0c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:16.511460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-606f9f60-d8a8-482d-bbc7-36298f063901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e8b7cab8e44004ab421c5ea60afa0c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:16.517101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-606f9f60-d8a8-482d-bbc7-36298f063901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e8b7cab8e44004ab421c5ea60afa0c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:16.541888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-606f9f60-d8a8-482d-bbc7-36298f063901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e8b7cab8e44004ab421c5ea60afa0c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:16.578232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 922/1797] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:16 2022] DELETE /identity/v3/users/a7e8b7cab8e44004ab421c5ea60afa0c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:16.594227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808accf-21cc-4ba9-97c6-7095d803ec81 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:16.595943 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808accf-21cc-4ba9-97c6-7095d803ec81 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:16.614545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808accf-21cc-4ba9-97c6-7095d803ec81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:16.667249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c808accf-21cc-4ba9-97c6-7095d803ec81 None None] MFA Rules not processed for user `1e24364e59144eae846d5a5efa260dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:16.668509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c808accf-21cc-4ba9-97c6-7095d803ec81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:16.866300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 923/1798] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:16.873335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f2e57-9f8a-478b-be40-9156ffe0adcd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:16.873771 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f2e57-9f8a-478b-be40-9156ffe0adcd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:16.874191 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f2e57-9f8a-478b-be40-9156ffe0adcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:16.932811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d66f2e57-9f8a-478b-be40-9156ffe0adcd None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:16.934079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d66f2e57-9f8a-478b-be40-9156ffe0adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:16.938654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cebae4-6124-430d-b702-14b001208993 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:17.155691 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaea4d6-7ac2-4143-a765-cdd089be939b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:17.157235 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaea4d6-7ac2-4143-a765-cdd089be939b service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:17.157797 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaea4d6-7ac2-4143-a765-cdd089be939b service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:17.158236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaea4d6-7ac2-4143-a765-cdd089be939b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:17.162089 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2aaea4d6-7ac2-4143-a765-cdd089be939b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:17.191355 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaea4d6-7ac2-4143-a765-cdd089be939b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:17.193607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaea4d6-7ac2-4143-a765-cdd089be939b service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:17.200119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 924/1799] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:17.201141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f2e57-9f8a-478b-be40-9156ffe0adcd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:17.203119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d66f2e57-9f8a-478b-be40-9156ffe0adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:17.236344 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 876/1800] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 773 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:17.241177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc4b31-a690-4a79-9abb-75fdacf0488c None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:17.242044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc4b31-a690-4a79-9abb-75fdacf0488c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:17.242924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc4b31-a690-4a79-9abb-75fdacf0488c None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:17.251692 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 877/1801] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jul 21 22:30:17 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:17.251927 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f2e57-9f8a-478b-be40-9156ffe0adcd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:17.256123 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc4b31-a690-4a79-9abb-75fdacf0488c None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:17.257252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949753c-dc48-4f43-a338-0cbf9f858b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:17.258269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949753c-dc48-4f43-a338-0cbf9f858b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:17.261996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949753c-dc48-4f43-a338-0cbf9f858b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:17.262398 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949753c-dc48-4f43-a338-0cbf9f858b44 admin admin] PATH_INFO: `/v3/projects/08f6748a038d4c5baf674340129540ee` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:17.264419 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949753c-dc48-4f43-a338-0cbf9f858b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f6748a038d4c5baf674340129540ee)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:17.264713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-cabc4b31-a690-4a79-9abb-75fdacf0488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:17.281217 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949753c-dc48-4f43-a338-0cbf9f858b44 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:17.285760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:17.391807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f949753c-dc48-4f43-a338-0cbf9f858b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f6748a038d4c5baf674340129540ee', 'request_id': 'req-f949753c-dc48-4f43-a338-0cbf9f858b44'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:17.398788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f949753c-dc48-4f43-a338-0cbf9f858b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f6748a038d4c5baf674340129540ee', 'request_id': 'req-f949753c-dc48-4f43-a338-0cbf9f858b44'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:17.406676 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f949753c-dc48-4f43-a338-0cbf9f858b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f6748a038d4c5baf674340129540ee', 'request_id': 'req-f949753c-dc48-4f43-a338-0cbf9f858b44'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:17.439462 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f949753c-dc48-4f43-a338-0cbf9f858b44 admin admin] The token cache is being invalidate because project 08f6748a038d4c5baf674340129540ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:17.439714 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f949753c-dc48-4f43-a338-0cbf9f858b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:17.443229 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f949753c-dc48-4f43-a338-0cbf9f858b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:17.447628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 925/1802] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:17 2022] DELETE /identity/v3/projects/08f6748a038d4c5baf674340129540ee => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:17.448914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949753c-dc48-4f43-a338-0cbf9f858b44 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:17.453527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f949753c-dc48-4f43-a338-0cbf9f858b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:17.478431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc4b31-a690-4a79-9abb-75fdacf0488c None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:17.556729 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949753c-dc48-4f43-a338-0cbf9f858b44 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:17.563657 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb366e5-6449-42fd-a244-477286aa277e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:17.565424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb366e5-6449-42fd-a244-477286aa277e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:17.566131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb366e5-6449-42fd-a244-477286aa277e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:17.566625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb366e5-6449-42fd-a244-477286aa277e admin admin] PATH_INFO: `/v3/projects/e3296bb2f8d34f1682603fd5c9e3d627` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:17.568194 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb366e5-6449-42fd-a244-477286aa277e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3296bb2f8d34f1682603fd5c9e3d627)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:17.570663 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb366e5-6449-42fd-a244-477286aa277e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:17.644294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0cb366e5-6449-42fd-a244-477286aa277e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3296bb2f8d34f1682603fd5c9e3d627', 'request_id': 'req-0cb366e5-6449-42fd-a244-477286aa277e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:17.648160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:17.657232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0cb366e5-6449-42fd-a244-477286aa277e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3296bb2f8d34f1682603fd5c9e3d627', 'request_id': 'req-0cb366e5-6449-42fd-a244-477286aa277e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:17.666002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0cb366e5-6449-42fd-a244-477286aa277e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3296bb2f8d34f1682603fd5c9e3d627', 'request_id': 'req-0cb366e5-6449-42fd-a244-477286aa277e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:17.695204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0cb366e5-6449-42fd-a244-477286aa277e admin admin] The token cache is being invalidate because project e3296bb2f8d34f1682603fd5c9e3d627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:17.698296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0cb366e5-6449-42fd-a244-477286aa277e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:17.700314 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0cb366e5-6449-42fd-a244-477286aa277e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:17.703483 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ee102-965d-466b-a05a-29d20990cc3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:17.704278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ee102-965d-466b-a05a-29d20990cc3e service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:17.704722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ee102-965d-466b-a05a-29d20990cc3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:17.705092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ee102-965d-466b-a05a-29d20990cc3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:17.705320 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 926/1803] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:17 2022] DELETE /identity/v3/projects/e3296bb2f8d34f1682603fd5c9e3d627 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:17.710305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c599d31-87ac-40fb-8caa-83fd345b4fdc None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:17.711034 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c599d31-87ac-40fb-8caa-83fd345b4fdc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:17.711852 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c599d31-87ac-40fb-8caa-83fd345b4fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:17.713892 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-5e2ee102-965d-466b-a05a-29d20990cc3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:17.738607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ee102-965d-466b-a05a-29d20990cc3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:17.740247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ee102-965d-466b-a05a-29d20990cc3e service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:17.764084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 878/1804] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:17.764986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ee102-965d-466b-a05a-29d20990cc3e service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:17.769979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-5e2ee102-965d-466b-a05a-29d20990cc3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:17.788828 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0c599d31-87ac-40fb-8caa-83fd345b4fdc None None] MFA Rules not processed for user `2c04dc3ee4484afaab388cbb306974af`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:17.792958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ee102-965d-466b-a05a-29d20990cc3e service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:17.800542 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0c599d31-87ac-40fb-8caa-83fd345b4fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:17.838513 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:17.916083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feaf34-9fe6-4df7-be68-f2f91824600e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:17.916896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feaf34-9fe6-4df7-be68-f2f91824600e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:17.917216 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feaf34-9fe6-4df7-be68-f2f91824600e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:17.917494 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feaf34-9fe6-4df7-be68-f2f91824600e admin admin] PATH_INFO: `/v3/users/1a32ab8541cc4abab34663bfa24b3649` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:17.922432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09feaf34-9fe6-4df7-be68-f2f91824600e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a32ab8541cc4abab34663bfa24b3649)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:17.924791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09feaf34-9fe6-4df7-be68-f2f91824600e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:17.964798 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 927/1805] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jul 21 22:30:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:17.965755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c599d31-87ac-40fb-8caa-83fd345b4fdc None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:17.967126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0c599d31-87ac-40fb-8caa-83fd345b4fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:18.005841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c599d31-87ac-40fb-8caa-83fd345b4fdc None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:18.022923 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf926e7f-7ebc-4c2f-8941-1ac17ce61778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:18.023866 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf926e7f-7ebc-4c2f-8941-1ac17ce61778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:18.024149 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf926e7f-7ebc-4c2f-8941-1ac17ce61778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:18.028720 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf926e7f-7ebc-4c2f-8941-1ac17ce61778 admin admin] PATH_INFO: `/v3/users/d345e53148c2434d9c4a3643d21828b2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:18.039367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf926e7f-7ebc-4c2f-8941-1ac17ce61778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d345e53148c2434d9c4a3643d21828b2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:18.042754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-09feaf34-9fe6-4df7-be68-f2f91824600e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a32ab8541cc4abab34663bfa24b3649'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:18.042932 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf926e7f-7ebc-4c2f-8941-1ac17ce61778 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:18.076141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-09feaf34-9fe6-4df7-be68-f2f91824600e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a32ab8541cc4abab34663bfa24b3649'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:18.081523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-09feaf34-9fe6-4df7-be68-f2f91824600e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a32ab8541cc4abab34663bfa24b3649'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:18.130953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-09feaf34-9fe6-4df7-be68-f2f91824600e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a32ab8541cc4abab34663bfa24b3649'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:18.165376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-09feaf34-9fe6-4df7-be68-f2f91824600e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a32ab8541cc4abab34663bfa24b3649'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:18.188976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 879/1806] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:17 2022] DELETE /identity/v3/users/1a32ab8541cc4abab34663bfa24b3649 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:18.255770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cf926e7f-7ebc-4c2f-8941-1ac17ce61778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd345e53148c2434d9c4a3643d21828b2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:18.276825 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cf926e7f-7ebc-4c2f-8941-1ac17ce61778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd345e53148c2434d9c4a3643d21828b2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:18.288532 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cf926e7f-7ebc-4c2f-8941-1ac17ce61778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd345e53148c2434d9c4a3643d21828b2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:18.289864 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cf926e7f-7ebc-4c2f-8941-1ac17ce61778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd345e53148c2434d9c4a3643d21828b2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:18.308418 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cf926e7f-7ebc-4c2f-8941-1ac17ce61778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd345e53148c2434d9c4a3643d21828b2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:18.330351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 928/1807] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:17 2022] DELETE /identity/v3/users/d345e53148c2434d9c4a3643d21828b2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:18.684507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feaf34-9fe6-4df7-be68-f2f91824600e admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:18.686000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-09feaf34-9fe6-4df7-be68-f2f91824600e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:18.792092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf926e7f-7ebc-4c2f-8941-1ac17ce61778 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:18.797598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cf926e7f-7ebc-4c2f-8941-1ac17ce61778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:18.804647 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:18.847021 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feaf34-9fe6-4df7-be68-f2f91824600e admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:18.954763 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf926e7f-7ebc-4c2f-8941-1ac17ce61778 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:18.970780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3f90e-a726-4acc-a558-d24ca876e4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:18.971648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3f90e-a726-4acc-a558-d24ca876e4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:18.971942 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3f90e-a726-4acc-a558-d24ca876e4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:18.973519 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3f90e-a726-4acc-a558-d24ca876e4fa admin admin] PATH_INFO: `/v3/projects/e2618a357d6d4fee8b78b1812620d75c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:18.978599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3f90e-a726-4acc-a558-d24ca876e4fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2618a357d6d4fee8b78b1812620d75c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:18.981401 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3f90e-a726-4acc-a558-d24ca876e4fa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:18.994914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ac46-b5e3-498d-a984-828b2ac5ed56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:18.995576 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ac46-b5e3-498d-a984-828b2ac5ed56 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:18.995856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ac46-b5e3-498d-a984-828b2ac5ed56 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:18.996165 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ac46-b5e3-498d-a984-828b2ac5ed56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:19.002518 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e871ac46-b5e3-498d-a984-828b2ac5ed56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:19.030106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871ac46-b5e3-498d-a984-828b2ac5ed56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:19.033728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871ac46-b5e3-498d-a984-828b2ac5ed56 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:19.051961 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:19.056318 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 880/1808] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:19.086947 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f8f3f90e-a726-4acc-a558-d24ca876e4fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2618a357d6d4fee8b78b1812620d75c', 'request_id': 'req-f8f3f90e-a726-4acc-a558-d24ca876e4fa'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:19.111110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f8f3f90e-a726-4acc-a558-d24ca876e4fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2618a357d6d4fee8b78b1812620d75c', 'request_id': 'req-f8f3f90e-a726-4acc-a558-d24ca876e4fa'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:19.126651 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f8f3f90e-a726-4acc-a558-d24ca876e4fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2618a357d6d4fee8b78b1812620d75c', 'request_id': 'req-f8f3f90e-a726-4acc-a558-d24ca876e4fa'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:19.176259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f8f3f90e-a726-4acc-a558-d24ca876e4fa admin admin] The token cache is being invalidate because project e2618a357d6d4fee8b78b1812620d75c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:19.177203 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f8f3f90e-a726-4acc-a558-d24ca876e4fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:19.178542 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f8f3f90e-a726-4acc-a558-d24ca876e4fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:19.180600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 929/1809] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:18 2022] DELETE /identity/v3/projects/e2618a357d6d4fee8b78b1812620d75c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:19.184743 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ac46-b5e3-498d-a984-828b2ac5ed56 service nova] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:19.202209 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ac46-b5e3-498d-a984-828b2ac5ed56 service nova] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:19.328487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c4d97-0807-4d67-89c4-84b2ea778318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:19.331371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c4d97-0807-4d67-89c4-84b2ea778318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:19.331709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c4d97-0807-4d67-89c4-84b2ea778318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:19.333449 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c4d97-0807-4d67-89c4-84b2ea778318 admin admin] PATH_INFO: `/v3/users/4026f851d26047f5b78ce5b7fa31ec71` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:19.336547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c4d97-0807-4d67-89c4-84b2ea778318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4026f851d26047f5b78ce5b7fa31ec71)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:19.339938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c4d97-0807-4d67-89c4-84b2ea778318 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:19.462381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-da1c4d97-0807-4d67-89c4-84b2ea778318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4026f851d26047f5b78ce5b7fa31ec71'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:19.471665 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-da1c4d97-0807-4d67-89c4-84b2ea778318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4026f851d26047f5b78ce5b7fa31ec71'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:19.472599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-da1c4d97-0807-4d67-89c4-84b2ea778318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4026f851d26047f5b78ce5b7fa31ec71'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:19.490508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-da1c4d97-0807-4d67-89c4-84b2ea778318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4026f851d26047f5b78ce5b7fa31ec71'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:19.495055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:19.501535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-da1c4d97-0807-4d67-89c4-84b2ea778318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4026f851d26047f5b78ce5b7fa31ec71'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:19.530271 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 881/1810] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:19 2022] DELETE /identity/v3/users/4026f851d26047f5b78ce5b7fa31ec71 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:20.240413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3f90e-a726-4acc-a558-d24ca876e4fa admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:20.242427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f8f3f90e-a726-4acc-a558-d24ca876e4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:20.271938 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3f90e-a726-4acc-a558-d24ca876e4fa admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:20.500208 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74834ea0-6172-4c18-b0f3-3d5511d3f4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:20.501554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74834ea0-6172-4c18-b0f3-3d5511d3f4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:20.503018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74834ea0-6172-4c18-b0f3-3d5511d3f4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:20.503490 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74834ea0-6172-4c18-b0f3-3d5511d3f4df admin admin] PATH_INFO: `/v3/projects/ce763bbe26b74edf8fff8e9959026834` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:20.507386 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74834ea0-6172-4c18-b0f3-3d5511d3f4df admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce763bbe26b74edf8fff8e9959026834)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:20.511083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74834ea0-6172-4c18-b0f3-3d5511d3f4df admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:20.551810 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c4d97-0807-4d67-89c4-84b2ea778318 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:20.553543 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-da1c4d97-0807-4d67-89c4-84b2ea778318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:20.579671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c4d97-0807-4d67-89c4-84b2ea778318 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:20.590674 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-74834ea0-6172-4c18-b0f3-3d5511d3f4df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce763bbe26b74edf8fff8e9959026834', 'request_id': 'req-74834ea0-6172-4c18-b0f3-3d5511d3f4df'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:20.601900 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-74834ea0-6172-4c18-b0f3-3d5511d3f4df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce763bbe26b74edf8fff8e9959026834', 'request_id': 'req-74834ea0-6172-4c18-b0f3-3d5511d3f4df'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:20.611800 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-74834ea0-6172-4c18-b0f3-3d5511d3f4df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce763bbe26b74edf8fff8e9959026834', 'request_id': 'req-74834ea0-6172-4c18-b0f3-3d5511d3f4df'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:20.632547 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-74834ea0-6172-4c18-b0f3-3d5511d3f4df admin admin] The token cache is being invalidate because project ce763bbe26b74edf8fff8e9959026834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:20.632970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-74834ea0-6172-4c18-b0f3-3d5511d3f4df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:20.635547 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-74834ea0-6172-4c18-b0f3-3d5511d3f4df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:20.641141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 930/1811] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:20 2022] DELETE /identity/v3/projects/ce763bbe26b74edf8fff8e9959026834 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:20.643469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79de00-a77f-47ea-8be2-57b59941dcf3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:20.643899 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79de00-a77f-47ea-8be2-57b59941dcf3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:20.644412 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79de00-a77f-47ea-8be2-57b59941dcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:20.694637 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ce79de00-a77f-47ea-8be2-57b59941dcf3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:20.699381 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ce79de00-a77f-47ea-8be2-57b59941dcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:20.824737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8751f-a1b9-4df3-8cf3-79d5b3f4409a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:20.825878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8751f-a1b9-4df3-8cf3-79d5b3f4409a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:20.826363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8751f-a1b9-4df3-8cf3-79d5b3f4409a admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:20.826832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8751f-a1b9-4df3-8cf3-79d5b3f4409a admin admin] PATH_INFO: `/v3/projects/832e81d968914261b8ab541671c5fec8` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:20.830700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8751f-a1b9-4df3-8cf3-79d5b3f4409a admin admin] RBAC: Authorizing `identity:delete_project(project_id=832e81d968914261b8ab541671c5fec8)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:20.833060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8751f-a1b9-4df3-8cf3-79d5b3f4409a admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:20.848062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:20.944010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 931/1812] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:20.944010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79de00-a77f-47ea-8be2-57b59941dcf3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:20.944010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ce79de00-a77f-47ea-8be2-57b59941dcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:20.984718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79de00-a77f-47ea-8be2-57b59941dcf3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:20.995882 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7ca8751f-a1b9-4df3-8cf3-79d5b3f4409a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832e81d968914261b8ab541671c5fec8', 'request_id': 'req-7ca8751f-a1b9-4df3-8cf3-79d5b3f4409a'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:21.019651 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7ca8751f-a1b9-4df3-8cf3-79d5b3f4409a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832e81d968914261b8ab541671c5fec8', 'request_id': 'req-7ca8751f-a1b9-4df3-8cf3-79d5b3f4409a'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:21.042262 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7ca8751f-a1b9-4df3-8cf3-79d5b3f4409a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832e81d968914261b8ab541671c5fec8', 'request_id': 'req-7ca8751f-a1b9-4df3-8cf3-79d5b3f4409a'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:21.061343 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7ca8751f-a1b9-4df3-8cf3-79d5b3f4409a admin admin] The token cache is being invalidate because project 832e81d968914261b8ab541671c5fec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:21.062459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7ca8751f-a1b9-4df3-8cf3-79d5b3f4409a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:21.063374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7ca8751f-a1b9-4df3-8cf3-79d5b3f4409a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:21.083566 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 882/1813] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:20 2022] DELETE /identity/v3/projects/832e81d968914261b8ab541671c5fec8 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:21.085331 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586071a-2300-4bbe-8502-8ca72491be0c None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:21.085625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586071a-2300-4bbe-8502-8ca72491be0c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:21.086801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586071a-2300-4bbe-8502-8ca72491be0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:21.116782 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-c586071a-2300-4bbe-8502-8ca72491be0c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:21.119814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c586071a-2300-4bbe-8502-8ca72491be0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:21.191193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:21.192086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:21.192373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:21.192642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24 admin admin] PATH_INFO: `/v3/projects/d364115b80bf4218ad7e324106010184` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:21.194355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d364115b80bf4218ad7e324106010184)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:21.196300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:21.293182 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 883/1814] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:21.300341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586071a-2300-4bbe-8502-8ca72491be0c None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:21.300341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c586071a-2300-4bbe-8502-8ca72491be0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:21.329600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586071a-2300-4bbe-8502-8ca72491be0c None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:21.337880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4345a2-08ed-42d9-b572-f67ed2c5f734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:21.339759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4345a2-08ed-42d9-b572-f67ed2c5f734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:21.340054 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4345a2-08ed-42d9-b572-f67ed2c5f734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:21.340852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4345a2-08ed-42d9-b572-f67ed2c5f734 admin admin] PATH_INFO: `/v3/users/f76124ce9370464592e8b67213cc2cda` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:21.344433 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4345a2-08ed-42d9-b572-f67ed2c5f734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f76124ce9370464592e8b67213cc2cda)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:21.348858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4345a2-08ed-42d9-b572-f67ed2c5f734 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:21.386757 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd364115b80bf4218ad7e324106010184', 'request_id': 'req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:21.397172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:21.403848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd364115b80bf4218ad7e324106010184', 'request_id': 'req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:21.454728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd364115b80bf4218ad7e324106010184', 'request_id': 'req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:21.487734 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5d4345a2-08ed-42d9-b572-f67ed2c5f734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f76124ce9370464592e8b67213cc2cda'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:21.488905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24 admin admin] The token cache is being invalidate because project d364115b80bf4218ad7e324106010184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:21.489505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:21.491606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:21.498108 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5d4345a2-08ed-42d9-b572-f67ed2c5f734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f76124ce9370464592e8b67213cc2cda'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:21.498706 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 932/1815] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:20 2022] DELETE /identity/v3/projects/d364115b80bf4218ad7e324106010184 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:21.498879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5d4345a2-08ed-42d9-b572-f67ed2c5f734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f76124ce9370464592e8b67213cc2cda'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:21.500214 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:21.504851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:21.541682 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5d4345a2-08ed-42d9-b572-f67ed2c5f734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f76124ce9370464592e8b67213cc2cda'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:21.565599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5d4345a2-08ed-42d9-b572-f67ed2c5f734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f76124ce9370464592e8b67213cc2cda'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:21.573776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 884/1816] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:21 2022] DELETE /identity/v3/users/f76124ce9370464592e8b67213cc2cda => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:21.575053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141945b-ca59-444e-996c-98d8b9c1a120 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:21.575341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141945b-ca59-444e-996c-98d8b9c1a120 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:21.575621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141945b-ca59-444e-996c-98d8b9c1a120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:21.623421 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-1141945b-ca59-444e-996c-98d8b9c1a120 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:21.625416 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-1141945b-ca59-444e-996c-98d8b9c1a120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:21.669060 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f941a7d-d6b0-4ee9-82b2-ec5131fecf24 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:21.712881 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:21.759734 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 885/1817] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:21.762170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d8dd4-beb7-4934-a01e-01e6957bfde8 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:21.762682 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d8dd4-beb7-4934-a01e-01e6957bfde8 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:21.763207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d8dd4-beb7-4934-a01e-01e6957bfde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:21.778556 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58e2fd-cd1c-429e-b67a-ec9e76d24ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:21.779358 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58e2fd-cd1c-429e-b67a-ec9e76d24ada admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:21.779711 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58e2fd-cd1c-429e-b67a-ec9e76d24ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:21.780014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58e2fd-cd1c-429e-b67a-ec9e76d24ada admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:21.781855 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58e2fd-cd1c-429e-b67a-ec9e76d24ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:21.782277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58e2fd-cd1c-429e-b67a-ec9e76d24ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:21.784822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58e2fd-cd1c-429e-b67a-ec9e76d24ada admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:21.790494 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-e09d8dd4-beb7-4934-a01e-01e6957bfde8 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:21.792802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e09d8dd4-beb7-4934-a01e-01e6957bfde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:21.804174 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 933/1818] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:21.805941 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58e2fd-cd1c-429e-b67a-ec9e76d24ada admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:21.807717 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fc58e2fd-cd1c-429e-b67a-ec9e76d24ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:21.816652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 886/1819] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:21.817863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d8dd4-beb7-4934-a01e-01e6957bfde8 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:21.826005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58e2fd-cd1c-429e-b67a-ec9e76d24ada admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:21.833488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96433b73-186f-4ddd-961a-7b4a1de4ba93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:21.834157 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96433b73-186f-4ddd-961a-7b4a1de4ba93 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:21.834441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96433b73-186f-4ddd-961a-7b4a1de4ba93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:21.834719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96433b73-186f-4ddd-961a-7b4a1de4ba93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:21.835655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d8dd4-beb7-4934-a01e-01e6957bfde8 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:21.835775 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96433b73-186f-4ddd-961a-7b4a1de4ba93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:21.837887 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96433b73-186f-4ddd-961a-7b4a1de4ba93 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:21.846054 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf69b53-54b5-446a-934a-145dea74c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:21.847126 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf69b53-54b5-446a-934a-145dea74c49d admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:21.847479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf69b53-54b5-446a-934a-145dea74c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:21.847844 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf69b53-54b5-446a-934a-145dea74c49d admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:21.848687 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf69b53-54b5-446a-934a-145dea74c49d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:21.849337 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf69b53-54b5-446a-934a-145dea74c49d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:21.851411 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf69b53-54b5-446a-934a-145dea74c49d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:21.885884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 887/1820] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:21.893568 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 934/1821] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:21 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:21.901499 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf69b53-54b5-446a-934a-145dea74c49d admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:21.901643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96433b73-186f-4ddd-961a-7b4a1de4ba93 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:21.903893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-96433b73-186f-4ddd-961a-7b4a1de4ba93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:21.931018 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf69b53-54b5-446a-934a-145dea74c49d admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:22.034657 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d3c0-5e2c-4953-ac8a-086cf83044e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:22.038378 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d3c0-5e2c-4953-ac8a-086cf83044e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:22.038759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d3c0-5e2c-4953-ac8a-086cf83044e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:22.039113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d3c0-5e2c-4953-ac8a-086cf83044e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:22.041136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354d3c0-5e2c-4953-ac8a-086cf83044e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:22.047732 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354d3c0-5e2c-4953-ac8a-086cf83044e9 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:22.087900 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96433b73-186f-4ddd-961a-7b4a1de4ba93 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:22.108323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:22.112496 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 888/1822] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:21 2022] POST /identity/v3/projects => generated 393 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:22.112658 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:22.112658 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:22.112834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d3c0-5e2c-4953-ac8a-086cf83044e9 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:22.112942 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8 admin admin] PATH_INFO: `/v3/projects/cb83e64e01924fa6ae81f1fe3992f2ed` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:22.113470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb83e64e01924fa6ae81f1fe3992f2ed)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:22.115479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:22.125940 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:22.215020 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb83e64e01924fa6ae81f1fe3992f2ed', 'request_id': 'req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:22.216912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d3c0-5e2c-4953-ac8a-086cf83044e9 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:22.233535 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb83e64e01924fa6ae81f1fe3992f2ed', 'request_id': 'req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:22.251500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb83e64e01924fa6ae81f1fe3992f2ed', 'request_id': 'req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:22.272535 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8 admin admin] The token cache is being invalidate because project cb83e64e01924fa6ae81f1fe3992f2ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:22.273303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:22.274456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:22.277041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 935/1823] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:21 2022] DELETE /identity/v3/projects/cb83e64e01924fa6ae81f1fe3992f2ed => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:22.278423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:22.280226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:22.341099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:22.350283 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ebec3-857a-4bbb-b6c7-784bb65ea8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:22.351359 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ebec3-857a-4bbb-b6c7-784bb65ea8bb admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:22.351730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ebec3-857a-4bbb-b6c7-784bb65ea8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:22.352106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ebec3-857a-4bbb-b6c7-784bb65ea8bb admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:22.353071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ebec3-857a-4bbb-b6c7-784bb65ea8bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:22.355084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ebec3-857a-4bbb-b6c7-784bb65ea8bb admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:22.378398 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 889/1824] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:22 2022] POST /identity/v3/users => generated 285 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:22.379776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3089562-7e89-4987-b179-7e900b2be174 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:22.380100 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3089562-7e89-4987-b179-7e900b2be174 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:22.380353 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3089562-7e89-4987-b179-7e900b2be174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:22.406916 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e3c1f-2c55-4d6d-beb1-f25f9d3b24e8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:22.415162 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-e3089562-7e89-4987-b179-7e900b2be174 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:22.416551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e3089562-7e89-4987-b179-7e900b2be174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:22.429661 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 890/1825] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:22.430790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3089562-7e89-4987-b179-7e900b2be174 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:22.432301 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e3089562-7e89-4987-b179-7e900b2be174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:22.432525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e587bef-7b3c-4087-a570-c8ea71b8940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:22.433287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e587bef-7b3c-4087-a570-c8ea71b8940e admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:22.433572 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e587bef-7b3c-4087-a570-c8ea71b8940e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:22.433849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e587bef-7b3c-4087-a570-c8ea71b8940e admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:22.434555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e587bef-7b3c-4087-a570-c8ea71b8940e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:22.438084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e587bef-7b3c-4087-a570-c8ea71b8940e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:22.447335 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3089562-7e89-4987-b179-7e900b2be174 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:22.455183 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bde639-6e51-4837-a441-7edd828a868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:22.456158 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bde639-6e51-4837-a441-7edd828a868f admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:22.456603 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bde639-6e51-4837-a441-7edd828a868f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:22.457355 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bde639-6e51-4837-a441-7edd828a868f admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:22.458641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bde639-6e51-4837-a441-7edd828a868f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:22.460375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bde639-6e51-4837-a441-7edd828a868f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:22.468492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 936/1826] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:22 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:22.468492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac88143-c25c-4897-9ba0-9f6176bf8cb3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:22.468738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac88143-c25c-4897-9ba0-9f6176bf8cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:22.469078 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac88143-c25c-4897-9ba0-9f6176bf8cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:22.477372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 891/1827] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:22.477372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bde639-6e51-4837-a441-7edd828a868f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:22.490384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bde639-6e51-4837-a441-7edd828a868f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:22.496375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210392f2-93c7-4dbb-9ff5-b4b530a9b8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:22.497202 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210392f2-93c7-4dbb-9ff5-b4b530a9b8ad admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:22.497586 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210392f2-93c7-4dbb-9ff5-b4b530a9b8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:22.497963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210392f2-93c7-4dbb-9ff5-b4b530a9b8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:22.498865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210392f2-93c7-4dbb-9ff5-b4b530a9b8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:22.501379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210392f2-93c7-4dbb-9ff5-b4b530a9b8ad admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:22.501919 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-eac88143-c25c-4897-9ba0-9f6176bf8cb3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:22.504105 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-eac88143-c25c-4897-9ba0-9f6176bf8cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:22.516401 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 892/1828] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:22.516401 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210392f2-93c7-4dbb-9ff5-b4b530a9b8ad admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:22.518217 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 937/1829] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:22.519792 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac88143-c25c-4897-9ba0-9f6176bf8cb3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:22.528963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210392f2-93c7-4dbb-9ff5-b4b530a9b8ad admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:22.532188 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac88143-c25c-4897-9ba0-9f6176bf8cb3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:22.535139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e6f8b-5648-4fac-92d6-311b6c33ca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:22.535926 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e6f8b-5648-4fac-92d6-311b6c33ca90 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:22.536368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e6f8b-5648-4fac-92d6-311b6c33ca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:22.536695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e6f8b-5648-4fac-92d6-311b6c33ca90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:22.537550 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e6f8b-5648-4fac-92d6-311b6c33ca90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:22.539245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e6f8b-5648-4fac-92d6-311b6c33ca90 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:22.539918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d3d3f-ccc7-4740-a058-282484e3766a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:22.540619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d3d3f-ccc7-4740-a058-282484e3766a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:22.540896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d3d3f-ccc7-4740-a058-282484e3766a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:22.541195 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d3d3f-ccc7-4740-a058-282484e3766a admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:22.542549 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d3d3f-ccc7-4740-a058-282484e3766a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:22.547966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d3d3f-ccc7-4740-a058-282484e3766a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:22.555072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 893/1830] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:22.556125 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e6f8b-5648-4fac-92d6-311b6c33ca90 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:22.570871 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e6f8b-5648-4fac-92d6-311b6c33ca90 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:22.571436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 938/1831] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:22.572729 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d3d3f-ccc7-4740-a058-282484e3766a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:22.588164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118168-ed00-44d4-b8d7-bb4f3bd0d7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:22.589114 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118168-ed00-44d4-b8d7-bb4f3bd0d7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:22.589732 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118168-ed00-44d4-b8d7-bb4f3bd0d7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:22.590227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118168-ed00-44d4-b8d7-bb4f3bd0d7c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:22.590817 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f118168-ed00-44d4-b8d7-bb4f3bd0d7c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:22.591568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f118168-ed00-44d4-b8d7-bb4f3bd0d7c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:22.601265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f118168-ed00-44d4-b8d7-bb4f3bd0d7c9 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:22.601459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d3d3f-ccc7-4740-a058-282484e3766a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:22.606581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960dd9d-e1b9-48e1-9f87-42c2d4bbf137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:22.607589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960dd9d-e1b9-48e1-9f87-42c2d4bbf137 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:22.607933 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960dd9d-e1b9-48e1-9f87-42c2d4bbf137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:22.608207 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960dd9d-e1b9-48e1-9f87-42c2d4bbf137 admin admin] PATH_INFO: `/v3/projects/cb91bac67d51428d804e132535293680/users/aa983813b9364cf4b895aec7b66deb02/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:22.642722 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960dd9d-e1b9-48e1-9f87-42c2d4bbf137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb91bac67d51428d804e132535293680, user_id=aa983813b9364cf4b895aec7b66deb02, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:22.645501 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960dd9d-e1b9-48e1-9f87-42c2d4bbf137 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:22.647933 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 894/1832] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:22.648821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118168-ed00-44d4-b8d7-bb4f3bd0d7c9 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:22.666818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118168-ed00-44d4-b8d7-bb4f3bd0d7c9 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:22.672979 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 939/1833] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:22 2022] PUT /identity/v3/projects/cb91bac67d51428d804e132535293680/users/aa983813b9364cf4b895aec7b66deb02/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:22.674122 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960dd9d-e1b9-48e1-9f87-42c2d4bbf137 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:22.687005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e960dd9d-e1b9-48e1-9f87-42c2d4bbf137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:22.767087 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:22.790385 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e8494-cad3-44d0-bf21-87a28812ca1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:22.806548 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e8494-cad3-44d0-bf21-87a28812ca1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:22.807996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e8494-cad3-44d0-bf21-87a28812ca1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:22.807996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e8494-cad3-44d0-bf21-87a28812ca1f admin admin] PATH_INFO: `/v3/projects/465fda7e0565420fa8066575a71138b9/users/e21f820ce3bb44c99a43dbeb7bdfa9ae/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:22.829078 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960dd9d-e1b9-48e1-9f87-42c2d4bbf137 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:22.834424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e8494-cad3-44d0-bf21-87a28812ca1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=465fda7e0565420fa8066575a71138b9, user_id=e21f820ce3bb44c99a43dbeb7bdfa9ae, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:22.836398 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce144-fe81-4a2e-9602-71958e09ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:22.837328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce144-fe81-4a2e-9602-71958e09ec39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:22.837510 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e8494-cad3-44d0-bf21-87a28812ca1f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:22.837628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce144-fe81-4a2e-9602-71958e09ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:22.837869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce144-fe81-4a2e-9602-71958e09ec39 admin admin] PATH_INFO: `/v3/projects/402a197d313047318e24b82808d9ff88` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:22.840846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce144-fe81-4a2e-9602-71958e09ec39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=402a197d313047318e24b82808d9ff88)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:22.843809 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce144-fe81-4a2e-9602-71958e09ec39 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:22.854761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 895/1834] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:22 2022] PUT /identity/v3/projects/465fda7e0565420fa8066575a71138b9/users/e21f820ce3bb44c99a43dbeb7bdfa9ae/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:22.856131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e8494-cad3-44d0-bf21-87a28812ca1f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:22.954096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e25ce144-fe81-4a2e-9602-71958e09ec39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '402a197d313047318e24b82808d9ff88', 'request_id': 'req-e25ce144-fe81-4a2e-9602-71958e09ec39'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:22.969482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e8494-cad3-44d0-bf21-87a28812ca1f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:22.973238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e25ce144-fe81-4a2e-9602-71958e09ec39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '402a197d313047318e24b82808d9ff88', 'request_id': 'req-e25ce144-fe81-4a2e-9602-71958e09ec39'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:22.979836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e25ce144-fe81-4a2e-9602-71958e09ec39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '402a197d313047318e24b82808d9ff88', 'request_id': 'req-e25ce144-fe81-4a2e-9602-71958e09ec39'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:22.997599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e25ce144-fe81-4a2e-9602-71958e09ec39 admin admin] The token cache is being invalidate because project 402a197d313047318e24b82808d9ff88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:22.998396 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e25ce144-fe81-4a2e-9602-71958e09ec39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:22.999429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e25ce144-fe81-4a2e-9602-71958e09ec39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:23.005184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 940/1835] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:22 2022] DELETE /identity/v3/projects/402a197d313047318e24b82808d9ff88 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:23.008978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad829f-aea2-4634-a595-8a86c2c56185 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.009734 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad829f-aea2-4634-a595-8a86c2c56185 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.010049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad829f-aea2-4634-a595-8a86c2c56185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.020004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:23.047218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c7ad829f-aea2-4634-a595-8a86c2c56185 None None] MFA Rules not processed for user `aa983813b9364cf4b895aec7b66deb02`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:23.048049 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71a4dd-c3f7-4117-8e22-f7d9c3bad268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.048456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c7ad829f-aea2-4634-a595-8a86c2c56185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:23.048909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71a4dd-c3f7-4117-8e22-f7d9c3bad268 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.049457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71a4dd-c3f7-4117-8e22-f7d9c3bad268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.049967 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71a4dd-c3f7-4117-8e22-f7d9c3bad268 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.050763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71a4dd-c3f7-4117-8e22-f7d9c3bad268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.052827 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71a4dd-c3f7-4117-8e22-f7d9c3bad268 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.110535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 896/1836] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:22 2022] POST /identity/v3/projects => generated 387 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:23.111963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ccc6d-f2bc-49f3-a3b7-75b30cb7d629 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.112345 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ccc6d-f2bc-49f3-a3b7-75b30cb7d629 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.112716 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ccc6d-f2bc-49f3-a3b7-75b30cb7d629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.142364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 941/1837] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:23.143591 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191ba31-5708-47e0-8e61-c984b9615422 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.144029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191ba31-5708-47e0-8e61-c984b9615422 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.144329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191ba31-5708-47e0-8e61-c984b9615422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.149057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-f45ccc6d-f2bc-49f3-a3b7-75b30cb7d629 None None] MFA Rules not processed for user `e21f820ce3bb44c99a43dbeb7bdfa9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:23.150343 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f45ccc6d-f2bc-49f3-a3b7-75b30cb7d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:23.171745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c191ba31-5708-47e0-8e61-c984b9615422 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:23.174291 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c191ba31-5708-47e0-8e61-c984b9615422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:23.234219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:23.248107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 897/1838] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:23.250804 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ccc6d-f2bc-49f3-a3b7-75b30cb7d629 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:23.255012 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f45ccc6d-f2bc-49f3-a3b7-75b30cb7d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:23.261844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 942/1839] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:23.261844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191ba31-5708-47e0-8e61-c984b9615422 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:23.261844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c191ba31-5708-47e0-8e61-c984b9615422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:23.271902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191ba31-5708-47e0-8e61-c984b9615422 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:23.278549 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9985997-35e9-4bbb-b090-9b113dd5547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.279329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9985997-35e9-4bbb-b090-9b113dd5547a admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.279617 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9985997-35e9-4bbb-b090-9b113dd5547a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.279895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9985997-35e9-4bbb-b090-9b113dd5547a admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.280569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ccc6d-f2bc-49f3-a3b7-75b30cb7d629 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:23.280684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9985997-35e9-4bbb-b090-9b113dd5547a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.283144 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9985997-35e9-4bbb-b090-9b113dd5547a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.288532 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a03770-7c47-40ce-8d88-a637b917d630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.289304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a03770-7c47-40ce-8d88-a637b917d630 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.289591 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a03770-7c47-40ce-8d88-a637b917d630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.289870 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a03770-7c47-40ce-8d88-a637b917d630 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.293464 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a03770-7c47-40ce-8d88-a637b917d630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.295481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a03770-7c47-40ce-8d88-a637b917d630 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.316540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 943/1840] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:23 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:23.317456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9985997-35e9-4bbb-b090-9b113dd5547a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:23.319848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c9985997-35e9-4bbb-b090-9b113dd5547a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:23.322873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 898/1841] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:23 2022] POST /identity/v3/users => generated 294 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:23.324409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1f170-bc8f-4c1e-aff8-a3d585649abb None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.324770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1f170-bc8f-4c1e-aff8-a3d585649abb None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.325010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1f170-bc8f-4c1e-aff8-a3d585649abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.360974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-5cc1f170-bc8f-4c1e-aff8-a3d585649abb None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:23.362195 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-5cc1f170-bc8f-4c1e-aff8-a3d585649abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:23.402742 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9985997-35e9-4bbb-b090-9b113dd5547a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:23.408911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ce98e-dece-4230-99d0-d8327feb77b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.409816 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ce98e-dece-4230-99d0-d8327feb77b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.410098 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ce98e-dece-4230-99d0-d8327feb77b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.410377 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ce98e-dece-4230-99d0-d8327feb77b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.411870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ce98e-dece-4230-99d0-d8327feb77b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.415855 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ce98e-dece-4230-99d0-d8327feb77b3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.437063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 899/1842] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:23.437063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1f170-bc8f-4c1e-aff8-a3d585649abb None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:23.446285 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:23.452574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1f170-bc8f-4c1e-aff8-a3d585649abb None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:23.458093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56329a4b-be14-4fa4-bdf1-5c22f796628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.458982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56329a4b-be14-4fa4-bdf1-5c22f796628a admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.459366 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56329a4b-be14-4fa4-bdf1-5c22f796628a admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.459951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56329a4b-be14-4fa4-bdf1-5c22f796628a admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.460798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56329a4b-be14-4fa4-bdf1-5c22f796628a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.462881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56329a4b-be14-4fa4-bdf1-5c22f796628a admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.476033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 944/1843] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:23 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:23.476659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ce98e-dece-4230-99d0-d8327feb77b3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:23.499164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 900/1844] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:23 2022] POST /identity/v3/users => generated 291 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:23.500552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56329a4b-be14-4fa4-bdf1-5c22f796628a admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:23.510894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56329a4b-be14-4fa4-bdf1-5c22f796628a admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:23.573357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ce98e-dece-4230-99d0-d8327feb77b3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:23.577960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bf301-74ff-4f59-b11a-7e771c25ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.578113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3286c2e-36c9-4114-94d9-3b5466e9d9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.578627 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bf301-74ff-4f59-b11a-7e771c25ab31 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.578730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3286c2e-36c9-4114-94d9-3b5466e9d9fa admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.578913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3286c2e-36c9-4114-94d9-3b5466e9d9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.579006 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bf301-74ff-4f59-b11a-7e771c25ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.579187 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bf301-74ff-4f59-b11a-7e771c25ab31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.579273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3286c2e-36c9-4114-94d9-3b5466e9d9fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.579916 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bf301-74ff-4f59-b11a-7e771c25ab31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.580016 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3286c2e-36c9-4114-94d9-3b5466e9d9fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:23.580256 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3286c2e-36c9-4114-94d9-3b5466e9d9fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.581553 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bf301-74ff-4f59-b11a-7e771c25ab31 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.581864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3286c2e-36c9-4114-94d9-3b5466e9d9fa admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.592043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 945/1845] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:23.592916 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bf301-74ff-4f59-b11a-7e771c25ab31 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:23.595944 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 901/1846] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:23.596951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3286c2e-36c9-4114-94d9-3b5466e9d9fa admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:23.603496 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bf301-74ff-4f59-b11a-7e771c25ab31 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:23.608233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4b477-d56c-4411-bf5a-852923fe8e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.608719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3286c2e-36c9-4114-94d9-3b5466e9d9fa admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:23.609545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4b477-d56c-4411-bf5a-852923fe8e66 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.609830 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4b477-d56c-4411-bf5a-852923fe8e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.610110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4b477-d56c-4411-bf5a-852923fe8e66 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.610867 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4b477-d56c-4411-bf5a-852923fe8e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.612713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4b477-d56c-4411-bf5a-852923fe8e66 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.614213 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c8d1b-9128-498b-8777-0c1d6fb2d2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.614864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c8d1b-9128-498b-8777-0c1d6fb2d2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.615180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c8d1b-9128-498b-8777-0c1d6fb2d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.615460 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c8d1b-9128-498b-8777-0c1d6fb2d2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.616184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c8d1b-9128-498b-8777-0c1d6fb2d2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.617796 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c8d1b-9128-498b-8777-0c1d6fb2d2e2 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.629009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 902/1847] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:23.629899 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c8d1b-9128-498b-8777-0c1d6fb2d2e2 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:23.637622 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 946/1848] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:23 2022] POST /identity/v3/users => generated 302 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:23.638282 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4b477-d56c-4411-bf5a-852923fe8e66 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:23.639429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c8d1b-9128-498b-8777-0c1d6fb2d2e2 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:23.644157 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f0b6f-1940-432f-b68b-564ede54d43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.644804 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f0b6f-1940-432f-b68b-564ede54d43a admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.645131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f0b6f-1940-432f-b68b-564ede54d43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.645389 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f0b6f-1940-432f-b68b-564ede54d43a admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.646179 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f0b6f-1940-432f-b68b-564ede54d43a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.647680 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f0b6f-1940-432f-b68b-564ede54d43a admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.648108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4b477-d56c-4411-bf5a-852923fe8e66 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:23.652675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa98e52-53ab-4c23-ba39-a3bd9435e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.653349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa98e52-53ab-4c23-ba39-a3bd9435e44b admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.653629 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa98e52-53ab-4c23-ba39-a3bd9435e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.653904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa98e52-53ab-4c23-ba39-a3bd9435e44b admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.654579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa98e52-53ab-4c23-ba39-a3bd9435e44b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.657259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa98e52-53ab-4c23-ba39-a3bd9435e44b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.661902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 903/1849] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:23.661902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f0b6f-1940-432f-b68b-564ede54d43a admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:23.669062 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f0b6f-1940-432f-b68b-564ede54d43a admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:23.674386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe616b7-9e53-45d0-9730-45f438ad429b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.675247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe616b7-9e53-45d0-9730-45f438ad429b admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.675526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe616b7-9e53-45d0-9730-45f438ad429b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.675849 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe616b7-9e53-45d0-9730-45f438ad429b admin admin] PATH_INFO: `/v3/projects/635b7ac2c1d44269bbee29906f331070/users/b05caf1fa56642399cd880501f77961e/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.686564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 947/1850] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:23 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:23.687565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa98e52-53ab-4c23-ba39-a3bd9435e44b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:23.691135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe616b7-9e53-45d0-9730-45f438ad429b admin admin] RBAC: Authorizing `identity:create_grant(project_id=635b7ac2c1d44269bbee29906f331070, user_id=b05caf1fa56642399cd880501f77961e, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.694047 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe616b7-9e53-45d0-9730-45f438ad429b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.707227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 904/1851] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:23 2022] PUT /identity/v3/projects/635b7ac2c1d44269bbee29906f331070/users/b05caf1fa56642399cd880501f77961e/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:23.707994 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe616b7-9e53-45d0-9730-45f438ad429b admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:23.715985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:23.756494 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa98e52-53ab-4c23-ba39-a3bd9435e44b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:23.778634 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe616b7-9e53-45d0-9730-45f438ad429b admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:23.787315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea70e46-66d2-48c8-8705-f8880dd3c0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.788435 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea70e46-66d2-48c8-8705-f8880dd3c0ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.788800 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea70e46-66d2-48c8-8705-f8880dd3c0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.789167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea70e46-66d2-48c8-8705-f8880dd3c0ed admin admin] PATH_INFO: `/v3/projects/a21ebca513a84044a2fdd904642b13d2/users/3dc49ea37fc34fbc878bf667f0282129/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.811501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea70e46-66d2-48c8-8705-f8880dd3c0ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21ebca513a84044a2fdd904642b13d2, user_id=3dc49ea37fc34fbc878bf667f0282129, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.815633 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea70e46-66d2-48c8-8705-f8880dd3c0ed admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.848728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 905/1852] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:23 2022] PUT /identity/v3/projects/a21ebca513a84044a2fdd904642b13d2/users/3dc49ea37fc34fbc878bf667f0282129/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:23.848728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea70e46-66d2-48c8-8705-f8880dd3c0ed admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:23.920837 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb66c9b-15c6-4b4a-a259-f6a5dd6e0eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.921135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb66c9b-15c6-4b4a-a259-f6a5dd6e0eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.921579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb66c9b-15c6-4b4a-a259-f6a5dd6e0eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.921868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb66c9b-15c6-4b4a-a259-f6a5dd6e0eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.922613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb66c9b-15c6-4b4a-a259-f6a5dd6e0eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.924251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb66c9b-15c6-4b4a-a259-f6a5dd6e0eb7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.925920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:23.938690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 948/1853] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:23.939661 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb66c9b-15c6-4b4a-a259-f6a5dd6e0eb7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:23.950093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea70e46-66d2-48c8-8705-f8880dd3c0ed admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:23.950757 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb66c9b-15c6-4b4a-a259-f6a5dd6e0eb7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:23.955596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bbf2e-3130-411c-9839-0932ef7a1303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.955944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec487be-2166-4fe6-a83d-0b855e9abbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:23.956276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bbf2e-3130-411c-9839-0932ef7a1303 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.956560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bbf2e-3130-411c-9839-0932ef7a1303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.956782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec487be-2166-4fe6-a83d-0b855e9abbed admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.956878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bbf2e-3130-411c-9839-0932ef7a1303 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.957340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec487be-2166-4fe6-a83d-0b855e9abbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.957553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bbf2e-3130-411c-9839-0932ef7a1303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.957795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec487be-2166-4fe6-a83d-0b855e9abbed admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.958611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec487be-2166-4fe6-a83d-0b855e9abbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:23.959477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bbf2e-3130-411c-9839-0932ef7a1303 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.960208 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec487be-2166-4fe6-a83d-0b855e9abbed admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:23.971668 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 949/1854] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:23.972834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c6883-1619-4c37-94ad-db01cabfc76d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:23.973148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c6883-1619-4c37-94ad-db01cabfc76d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:23.973428 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c6883-1619-4c37-94ad-db01cabfc76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:23.998085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 906/1855] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:23 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:23.998982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bbf2e-3130-411c-9839-0932ef7a1303 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:24.009001 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bbf2e-3130-411c-9839-0932ef7a1303 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:24.010035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7c6c6883-1619-4c37-94ad-db01cabfc76d None None] MFA Rules not processed for user `3dc49ea37fc34fbc878bf667f0282129`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:24.011497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7c6c6883-1619-4c37-94ad-db01cabfc76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:24.013679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fee02e-54c1-4029-9231-2e90950aceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:24.014551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fee02e-54c1-4029-9231-2e90950aceda admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:24.015340 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fee02e-54c1-4029-9231-2e90950aceda admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:24.016328 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fee02e-54c1-4029-9231-2e90950aceda admin admin] PATH_INFO: `/v3/projects/a63d944e862047aeaad1dce1f27335c0/users/f1d84565784b4c62ae9fd1d1d155d5f4/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:24.032192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fee02e-54c1-4029-9231-2e90950aceda admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63d944e862047aeaad1dce1f27335c0, user_id=f1d84565784b4c62ae9fd1d1d155d5f4, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:24.034895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fee02e-54c1-4029-9231-2e90950aceda admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:24.051843 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 907/1856] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:23 2022] PUT /identity/v3/projects/a63d944e862047aeaad1dce1f27335c0/users/f1d84565784b4c62ae9fd1d1d155d5f4/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:24.058231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fee02e-54c1-4029-9231-2e90950aceda admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:24.102232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 950/1857] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:24.103150 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c6883-1619-4c37-94ad-db01cabfc76d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:24.118908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c6883-1619-4c37-94ad-db01cabfc76d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:24.161178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:24.169758 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fee02e-54c1-4029-9231-2e90950aceda admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:24.181162 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031b063-024c-49b3-93c2-ea7d85c9c9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:24.182488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031b063-024c-49b3-93c2-ea7d85c9c9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:24.182782 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031b063-024c-49b3-93c2-ea7d85c9c9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:24.183086 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031b063-024c-49b3-93c2-ea7d85c9c9ca admin admin] PATH_INFO: `/v3/projects/635b7ac2c1d44269bbee29906f331070/users/b05caf1fa56642399cd880501f77961e/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:24.186477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031b063-024c-49b3-93c2-ea7d85c9c9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=635b7ac2c1d44269bbee29906f331070, user_id=b05caf1fa56642399cd880501f77961e, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:24.189689 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031b063-024c-49b3-93c2-ea7d85c9c9ca admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:24.208354 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 908/1858] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:24 2022] PUT /identity/v3/projects/635b7ac2c1d44269bbee29906f331070/users/b05caf1fa56642399cd880501f77961e/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:24.208354 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031b063-024c-49b3-93c2-ea7d85c9c9ca admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:24.262073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81f4b9-87b2-4040-86ed-19dc143ab7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:24.275392 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81f4b9-87b2-4040-86ed-19dc143ab7fc admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:24.277956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81f4b9-87b2-4040-86ed-19dc143ab7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:24.279065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81f4b9-87b2-4040-86ed-19dc143ab7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:24.282060 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81f4b9-87b2-4040-86ed-19dc143ab7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:24.283931 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81f4b9-87b2-4040-86ed-19dc143ab7fc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:24.299558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031b063-024c-49b3-93c2-ea7d85c9c9ca admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:24.305452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7f368-c34b-441b-84e9-b1ab314d9ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:24.306380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7f368-c34b-441b-84e9-b1ab314d9ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:24.306812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7f368-c34b-441b-84e9-b1ab314d9ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:24.307257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7f368-c34b-441b-84e9-b1ab314d9ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:24.308327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7f368-c34b-441b-84e9-b1ab314d9ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:24.310407 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7f368-c34b-441b-84e9-b1ab314d9ab3 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:24.315773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 951/1859] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:24.317905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81f4b9-87b2-4040-86ed-19dc143ab7fc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:24.327205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 909/1860] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:24.329142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4297a-233f-4f1c-9383-1b0471c343fe None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:24.329780 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4297a-233f-4f1c-9383-1b0471c343fe None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:24.330195 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4297a-233f-4f1c-9383-1b0471c343fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:24.342690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81f4b9-87b2-4040-86ed-19dc143ab7fc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:24.357288 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ce5ea-42a5-495d-b0e5-3241719224ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:24.358128 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ce5ea-42a5-495d-b0e5-3241719224ed admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:24.358533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ce5ea-42a5-495d-b0e5-3241719224ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:24.359874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ce5ea-42a5-495d-b0e5-3241719224ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:24.360797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ce5ea-42a5-495d-b0e5-3241719224ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:24.363297 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ce5ea-42a5-495d-b0e5-3241719224ed admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:24.366036 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-eaa4297a-233f-4f1c-9383-1b0471c343fe None None] MFA Rules not processed for user `b05caf1fa56642399cd880501f77961e`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:24.367460 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-eaa4297a-233f-4f1c-9383-1b0471c343fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:24.412349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 952/1861] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:24 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:24.413401 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ce5ea-42a5-495d-b0e5-3241719224ed admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:24.496222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 910/1862] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:24 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:24.496222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4297a-233f-4f1c-9383-1b0471c343fe None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:24.496496 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:24.519708 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ce5ea-42a5-495d-b0e5-3241719224ed admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:24.526083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4297a-233f-4f1c-9383-1b0471c343fe None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:24.531307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf74f7-8a80-4e60-9bb4-5e19bf830431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:24.531700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962d283-234a-434e-a96a-b738e97bb7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:24.532544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf74f7-8a80-4e60-9bb4-5e19bf830431 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:24.532733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962d283-234a-434e-a96a-b738e97bb7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:24.533261 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf74f7-8a80-4e60-9bb4-5e19bf830431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:24.533594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962d283-234a-434e-a96a-b738e97bb7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:24.533880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962d283-234a-434e-a96a-b738e97bb7e5 admin admin] PATH_INFO: `/v3/projects/a63d944e862047aeaad1dce1f27335c0/users/f1d84565784b4c62ae9fd1d1d155d5f4/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:24.534308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf74f7-8a80-4e60-9bb4-5e19bf830431 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:24.535269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf74f7-8a80-4e60-9bb4-5e19bf830431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:24.536436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962d283-234a-434e-a96a-b738e97bb7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63d944e862047aeaad1dce1f27335c0, user_id=f1d84565784b4c62ae9fd1d1d155d5f4, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:24.538242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf74f7-8a80-4e60-9bb4-5e19bf830431 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:24.538679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962d283-234a-434e-a96a-b738e97bb7e5 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:24.554311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 911/1863] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:24 2022] PUT /identity/v3/projects/a63d944e862047aeaad1dce1f27335c0/users/f1d84565784b4c62ae9fd1d1d155d5f4/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:24.555184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962d283-234a-434e-a96a-b738e97bb7e5 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:24.557783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 953/1864] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:24.558938 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf74f7-8a80-4e60-9bb4-5e19bf830431 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:24.566127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-61cf74f7-8a80-4e60-9bb4-5e19bf830431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:24.636885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf74f7-8a80-4e60-9bb4-5e19bf830431 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:24.647895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:24.658947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962d283-234a-434e-a96a-b738e97bb7e5 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:24.666058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670166b-3160-478c-8907-c3f4b8766386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:24.667573 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670166b-3160-478c-8907-c3f4b8766386 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:24.667956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670166b-3160-478c-8907-c3f4b8766386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:24.668329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670166b-3160-478c-8907-c3f4b8766386 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:24.669170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670166b-3160-478c-8907-c3f4b8766386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:24.671852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670166b-3160-478c-8907-c3f4b8766386 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:24.701695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579e4a7-0819-42aa-8bec-4083e703452d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:24.702657 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579e4a7-0819-42aa-8bec-4083e703452d service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:24.702933 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579e4a7-0819-42aa-8bec-4083e703452d service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:24.703268 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579e4a7-0819-42aa-8bec-4083e703452d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:24.708004 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 912/1865] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:24 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:24.712380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670166b-3160-478c-8907-c3f4b8766386 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:24.735455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670166b-3160-478c-8907-c3f4b8766386 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:24.741340 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703abf5e-c2c0-4676-9f00-1e320a246118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:24.742613 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703abf5e-c2c0-4676-9f00-1e320a246118 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:24.743876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703abf5e-c2c0-4676-9f00-1e320a246118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:24.745010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703abf5e-c2c0-4676-9f00-1e320a246118 admin admin] PATH_INFO: `/v3/projects/7f8dcc3b82464b1384540b34486b13a9/users/0230a16f181d4b3b97bbecc1ebc4a266/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:24.767390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703abf5e-c2c0-4676-9f00-1e320a246118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8dcc3b82464b1384540b34486b13a9, user_id=0230a16f181d4b3b97bbecc1ebc4a266, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:24.772489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703abf5e-c2c0-4676-9f00-1e320a246118 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:24.776669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579e4a7-0819-42aa-8bec-4083e703452d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:24.778400 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579e4a7-0819-42aa-8bec-4083e703452d service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:24.808419 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 913/1866] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:24 2022] PUT /identity/v3/projects/7f8dcc3b82464b1384540b34486b13a9/users/0230a16f181d4b3b97bbecc1ebc4a266/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:24.810691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 954/1867] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:24 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:24.812485 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579e4a7-0819-42aa-8bec-4083e703452d service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:24.814343 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bd23f-9aa4-48af-839f-42651272e88f None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:24.814669 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bd23f-9aa4-48af-839f-42651272e88f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:24.814960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bd23f-9aa4-48af-839f-42651272e88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:24.838749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579e4a7-0819-42aa-8bec-4083e703452d service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:24.866228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-718bd23f-9aa4-48af-839f-42651272e88f None None] MFA Rules not processed for user `f1d84565784b4c62ae9fd1d1d155d5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:24.868278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-718bd23f-9aa4-48af-839f-42651272e88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:24.944647 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:24.988992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e233c3d-2640-4433-83f1-f009e2546045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:24.993775 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e233c3d-2640-4433-83f1-f009e2546045 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:24.994121 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e233c3d-2640-4433-83f1-f009e2546045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:24.994408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e233c3d-2640-4433-83f1-f009e2546045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:25.001965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e233c3d-2640-4433-83f1-f009e2546045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:25.005066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e233c3d-2640-4433-83f1-f009e2546045 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:25.064031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 955/1868] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:25.067397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c882e-6a4d-4ab0-aceb-37d5b9cd0e02 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:25.068050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c882e-6a4d-4ab0-aceb-37d5b9cd0e02 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:25.069161 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c882e-6a4d-4ab0-aceb-37d5b9cd0e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:25.079184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 914/1869] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:25.079892 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bd23f-9aa4-48af-839f-42651272e88f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:25.114090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bd23f-9aa4-48af-839f-42651272e88f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:25.128666 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925404a-87d9-4c1f-896e-c5162585d22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:25.129651 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925404a-87d9-4c1f-896e-c5162585d22d admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:25.129913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925404a-87d9-4c1f-896e-c5162585d22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:25.130196 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925404a-87d9-4c1f-896e-c5162585d22d admin admin] PATH_INFO: `/v3/projects/477a60352931459097df6315ab5e9216/users/3288a0c003eb423d9fce7568baaf4d7a/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:25.155393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-bc9c882e-6a4d-4ab0-aceb-37d5b9cd0e02 None None] MFA Rules not processed for user `0230a16f181d4b3b97bbecc1ebc4a266`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:25.159433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bc9c882e-6a4d-4ab0-aceb-37d5b9cd0e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:25.159601 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925404a-87d9-4c1f-896e-c5162585d22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=477a60352931459097df6315ab5e9216, user_id=3288a0c003eb423d9fce7568baaf4d7a, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:25.162391 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925404a-87d9-4c1f-896e-c5162585d22d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:25.198471 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 915/1870] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:25 2022] PUT /identity/v3/projects/477a60352931459097df6315ab5e9216/users/3288a0c003eb423d9fce7568baaf4d7a/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:25.198471 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925404a-87d9-4c1f-896e-c5162585d22d admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:25.321522 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925404a-87d9-4c1f-896e-c5162585d22d admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:25.328713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 956/1871] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:25.329870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c882e-6a4d-4ab0-aceb-37d5b9cd0e02 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:25.332970 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83e90b-2284-42e0-814a-6d127c8c9e88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:25.334052 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83e90b-2284-42e0-814a-6d127c8c9e88 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:25.334346 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83e90b-2284-42e0-814a-6d127c8c9e88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:25.334626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83e90b-2284-42e0-814a-6d127c8c9e88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:25.347989 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c882e-6a4d-4ab0-aceb-37d5b9cd0e02 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:25.425019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:25.450491 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c6818-21eb-4000-8df5-848c77f098ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:25.452377 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c6818-21eb-4000-8df5-848c77f098ee admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:25.452738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c6818-21eb-4000-8df5-848c77f098ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:25.453414 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c6818-21eb-4000-8df5-848c77f098ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:25.454294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c6818-21eb-4000-8df5-848c77f098ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:25.456670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c6818-21eb-4000-8df5-848c77f098ee admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:25.473846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 957/1872] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:25.474779 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c6818-21eb-4000-8df5-848c77f098ee admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:25.479611 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83e90b-2284-42e0-814a-6d127c8c9e88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:25.481129 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83e90b-2284-42e0-814a-6d127c8c9e88 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:25.486421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c6818-21eb-4000-8df5-848c77f098ee admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:25.492821 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e737ebc-24d6-4fa8-8ef8-bab4d31c8c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:25.493580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e737ebc-24d6-4fa8-8ef8-bab4d31c8c9f admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:25.493889 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e737ebc-24d6-4fa8-8ef8-bab4d31c8c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:25.494140 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e737ebc-24d6-4fa8-8ef8-bab4d31c8c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:25.494868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e737ebc-24d6-4fa8-8ef8-bab4d31c8c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:25.496362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 916/1873] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:25.496743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e737ebc-24d6-4fa8-8ef8-bab4d31c8c9f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:25.507051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83e90b-2284-42e0-814a-6d127c8c9e88 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:25.531761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83e90b-2284-42e0-814a-6d127c8c9e88 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:25.538456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 958/1874] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:25 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:25.540290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e7136-5c42-43db-8112-548d27a2c8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:25.541606 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e7136-5c42-43db-8112-548d27a2c8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:25.541895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e7136-5c42-43db-8112-548d27a2c8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:25.542173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e7136-5c42-43db-8112-548d27a2c8c3 admin admin] PATH_INFO: `/v3/projects/477a60352931459097df6315ab5e9216/users/3288a0c003eb423d9fce7568baaf4d7a/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:25.544401 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e7136-5c42-43db-8112-548d27a2c8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=477a60352931459097df6315ab5e9216, user_id=3288a0c003eb423d9fce7568baaf4d7a, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:25.544510 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e737ebc-24d6-4fa8-8ef8-bab4d31c8c9f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:25.547152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e7136-5c42-43db-8112-548d27a2c8c3 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:25.568480 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 917/1875] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:25 2022] PUT /identity/v3/projects/477a60352931459097df6315ab5e9216/users/3288a0c003eb423d9fce7568baaf4d7a/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:25.572395 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22e95f-7fb4-48ab-bd0d-e38a55e940a4 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:25.572750 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22e95f-7fb4-48ab-bd0d-e38a55e940a4 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:25.573069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22e95f-7fb4-48ab-bd0d-e38a55e940a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:25.619388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-ba22e95f-7fb4-48ab-bd0d-e38a55e940a4 None None] MFA Rules not processed for user `3288a0c003eb423d9fce7568baaf4d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:25.621105 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ba22e95f-7fb4-48ab-bd0d-e38a55e940a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:25.637321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:25.654244 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e737ebc-24d6-4fa8-8ef8-bab4d31c8c9f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:25.712142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 918/1876] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:25.712142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22e95f-7fb4-48ab-bd0d-e38a55e940a4 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:25.778617 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4e926-78c3-42e6-bcda-843df16b45fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:25.779599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4e926-78c3-42e6-bcda-843df16b45fc admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:25.779981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4e926-78c3-42e6-bcda-843df16b45fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:25.780356 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4e926-78c3-42e6-bcda-843df16b45fc admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:25.781550 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d4e926-78c3-42e6-bcda-843df16b45fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:25.783932 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d4e926-78c3-42e6-bcda-843df16b45fc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:25.813977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 959/1877] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:25 2022] POST /identity/v3/users => generated 295 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:25.815056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4e926-78c3-42e6-bcda-843df16b45fc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:25.817334 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-29d4e926-78c3-42e6-bcda-843df16b45fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:25.859727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22e95f-7fb4-48ab-bd0d-e38a55e940a4 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:25.875512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027404a-20ea-405d-b7f8-d67e32e7e746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:25.876190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027404a-20ea-405d-b7f8-d67e32e7e746 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:25.876475 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027404a-20ea-405d-b7f8-d67e32e7e746 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:25.876857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027404a-20ea-405d-b7f8-d67e32e7e746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:25.891248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4e926-78c3-42e6-bcda-843df16b45fc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:25.896348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773fb55-dc55-4bdf-888d-df4baff0e408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:25.897307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773fb55-dc55-4bdf-888d-df4baff0e408 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:25.897602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773fb55-dc55-4bdf-888d-df4baff0e408 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:25.898277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773fb55-dc55-4bdf-888d-df4baff0e408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:25.913576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773fb55-dc55-4bdf-888d-df4baff0e408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:25.916690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773fb55-dc55-4bdf-888d-df4baff0e408 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:25.933141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 960/1878] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:25.934409 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773fb55-dc55-4bdf-888d-df4baff0e408 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:25.951302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027404a-20ea-405d-b7f8-d67e32e7e746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:25.953206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027404a-20ea-405d-b7f8-d67e32e7e746 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:25.954446 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773fb55-dc55-4bdf-888d-df4baff0e408 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:25.959792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:25.969097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068b170-642b-4dae-b352-57538c469741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:25.969818 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068b170-642b-4dae-b352-57538c469741 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:25.970115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068b170-642b-4dae-b352-57538c469741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:25.970541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068b170-642b-4dae-b352-57538c469741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:25.971284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068b170-642b-4dae-b352-57538c469741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:25.972958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068b170-642b-4dae-b352-57538c469741 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:25.977823 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 919/1879] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:25.978804 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027404a-20ea-405d-b7f8-d67e32e7e746 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:25.995266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 961/1880] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:25.998969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068b170-642b-4dae-b352-57538c469741 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:26.006246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027404a-20ea-405d-b7f8-d67e32e7e746 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:26.016963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46d622-8840-4a3a-aabc-1be7cda27a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:26.017866 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46d622-8840-4a3a-aabc-1be7cda27a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:26.019776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46d622-8840-4a3a-aabc-1be7cda27a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:26.020076 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46d622-8840-4a3a-aabc-1be7cda27a59 admin admin] PATH_INFO: `/v3/users/3dc49ea37fc34fbc878bf667f0282129` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:26.022598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46d622-8840-4a3a-aabc-1be7cda27a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc49ea37fc34fbc878bf667f0282129)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:26.025085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068b170-642b-4dae-b352-57538c469741 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:26.027428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46d622-8840-4a3a-aabc-1be7cda27a59 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:26.053453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea292977-0748-4556-bde9-b20ad417ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:26.054539 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea292977-0748-4556-bde9-b20ad417ffc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:26.054687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea292977-0748-4556-bde9-b20ad417ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:26.054976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea292977-0748-4556-bde9-b20ad417ffc2 admin admin] PATH_INFO: `/v3/projects/99d65f8190104f098cdc95902fd089bd/users/aa55714153fe4a35ad73693bbb012f8a/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:26.105293 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea292977-0748-4556-bde9-b20ad417ffc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d65f8190104f098cdc95902fd089bd, user_id=aa55714153fe4a35ad73693bbb012f8a, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:26.109315 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea292977-0748-4556-bde9-b20ad417ffc2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:26.132753 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 962/1881] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:25 2022] PUT /identity/v3/projects/99d65f8190104f098cdc95902fd089bd/users/aa55714153fe4a35ad73693bbb012f8a/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:26.137098 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea292977-0748-4556-bde9-b20ad417ffc2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:26.176068 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c46d622-8840-4a3a-aabc-1be7cda27a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc49ea37fc34fbc878bf667f0282129'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:26.201051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c46d622-8840-4a3a-aabc-1be7cda27a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc49ea37fc34fbc878bf667f0282129'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:26.202126 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c46d622-8840-4a3a-aabc-1be7cda27a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc49ea37fc34fbc878bf667f0282129'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:26.215541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:26.222189 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea292977-0748-4556-bde9-b20ad417ffc2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:26.230464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3c447-a26c-4149-8672-1fc569d5f922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:26.232421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3c447-a26c-4149-8672-1fc569d5f922 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:26.232979 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3c447-a26c-4149-8672-1fc569d5f922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:26.233366 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3c447-a26c-4149-8672-1fc569d5f922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:26.235063 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3c447-a26c-4149-8672-1fc569d5f922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:26.238082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3c447-a26c-4149-8672-1fc569d5f922 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:26.251237 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c46d622-8840-4a3a-aabc-1be7cda27a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc49ea37fc34fbc878bf667f0282129'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:26.251429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 963/1882] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:30:26.259066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3c447-a26c-4149-8672-1fc569d5f922 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:26.274750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3c447-a26c-4149-8672-1fc569d5f922 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:26.282296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c46d622-8840-4a3a-aabc-1be7cda27a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc49ea37fc34fbc878bf667f0282129'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:26.293670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b17672-32b1-4ea5-aceb-e8d397187390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:26.294907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b17672-32b1-4ea5-aceb-e8d397187390 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:26.295020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 920/1883] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:25 2022] DELETE /identity/v3/users/3dc49ea37fc34fbc878bf667f0282129 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:26.295100 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b17672-32b1-4ea5-aceb-e8d397187390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:26.295100 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b17672-32b1-4ea5-aceb-e8d397187390 admin admin] PATH_INFO: `/v3/projects/99d65f8190104f098cdc95902fd089bd/users/aa55714153fe4a35ad73693bbb012f8a/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:26.297092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897082c3-cced-4d65-a464-27bdfd5d7be9 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:26.297092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897082c3-cced-4d65-a464-27bdfd5d7be9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:26.297092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897082c3-cced-4d65-a464-27bdfd5d7be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:26.299976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b17672-32b1-4ea5-aceb-e8d397187390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d65f8190104f098cdc95902fd089bd, user_id=aa55714153fe4a35ad73693bbb012f8a, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:26.303835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b17672-32b1-4ea5-aceb-e8d397187390 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:26.335547 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 964/1884] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:26 2022] PUT /identity/v3/projects/99d65f8190104f098cdc95902fd089bd/users/aa55714153fe4a35ad73693bbb012f8a/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:26.344136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999c40f-34ff-40dd-bbe4-b1d694ba8250 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:26.344405 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999c40f-34ff-40dd-bbe4-b1d694ba8250 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:26.344696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999c40f-34ff-40dd-bbe4-b1d694ba8250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:26.349919 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-897082c3-cced-4d65-a464-27bdfd5d7be9 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:26.351158 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-897082c3-cced-4d65-a464-27bdfd5d7be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:26.426560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1999c40f-34ff-40dd-bbe4-b1d694ba8250 None None] MFA Rules not processed for user `aa55714153fe4a35ad73693bbb012f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:26.427306 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1999c40f-34ff-40dd-bbe4-b1d694ba8250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:26.469232 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 921/1885] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:26.509878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897082c3-cced-4d65-a464-27bdfd5d7be9 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:26.517386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-897082c3-cced-4d65-a464-27bdfd5d7be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:26.590545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 965/1886] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:26.592690 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897082c3-cced-4d65-a464-27bdfd5d7be9 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:26.610951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8f3eb-0f80-4db8-a799-cbfb8e9dbf6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:26.613789 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8f3eb-0f80-4db8-a799-cbfb8e9dbf6d service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:26.614099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8f3eb-0f80-4db8-a799-cbfb8e9dbf6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:26.615495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8f3eb-0f80-4db8-a799-cbfb8e9dbf6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:26.646010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999c40f-34ff-40dd-bbe4-b1d694ba8250 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:26.651327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1999c40f-34ff-40dd-bbe4-b1d694ba8250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:26.657708 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8f3eb-0f80-4db8-a799-cbfb8e9dbf6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:26.659208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8f3eb-0f80-4db8-a799-cbfb8e9dbf6d service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:26.690605 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 922/1887] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:26.752050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999c40f-34ff-40dd-bbe4-b1d694ba8250 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:26.757876 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c7c63-8c56-4fe5-abdd-fd8218c5a26b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:26.757876 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c7c63-8c56-4fe5-abdd-fd8218c5a26b service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:26.757876 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c7c63-8c56-4fe5-abdd-fd8218c5a26b service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:26.758183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c7c63-8c56-4fe5-abdd-fd8218c5a26b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:26.760485 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0b6c7c63-8c56-4fe5-abdd-fd8218c5a26b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:26.941392 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c7c63-8c56-4fe5-abdd-fd8218c5a26b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:26.942894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c7c63-8c56-4fe5-abdd-fd8218c5a26b service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:26.970931 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 966/1888] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:30:27.481466 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8f3eb-0f80-4db8-a799-cbfb8e9dbf6d service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:27.483806 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e0f8f3eb-0f80-4db8-a799-cbfb8e9dbf6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:27.508259 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8f3eb-0f80-4db8-a799-cbfb8e9dbf6d service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:27.523408 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777d7cd-ff2b-4cd2-b47d-550ae26855ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:27.524781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777d7cd-ff2b-4cd2-b47d-550ae26855ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:27.525050 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777d7cd-ff2b-4cd2-b47d-550ae26855ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:27.525356 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777d7cd-ff2b-4cd2-b47d-550ae26855ca admin admin] PATH_INFO: `/v3/projects/a21ebca513a84044a2fdd904642b13d2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:27.527573 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777d7cd-ff2b-4cd2-b47d-550ae26855ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21ebca513a84044a2fdd904642b13d2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:27.531231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777d7cd-ff2b-4cd2-b47d-550ae26855ca admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:27.555729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:27.628865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0777d7cd-ff2b-4cd2-b47d-550ae26855ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21ebca513a84044a2fdd904642b13d2', 'request_id': 'req-0777d7cd-ff2b-4cd2-b47d-550ae26855ca'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:27.647647 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0777d7cd-ff2b-4cd2-b47d-550ae26855ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21ebca513a84044a2fdd904642b13d2', 'request_id': 'req-0777d7cd-ff2b-4cd2-b47d-550ae26855ca'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:27.669584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0777d7cd-ff2b-4cd2-b47d-550ae26855ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21ebca513a84044a2fdd904642b13d2', 'request_id': 'req-0777d7cd-ff2b-4cd2-b47d-550ae26855ca'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:27.716216 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0777d7cd-ff2b-4cd2-b47d-550ae26855ca admin admin] The token cache is being invalidate because project a21ebca513a84044a2fdd904642b13d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:27.719490 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0777d7cd-ff2b-4cd2-b47d-550ae26855ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:27.722934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0777d7cd-ff2b-4cd2-b47d-550ae26855ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:27.733014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 923/1889] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:27 2022] DELETE /identity/v3/projects/a21ebca513a84044a2fdd904642b13d2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:27.737074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c7c63-8c56-4fe5-abdd-fd8218c5a26b service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:27.766661 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c7c63-8c56-4fe5-abdd-fd8218c5a26b service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:27.818540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:27.996175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab42ad6-50ee-4a1b-9d89-c368cd327dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:27.997160 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab42ad6-50ee-4a1b-9d89-c368cd327dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:27.997466 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab42ad6-50ee-4a1b-9d89-c368cd327dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:27.997774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab42ad6-50ee-4a1b-9d89-c368cd327dfe admin admin] PATH_INFO: `/v3/users/3288a0c003eb423d9fce7568baaf4d7a` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:28.005204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab42ad6-50ee-4a1b-9d89-c368cd327dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3288a0c003eb423d9fce7568baaf4d7a)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:28.010149 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab42ad6-50ee-4a1b-9d89-c368cd327dfe admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:28.157060 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2ab42ad6-50ee-4a1b-9d89-c368cd327dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3288a0c003eb423d9fce7568baaf4d7a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:28.207231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2ab42ad6-50ee-4a1b-9d89-c368cd327dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3288a0c003eb423d9fce7568baaf4d7a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:28.223209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2ab42ad6-50ee-4a1b-9d89-c368cd327dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3288a0c003eb423d9fce7568baaf4d7a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:28.224022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2ab42ad6-50ee-4a1b-9d89-c368cd327dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3288a0c003eb423d9fce7568baaf4d7a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:28.236223 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2ab42ad6-50ee-4a1b-9d89-c368cd327dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3288a0c003eb423d9fce7568baaf4d7a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:28.249114 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13b6b4-3a2d-46ca-92d8-05fbc829e281 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:28.250858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13b6b4-3a2d-46ca-92d8-05fbc829e281 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:28.254092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13b6b4-3a2d-46ca-92d8-05fbc829e281 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:28.258048 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 967/1890] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:27 2022] DELETE /identity/v3/users/3288a0c003eb423d9fce7568baaf4d7a => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:28.261372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 924/1891] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jul 21 22:30:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:30:28.349151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab42ad6-50ee-4a1b-9d89-c368cd327dfe admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:28.354278 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2ab42ad6-50ee-4a1b-9d89-c368cd327dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:28.359794 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f48cb-0eda-428b-bb02-e20192ec0a92 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:28.369431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f48cb-0eda-428b-bb02-e20192ec0a92 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:28.370641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f48cb-0eda-428b-bb02-e20192ec0a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:28.443187 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-748f48cb-0eda-428b-bb02-e20192ec0a92 None None] MFA Rules not processed for user `2c04dc3ee4484afaab388cbb306974af`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:28.448346 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-748f48cb-0eda-428b-bb02-e20192ec0a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:28.512136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab42ad6-50ee-4a1b-9d89-c368cd327dfe admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:28.517460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a9024-0145-436e-b26b-e4f089fffdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:28.518437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a9024-0145-436e-b26b-e4f089fffdc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:28.518920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a9024-0145-436e-b26b-e4f089fffdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:28.519427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a9024-0145-436e-b26b-e4f089fffdc4 admin admin] PATH_INFO: `/v3/users/aa983813b9364cf4b895aec7b66deb02` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:28.524045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a9024-0145-436e-b26b-e4f089fffdc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa983813b9364cf4b895aec7b66deb02)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:28.538047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a9024-0145-436e-b26b-e4f089fffdc4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:28.627850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:28.645994 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 925/1892] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jul 21 22:30:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:28.650561 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-159a9024-0145-436e-b26b-e4f089fffdc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa983813b9364cf4b895aec7b66deb02'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:28.689409 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-159a9024-0145-436e-b26b-e4f089fffdc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa983813b9364cf4b895aec7b66deb02'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:28.710354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-159a9024-0145-436e-b26b-e4f089fffdc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa983813b9364cf4b895aec7b66deb02'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:28.711084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-159a9024-0145-436e-b26b-e4f089fffdc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa983813b9364cf4b895aec7b66deb02'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:28.729648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-159a9024-0145-436e-b26b-e4f089fffdc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa983813b9364cf4b895aec7b66deb02'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:28.748871 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 968/1893] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:28 2022] DELETE /identity/v3/users/aa983813b9364cf4b895aec7b66deb02 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:28.752730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732b055-8640-4098-8319-bece3df26d94 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:28.753415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732b055-8640-4098-8319-bece3df26d94 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:28.753961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732b055-8640-4098-8319-bece3df26d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:28.792243 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-b732b055-8640-4098-8319-bece3df26d94 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:28.798249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b732b055-8640-4098-8319-bece3df26d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:28.967562 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 926/1894] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:28.970555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a9024-0145-436e-b26b-e4f089fffdc4 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:28.979148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-159a9024-0145-436e-b26b-e4f089fffdc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:29.035801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732b055-8640-4098-8319-bece3df26d94 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:29.037833 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b732b055-8640-4098-8319-bece3df26d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:29.175230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:29.180381 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a9024-0145-436e-b26b-e4f089fffdc4 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:29.206087 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852459f-ef14-4f24-a2d0-145cbb1a2ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:29.206866 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852459f-ef14-4f24-a2d0-145cbb1a2ee6 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:29.207160 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852459f-ef14-4f24-a2d0-145cbb1a2ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:29.207453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852459f-ef14-4f24-a2d0-145cbb1a2ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:29.219448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8852459f-ef14-4f24-a2d0-145cbb1a2ee6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:29.262666 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852459f-ef14-4f24-a2d0-145cbb1a2ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:29.264300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852459f-ef14-4f24-a2d0-145cbb1a2ee6 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:29.315834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732b055-8640-4098-8319-bece3df26d94 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:29.331729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204ffc4-78e3-4e45-b1c9-1e85e7da9ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:29.332153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 969/1895] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:29.334132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204ffc4-78e3-4e45-b1c9-1e85e7da9ccb service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:29.334426 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204ffc4-78e3-4e45-b1c9-1e85e7da9ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:29.335409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204ffc4-78e3-4e45-b1c9-1e85e7da9ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:29.367857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204ffc4-78e3-4e45-b1c9-1e85e7da9ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:29.370836 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204ffc4-78e3-4e45-b1c9-1e85e7da9ccb service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:29.396834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 927/1896] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:29.724849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852459f-ef14-4f24-a2d0-145cbb1a2ee6 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:29.726478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8852459f-ef14-4f24-a2d0-145cbb1a2ee6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:29.761018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852459f-ef14-4f24-a2d0-145cbb1a2ee6 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:29.791071 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c016a-c69b-402d-a24c-3b80f90fb274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:29.792231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c016a-c69b-402d-a24c-3b80f90fb274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:29.792518 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c016a-c69b-402d-a24c-3b80f90fb274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:29.792807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c016a-c69b-402d-a24c-3b80f90fb274 admin admin] PATH_INFO: `/v3/projects/477a60352931459097df6315ab5e9216` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:29.794376 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c016a-c69b-402d-a24c-3b80f90fb274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=477a60352931459097df6315ab5e9216)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:29.796818 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c016a-c69b-402d-a24c-3b80f90fb274 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:29.912908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d39c016a-c69b-402d-a24c-3b80f90fb274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477a60352931459097df6315ab5e9216', 'request_id': 'req-d39c016a-c69b-402d-a24c-3b80f90fb274'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:29.924152 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d39c016a-c69b-402d-a24c-3b80f90fb274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477a60352931459097df6315ab5e9216', 'request_id': 'req-d39c016a-c69b-402d-a24c-3b80f90fb274'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:29.941549 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d39c016a-c69b-402d-a24c-3b80f90fb274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477a60352931459097df6315ab5e9216', 'request_id': 'req-d39c016a-c69b-402d-a24c-3b80f90fb274'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:29.966290 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d39c016a-c69b-402d-a24c-3b80f90fb274 admin admin] The token cache is being invalidate because project 477a60352931459097df6315ab5e9216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:29.967191 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d39c016a-c69b-402d-a24c-3b80f90fb274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:29.968393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d39c016a-c69b-402d-a24c-3b80f90fb274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:29.974919 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 970/1897] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:29 2022] DELETE /identity/v3/projects/477a60352931459097df6315ab5e9216 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:29.975878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7cb19-51d7-4d1a-8680-54ff0604549d None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:29.976303 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7cb19-51d7-4d1a-8680-54ff0604549d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:29.976442 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7cb19-51d7-4d1a-8680-54ff0604549d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:30.026069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-f9d7cb19-51d7-4d1a-8680-54ff0604549d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:30.037597 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f9d7cb19-51d7-4d1a-8680-54ff0604549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:30.232309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 928/1898] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:30.243666 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a449d1-39b4-4cbb-aa34-5fd62815f0bc None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:30.246284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a449d1-39b4-4cbb-aa34-5fd62815f0bc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:30.246284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a449d1-39b4-4cbb-aa34-5fd62815f0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:30.314762 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b1a449d1-39b4-4cbb-aa34-5fd62815f0bc None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:30.318816 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b1a449d1-39b4-4cbb-aa34-5fd62815f0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:30.340483 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 971/1899] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:30.345257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7cb19-51d7-4d1a-8680-54ff0604549d None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:30.371565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7cb19-51d7-4d1a-8680-54ff0604549d None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:30.406093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43428e-1419-46e7-8e47-c578f27d4604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:30.407116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43428e-1419-46e7-8e47-c578f27d4604 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:30.410447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43428e-1419-46e7-8e47-c578f27d4604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:30.413172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43428e-1419-46e7-8e47-c578f27d4604 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:30.414375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43428e-1419-46e7-8e47-c578f27d4604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:30.415560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43428e-1419-46e7-8e47-c578f27d4604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:30.426755 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43428e-1419-46e7-8e47-c578f27d4604 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:30.437441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a449d1-39b4-4cbb-aa34-5fd62815f0bc None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:30.439758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b1a449d1-39b4-4cbb-aa34-5fd62815f0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:30.448025 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 929/1900] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:30.462854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43428e-1419-46e7-8e47-c578f27d4604 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:30.487339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:30.493154 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43428e-1419-46e7-8e47-c578f27d4604 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:30.505846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45de4c-39a2-4743-994a-38d3eb8dc1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:30.506537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45de4c-39a2-4743-994a-38d3eb8dc1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:30.508331 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45de4c-39a2-4743-994a-38d3eb8dc1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:30.508625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45de4c-39a2-4743-994a-38d3eb8dc1c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:30.510451 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45de4c-39a2-4743-994a-38d3eb8dc1c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:30.512917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45de4c-39a2-4743-994a-38d3eb8dc1c2 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:30.562543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a449d1-39b4-4cbb-aa34-5fd62815f0bc None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:30.568554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 930/1901] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:30 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:30.569425 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45de4c-39a2-4743-994a-38d3eb8dc1c2 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:30.709383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed645cc-06ab-4406-b34e-ea57e4e9bbff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:30.710102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed645cc-06ab-4406-b34e-ea57e4e9bbff service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:30.710390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed645cc-06ab-4406-b34e-ea57e4e9bbff service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:30.710677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed645cc-06ab-4406-b34e-ea57e4e9bbff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:30.719903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0ed645cc-06ab-4406-b34e-ea57e4e9bbff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:30.755708 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45de4c-39a2-4743-994a-38d3eb8dc1c2 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:30.772890 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79ee76-48cb-434a-a109-c577512c113b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:30.773719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79ee76-48cb-434a-a109-c577512c113b admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:30.774557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79ee76-48cb-434a-a109-c577512c113b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:30.774893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79ee76-48cb-434a-a109-c577512c113b admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:30.775620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79ee76-48cb-434a-a109-c577512c113b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:30.784348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79ee76-48cb-434a-a109-c577512c113b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:30.825943 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 931/1902] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:30 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:30.826835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79ee76-48cb-434a-a109-c577512c113b admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:30.831567 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-7a79ee76-48cb-434a-a109-c577512c113b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:30.856325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79ee76-48cb-434a-a109-c577512c113b admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:30.866833 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed645cc-06ab-4406-b34e-ea57e4e9bbff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:30.868564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed645cc-06ab-4406-b34e-ea57e4e9bbff service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:30.868962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f16c11-9108-4a88-92cb-f82b119302df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:30.870793 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f16c11-9108-4a88-92cb-f82b119302df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:30.871169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f16c11-9108-4a88-92cb-f82b119302df admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:30.871524 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f16c11-9108-4a88-92cb-f82b119302df admin admin] PATH_INFO: `/v3/projects/cb91bac67d51428d804e132535293680` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:30.873032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f16c11-9108-4a88-92cb-f82b119302df admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb91bac67d51428d804e132535293680)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:30.876701 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f16c11-9108-4a88-92cb-f82b119302df admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:30.895765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 972/1903] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:30.900390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed645cc-06ab-4406-b34e-ea57e4e9bbff service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:30.928017 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed645cc-06ab-4406-b34e-ea57e4e9bbff service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:30.945346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91b2a9-ef7e-4fb2-ad16-2d79af779385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:30.945993 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91b2a9-ef7e-4fb2-ad16-2d79af779385 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:30.946322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91b2a9-ef7e-4fb2-ad16-2d79af779385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:30.946670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91b2a9-ef7e-4fb2-ad16-2d79af779385 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:30.947642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91b2a9-ef7e-4fb2-ad16-2d79af779385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:30.949638 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91b2a9-ef7e-4fb2-ad16-2d79af779385 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:30.975019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 973/1904] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:30.979626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:30.980148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91b2a9-ef7e-4fb2-ad16-2d79af779385 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:31.033156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91b2a9-ef7e-4fb2-ad16-2d79af779385 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:31.048434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c4f16c11-9108-4a88-92cb-f82b119302df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb91bac67d51428d804e132535293680', 'request_id': 'req-c4f16c11-9108-4a88-92cb-f82b119302df'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:31.070348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c4f16c11-9108-4a88-92cb-f82b119302df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb91bac67d51428d804e132535293680', 'request_id': 'req-c4f16c11-9108-4a88-92cb-f82b119302df'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:31.079643 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c4f16c11-9108-4a88-92cb-f82b119302df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb91bac67d51428d804e132535293680', 'request_id': 'req-c4f16c11-9108-4a88-92cb-f82b119302df'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:31.103927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c4f16c11-9108-4a88-92cb-f82b119302df admin admin] The token cache is being invalidate because project cb91bac67d51428d804e132535293680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:31.104249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c4f16c11-9108-4a88-92cb-f82b119302df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:31.105376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c4f16c11-9108-4a88-92cb-f82b119302df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:31.108249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 932/1905] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:30 2022] DELETE /identity/v3/projects/cb91bac67d51428d804e132535293680 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:31.113828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f16c11-9108-4a88-92cb-f82b119302df admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:31.117102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c4f16c11-9108-4a88-92cb-f82b119302df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:31.266689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f306d-9085-46f3-abf5-9af635f01ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:31.267606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f306d-9085-46f3-abf5-9af635f01ebc admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:31.267895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f306d-9085-46f3-abf5-9af635f01ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:31.271250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f306d-9085-46f3-abf5-9af635f01ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:31.272371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f306d-9085-46f3-abf5-9af635f01ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:31.279936 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f306d-9085-46f3-abf5-9af635f01ebc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:31.300674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f16c11-9108-4a88-92cb-f82b119302df admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:31.318029 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe34cf-1b96-460f-a961-2d1dd8e12882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:31.319091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe34cf-1b96-460f-a961-2d1dd8e12882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:31.319386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe34cf-1b96-460f-a961-2d1dd8e12882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:31.319680 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe34cf-1b96-460f-a961-2d1dd8e12882 admin admin] PATH_INFO: `/v3/users/b05caf1fa56642399cd880501f77961e` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:31.326589 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe34cf-1b96-460f-a961-2d1dd8e12882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05caf1fa56642399cd880501f77961e)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:31.332233 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe34cf-1b96-460f-a961-2d1dd8e12882 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:31.337045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 974/1906] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:31.339412 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f306d-9085-46f3-abf5-9af635f01ebc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:31.343915 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4d3f306d-9085-46f3-abf5-9af635f01ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:31.389032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f306d-9085-46f3-abf5-9af635f01ebc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:31.409038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499e6d0-df3a-45fe-97af-4873b135a0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:31.413187 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499e6d0-df3a-45fe-97af-4873b135a0ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:31.413606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499e6d0-df3a-45fe-97af-4873b135a0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:31.413899 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499e6d0-df3a-45fe-97af-4873b135a0ad admin admin] PATH_INFO: `/v3/projects/0fcf5cab87cc4e6189b0ee358781f6f9/users/8ba72a7e419945e9ba74a091640474fe/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:31.432335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:31.479945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499e6d0-df3a-45fe-97af-4873b135a0ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fcf5cab87cc4e6189b0ee358781f6f9, user_id=8ba72a7e419945e9ba74a091640474fe, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:31.498595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499e6d0-df3a-45fe-97af-4873b135a0ad admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:31.515855 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-43fe34cf-1b96-460f-a961-2d1dd8e12882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05caf1fa56642399cd880501f77961e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:31.534851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-43fe34cf-1b96-460f-a961-2d1dd8e12882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05caf1fa56642399cd880501f77961e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:31.535830 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-43fe34cf-1b96-460f-a961-2d1dd8e12882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05caf1fa56642399cd880501f77961e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:31.568399 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 975/1907] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:31 2022] PUT /identity/v3/projects/0fcf5cab87cc4e6189b0ee358781f6f9/users/8ba72a7e419945e9ba74a091640474fe/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:31.573534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-43fe34cf-1b96-460f-a961-2d1dd8e12882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05caf1fa56642399cd880501f77961e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:31.580626 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499e6d0-df3a-45fe-97af-4873b135a0ad admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:31.589095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-43fe34cf-1b96-460f-a961-2d1dd8e12882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05caf1fa56642399cd880501f77961e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:31.593859 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2499e6d0-df3a-45fe-97af-4873b135a0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:31.601497 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 933/1908] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:31 2022] DELETE /identity/v3/users/b05caf1fa56642399cd880501f77961e => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:31.603251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3d36-c2c3-426d-a445-4d0c7cd46720 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:31.610148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3d36-c2c3-426d-a445-4d0c7cd46720 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:31.613512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3d36-c2c3-426d-a445-4d0c7cd46720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:31.688714 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-024e3d36-c2c3-426d-a445-4d0c7cd46720 None None] MFA Rules not processed for user `8ba72a7e419945e9ba74a091640474fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:31.690263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-024e3d36-c2c3-426d-a445-4d0c7cd46720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:31.718172 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499e6d0-df3a-45fe-97af-4873b135a0ad admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:31.747654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:31.885867 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb205bd7-d543-4528-8c13-7d80add45766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:31.891751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb205bd7-d543-4528-8c13-7d80add45766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:31.892050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb205bd7-d543-4528-8c13-7d80add45766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:31.893319 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb205bd7-d543-4528-8c13-7d80add45766 admin admin] PATH_INFO: `/v3/users/e21f820ce3bb44c99a43dbeb7bdfa9ae` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:31.900392 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb205bd7-d543-4528-8c13-7d80add45766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21f820ce3bb44c99a43dbeb7bdfa9ae)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:31.902020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 934/1909] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:31.907550 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e3d36-c2c3-426d-a445-4d0c7cd46720 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:31.909703 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-024e3d36-c2c3-426d-a445-4d0c7cd46720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:31.909981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb205bd7-d543-4528-8c13-7d80add45766 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:31.945805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e3d36-c2c3-426d-a445-4d0c7cd46720 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:31.954233 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf98e5-b185-4c49-bfb8-bb7c74344fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:31.955188 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf98e5-b185-4c49-bfb8-bb7c74344fec admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:31.955682 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf98e5-b185-4c49-bfb8-bb7c74344fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:31.955975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf98e5-b185-4c49-bfb8-bb7c74344fec admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:31.957141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf98e5-b185-4c49-bfb8-bb7c74344fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:31.965270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf98e5-b185-4c49-bfb8-bb7c74344fec admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:32.026276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 935/1910] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:31 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:30:32.030474 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf98e5-b185-4c49-bfb8-bb7c74344fec admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:32.045294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bb205bd7-d543-4528-8c13-7d80add45766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21f820ce3bb44c99a43dbeb7bdfa9ae'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:32.090233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bb205bd7-d543-4528-8c13-7d80add45766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21f820ce3bb44c99a43dbeb7bdfa9ae'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:32.106138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bb205bd7-d543-4528-8c13-7d80add45766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21f820ce3bb44c99a43dbeb7bdfa9ae'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:32.108903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bb205bd7-d543-4528-8c13-7d80add45766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21f820ce3bb44c99a43dbeb7bdfa9ae'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:32.147468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bb205bd7-d543-4528-8c13-7d80add45766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21f820ce3bb44c99a43dbeb7bdfa9ae'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:32.170298 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 976/1911] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:31 2022] DELETE /identity/v3/users/e21f820ce3bb44c99a43dbeb7bdfa9ae => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:32.176320 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9fd9a-0437-4276-9dd9-fe3c8a4af404 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:32.176915 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9fd9a-0437-4276-9dd9-fe3c8a4af404 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:32.177426 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9fd9a-0437-4276-9dd9-fe3c8a4af404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:32.196116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf98e5-b185-4c49-bfb8-bb7c74344fec admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:32.224766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-66c9fd9a-0437-4276-9dd9-fe3c8a4af404 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:32.226321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-66c9fd9a-0437-4276-9dd9-fe3c8a4af404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:32.240746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:32.282453 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60e3ad-719f-4a7b-af68-e5ffe4919dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:32.283492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60e3ad-719f-4a7b-af68-e5ffe4919dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:32.284205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60e3ad-719f-4a7b-af68-e5ffe4919dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:32.284672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60e3ad-719f-4a7b-af68-e5ffe4919dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:32.285587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60e3ad-719f-4a7b-af68-e5ffe4919dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:32.287525 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60e3ad-719f-4a7b-af68-e5ffe4919dd7 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:32.318150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 936/1912] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:32 2022] POST /identity/v3/users => generated 296 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:30:32.326098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60e3ad-719f-4a7b-af68-e5ffe4919dd7 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:32.329069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ae60e3ad-719f-4a7b-af68-e5ffe4919dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:32.353688 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60e3ad-719f-4a7b-af68-e5ffe4919dd7 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:32.359578 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b361b7-8afd-4b09-82ca-0f6a098b2587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:32.360654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b361b7-8afd-4b09-82ca-0f6a098b2587 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:32.361078 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b361b7-8afd-4b09-82ca-0f6a098b2587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:32.361637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b361b7-8afd-4b09-82ca-0f6a098b2587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:32.362716 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b361b7-8afd-4b09-82ca-0f6a098b2587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:32.364814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b361b7-8afd-4b09-82ca-0f6a098b2587 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:32.376530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 977/1913] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:32.380445 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9fd9a-0437-4276-9dd9-fe3c8a4af404 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:32.381889 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 937/1914] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:32.383530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-66c9fd9a-0437-4276-9dd9-fe3c8a4af404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:32.385704 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b361b7-8afd-4b09-82ca-0f6a098b2587 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:32.406683 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b361b7-8afd-4b09-82ca-0f6a098b2587 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:32.424621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da33333-dc98-4854-b0d3-a7ab68453e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:32.425580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da33333-dc98-4854-b0d3-a7ab68453e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:32.426057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da33333-dc98-4854-b0d3-a7ab68453e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:32.426261 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da33333-dc98-4854-b0d3-a7ab68453e69 admin admin] PATH_INFO: `/v3/projects/5fcc4f181c3a4fd2a7abf60834080534/users/a6ec4179e0d24fc7a646589661591184/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:32.457249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da33333-dc98-4854-b0d3-a7ab68453e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fcc4f181c3a4fd2a7abf60834080534, user_id=a6ec4179e0d24fc7a646589661591184, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:32.460776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da33333-dc98-4854-b0d3-a7ab68453e69 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:32.485488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:32.503329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 938/1915] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:32 2022] PUT /identity/v3/projects/5fcc4f181c3a4fd2a7abf60834080534/users/a6ec4179e0d24fc7a646589661591184/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:32.507681 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da33333-dc98-4854-b0d3-a7ab68453e69 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:32.541115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9fd9a-0437-4276-9dd9-fe3c8a4af404 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:32.681873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da33333-dc98-4854-b0d3-a7ab68453e69 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:32.684833 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fe23e-166a-40e2-aab5-a8ead6ec7922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:32.685960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fe23e-166a-40e2-aab5-a8ead6ec7922 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:32.686318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fe23e-166a-40e2-aab5-a8ead6ec7922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:32.686762 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fe23e-166a-40e2-aab5-a8ead6ec7922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:32.709404 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e148a8-8f79-45da-beef-a9741835a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:32.710232 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e148a8-8f79-45da-beef-a9741835a093 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:32.710608 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e148a8-8f79-45da-beef-a9741835a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:32.710885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e148a8-8f79-45da-beef-a9741835a093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:32.711760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e148a8-8f79-45da-beef-a9741835a093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:32.714869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e148a8-8f79-45da-beef-a9741835a093 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:32.720031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fe23e-166a-40e2-aab5-a8ead6ec7922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:32.725214 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fe23e-166a-40e2-aab5-a8ead6ec7922 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:32.739783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 978/1916] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:32.743225 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fe23e-166a-40e2-aab5-a8ead6ec7922 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:32.747052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-381fe23e-166a-40e2-aab5-a8ead6ec7922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:32.763054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fe23e-166a-40e2-aab5-a8ead6ec7922 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:32.767791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 939/1917] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:32.773920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66f8d1-105d-409e-8962-a8d68a4a5111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:32.774492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e148a8-8f79-45da-beef-a9741835a093 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:32.775393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66f8d1-105d-409e-8962-a8d68a4a5111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:32.776092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66f8d1-105d-409e-8962-a8d68a4a5111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:32.776593 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66f8d1-105d-409e-8962-a8d68a4a5111 admin admin] PATH_INFO: `/v3/projects/635b7ac2c1d44269bbee29906f331070` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:32.779040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66f8d1-105d-409e-8962-a8d68a4a5111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=635b7ac2c1d44269bbee29906f331070)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:32.782835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66f8d1-105d-409e-8962-a8d68a4a5111 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:32.842393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e148a8-8f79-45da-beef-a9741835a093 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:32.857466 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7f66f8d1-105d-409e-8962-a8d68a4a5111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635b7ac2c1d44269bbee29906f331070', 'request_id': 'req-7f66f8d1-105d-409e-8962-a8d68a4a5111'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:32.868982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7f66f8d1-105d-409e-8962-a8d68a4a5111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635b7ac2c1d44269bbee29906f331070', 'request_id': 'req-7f66f8d1-105d-409e-8962-a8d68a4a5111'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:32.877132 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7f66f8d1-105d-409e-8962-a8d68a4a5111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635b7ac2c1d44269bbee29906f331070', 'request_id': 'req-7f66f8d1-105d-409e-8962-a8d68a4a5111'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:32.883910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:32.913327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7f66f8d1-105d-409e-8962-a8d68a4a5111 admin admin] The token cache is being invalidate because project 635b7ac2c1d44269bbee29906f331070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:32.914068 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7f66f8d1-105d-409e-8962-a8d68a4a5111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:32.916001 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7f66f8d1-105d-409e-8962-a8d68a4a5111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:32.930937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 979/1918] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:32 2022] DELETE /identity/v3/projects/635b7ac2c1d44269bbee29906f331070 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:32.936369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388caecd-cbca-4f98-ad41-b126040f848b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:32.936803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388caecd-cbca-4f98-ad41-b126040f848b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:32.937310 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388caecd-cbca-4f98-ad41-b126040f848b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:32.985809 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-388caecd-cbca-4f98-ad41-b126040f848b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:32.987271 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-388caecd-cbca-4f98-ad41-b126040f848b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:33.118110 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cb837-6b65-4de6-9b38-60d6b262a45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:33.119023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cb837-6b65-4de6-9b38-60d6b262a45a admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:33.119312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cb837-6b65-4de6-9b38-60d6b262a45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:33.119589 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cb837-6b65-4de6-9b38-60d6b262a45a admin admin] PATH_INFO: `/v3/projects/5fcc4f181c3a4fd2a7abf60834080534/users/a6ec4179e0d24fc7a646589661591184/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:33.125286 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cb837-6b65-4de6-9b38-60d6b262a45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fcc4f181c3a4fd2a7abf60834080534, user_id=a6ec4179e0d24fc7a646589661591184, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:33.128076 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cb837-6b65-4de6-9b38-60d6b262a45a admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:33.178403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 940/1919] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:32 2022] PUT /identity/v3/projects/5fcc4f181c3a4fd2a7abf60834080534/users/a6ec4179e0d24fc7a646589661591184/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:33.178739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 980/1920] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:33.185588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4c059-0e68-41d6-9fd4-d75eac7d618b None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:33.185588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4c059-0e68-41d6-9fd4-d75eac7d618b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:33.185588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4c059-0e68-41d6-9fd4-d75eac7d618b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:33.192967 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f107d-7c0c-4be3-a22d-6a06c32d1503 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:33.195269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f107d-7c0c-4be3-a22d-6a06c32d1503 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:33.195533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f107d-7c0c-4be3-a22d-6a06c32d1503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:33.233778 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-98d4c059-0e68-41d6-9fd4-d75eac7d618b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:33.234932 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-98d4c059-0e68-41d6-9fd4-d75eac7d618b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:33.291908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-dd7f107d-7c0c-4be3-a22d-6a06c32d1503 None None] MFA Rules not processed for user `a6ec4179e0d24fc7a646589661591184`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:33.295654 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dd7f107d-7c0c-4be3-a22d-6a06c32d1503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:33.416877 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 981/1921] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:33.430675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f107d-7c0c-4be3-a22d-6a06c32d1503 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:33.432494 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dd7f107d-7c0c-4be3-a22d-6a06c32d1503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:33.465361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 941/1922] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:33.473176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4c059-0e68-41d6-9fd4-d75eac7d618b None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:33.499727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4c059-0e68-41d6-9fd4-d75eac7d618b None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:33.529733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad885ba-7538-4033-8087-01a92ef982dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:33.540577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad885ba-7538-4033-8087-01a92ef982dc admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:33.541467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad885ba-7538-4033-8087-01a92ef982dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:33.541976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad885ba-7538-4033-8087-01a92ef982dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:33.546392 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad885ba-7538-4033-8087-01a92ef982dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:33.546980 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad885ba-7538-4033-8087-01a92ef982dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:33.550249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad885ba-7538-4033-8087-01a92ef982dc admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:33.589588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 942/1923] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:33.590726 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad885ba-7538-4033-8087-01a92ef982dc admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:33.609600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f107d-7c0c-4be3-a22d-6a06c32d1503 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:33.615757 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bba42-8bba-4934-9939-f87cca8534e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:33.616536 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bba42-8bba-4934-9939-f87cca8534e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:33.616820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bba42-8bba-4934-9939-f87cca8534e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:33.617133 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bba42-8bba-4934-9939-f87cca8534e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:33.644323 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad885ba-7538-4033-8087-01a92ef982dc admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:33.659772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bba42-8bba-4934-9939-f87cca8534e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:33.661642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bba42-8bba-4934-9939-f87cca8534e1 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:33.671459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ff9da-f8ad-4809-9b2c-3a8e9f1f1441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:33.681950 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ff9da-f8ad-4809-9b2c-3a8e9f1f1441 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:33.682215 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ff9da-f8ad-4809-9b2c-3a8e9f1f1441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:33.685875 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ff9da-f8ad-4809-9b2c-3a8e9f1f1441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:33.687236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ff9da-f8ad-4809-9b2c-3a8e9f1f1441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:33.697375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ff9da-f8ad-4809-9b2c-3a8e9f1f1441 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:33.700446 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 982/1924] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:33.744599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:33.781586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bba42-8bba-4934-9939-f87cca8534e1 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:33.788960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 943/1925] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:33 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:33.796781 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bba42-8bba-4934-9939-f87cca8534e1 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:33.844386 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:33.893722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ff9da-f8ad-4809-9b2c-3a8e9f1f1441 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:33.895476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b08ff9da-f8ad-4809-9b2c-3a8e9f1f1441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:33.915125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741e3bd-0ffd-423d-93c0-39b57a0612a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:33.915949 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741e3bd-0ffd-423d-93c0-39b57a0612a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:33.916391 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741e3bd-0ffd-423d-93c0-39b57a0612a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:33.917008 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741e3bd-0ffd-423d-93c0-39b57a0612a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:33.917985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741e3bd-0ffd-423d-93c0-39b57a0612a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:33.922402 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741e3bd-0ffd-423d-93c0-39b57a0612a3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:33.958240 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 983/1926] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:33 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:33.962877 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741e3bd-0ffd-423d-93c0-39b57a0612a3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:33.975885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741e3bd-0ffd-423d-93c0-39b57a0612a3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:33.981783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2bf86-e87d-4872-9fad-1a9de4ff010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:33.982472 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2bf86-e87d-4872-9fad-1a9de4ff010e admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:33.982752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2bf86-e87d-4872-9fad-1a9de4ff010e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:33.983027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2bf86-e87d-4872-9fad-1a9de4ff010e admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:33.984412 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2bf86-e87d-4872-9fad-1a9de4ff010e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:33.986059 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2bf86-e87d-4872-9fad-1a9de4ff010e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:34.036509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 984/1927] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:34.036697 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ff9da-f8ad-4809-9b2c-3a8e9f1f1441 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:34.041680 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2bf86-e87d-4872-9fad-1a9de4ff010e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:34.042732 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e9088-b1ab-461f-8e5e-9a8b284440d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:34.043620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e9088-b1ab-461f-8e5e-9a8b284440d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:34.043905 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e9088-b1ab-461f-8e5e-9a8b284440d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:34.044386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e9088-b1ab-461f-8e5e-9a8b284440d6 admin admin] PATH_INFO: `/v3/projects/465fda7e0565420fa8066575a71138b9` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:34.045466 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e9088-b1ab-461f-8e5e-9a8b284440d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=465fda7e0565420fa8066575a71138b9)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:34.048526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e9088-b1ab-461f-8e5e-9a8b284440d6 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:34.089051 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2bf86-e87d-4872-9fad-1a9de4ff010e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:34.101541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c00a4-8fe7-44e1-a3a5-e181f0eaf8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:34.102565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c00a4-8fe7-44e1-a3a5-e181f0eaf8cf admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:34.102951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c00a4-8fe7-44e1-a3a5-e181f0eaf8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:34.103431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c00a4-8fe7-44e1-a3a5-e181f0eaf8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:34.104407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c00a4-8fe7-44e1-a3a5-e181f0eaf8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:34.110744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c00a4-8fe7-44e1-a3a5-e181f0eaf8cf admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:34.141623 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-782e9088-b1ab-461f-8e5e-9a8b284440d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '465fda7e0565420fa8066575a71138b9', 'request_id': 'req-782e9088-b1ab-461f-8e5e-9a8b284440d6'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:34.151143 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 985/1928] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:34.152915 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c00a4-8fe7-44e1-a3a5-e181f0eaf8cf admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:34.163881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-782e9088-b1ab-461f-8e5e-9a8b284440d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '465fda7e0565420fa8066575a71138b9', 'request_id': 'req-782e9088-b1ab-461f-8e5e-9a8b284440d6'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:34.169521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c00a4-8fe7-44e1-a3a5-e181f0eaf8cf admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:34.179612 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-782e9088-b1ab-461f-8e5e-9a8b284440d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '465fda7e0565420fa8066575a71138b9', 'request_id': 'req-782e9088-b1ab-461f-8e5e-9a8b284440d6'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:34.200980 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-782e9088-b1ab-461f-8e5e-9a8b284440d6 admin admin] The token cache is being invalidate because project 465fda7e0565420fa8066575a71138b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:34.202920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-782e9088-b1ab-461f-8e5e-9a8b284440d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:34.203607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-782e9088-b1ab-461f-8e5e-9a8b284440d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:34.205674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 944/1929] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:33 2022] DELETE /identity/v3/projects/465fda7e0565420fa8066575a71138b9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:34.213080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e9088-b1ab-461f-8e5e-9a8b284440d6 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:34.215601 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-782e9088-b1ab-461f-8e5e-9a8b284440d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:34.314661 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d988b0c-90db-41a1-bab8-5b6dc289346f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:34.315720 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d988b0c-90db-41a1-bab8-5b6dc289346f admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:34.316101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d988b0c-90db-41a1-bab8-5b6dc289346f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:34.316865 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d988b0c-90db-41a1-bab8-5b6dc289346f admin admin] PATH_INFO: `/v3/projects/672e6d3f6bdb4e2f841e083186ab2506/users/68baea7f581b41bfafc7380529e26bac/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:34.337226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d988b0c-90db-41a1-bab8-5b6dc289346f admin admin] RBAC: Authorizing `identity:create_grant(project_id=672e6d3f6bdb4e2f841e083186ab2506, user_id=68baea7f581b41bfafc7380529e26bac, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:34.340470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d988b0c-90db-41a1-bab8-5b6dc289346f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:34.360086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 986/1930] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:34 2022] PUT /identity/v3/projects/672e6d3f6bdb4e2f841e083186ab2506/users/68baea7f581b41bfafc7380529e26bac/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:34.369869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d988b0c-90db-41a1-bab8-5b6dc289346f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:34.372886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7d988b0c-90db-41a1-bab8-5b6dc289346f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:34.373966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e9088-b1ab-461f-8e5e-9a8b284440d6 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:34.456722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:34.502095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9928ca-cb87-473a-9e57-fb258beec170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:34.502991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9928ca-cb87-473a-9e57-fb258beec170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:34.503387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9928ca-cb87-473a-9e57-fb258beec170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:34.503547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9928ca-cb87-473a-9e57-fb258beec170 admin admin] PATH_INFO: `/v3/users/f1d84565784b4c62ae9fd1d1d155d5f4` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:34.505540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9928ca-cb87-473a-9e57-fb258beec170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d84565784b4c62ae9fd1d1d155d5f4)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:34.509535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9928ca-cb87-473a-9e57-fb258beec170 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:34.510967 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d988b0c-90db-41a1-bab8-5b6dc289346f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:34.521049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8660c3-4ee0-4e29-a99a-003cf3bd88cf tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6ec4179e0d24fc7a646589661591184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fcc4f181c3a4fd2a7abf60834080534', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:34.524147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8660c3-4ee0-4e29-a99a-003cf3bd88cf tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:34.524147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8660c3-4ee0-4e29-a99a-003cf3bd88cf tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:34.524350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8660c3-4ee0-4e29-a99a-003cf3bd88cf tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:34.525147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8660c3-4ee0-4e29-a99a-003cf3bd88cf tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:34.525728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8660c3-4ee0-4e29-a99a-003cf3bd88cf tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:34.527566 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8660c3-4ee0-4e29-a99a-003cf3bd88cf tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:34.555843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 987/1931] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:34.559237 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759e602-7502-4163-94a4-f186d69a4080 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:34.559742 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759e602-7502-4163-94a4-f186d69a4080 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:34.560642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759e602-7502-4163-94a4-f186d69a4080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:34.596971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:34.619982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1759e602-7502-4163-94a4-f186d69a4080 None None] MFA Rules not processed for user `68baea7f581b41bfafc7380529e26bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:34.621595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1759e602-7502-4163-94a4-f186d69a4080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:34.628022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-1a9928ca-cb87-473a-9e57-fb258beec170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d84565784b4c62ae9fd1d1d155d5f4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:34.659373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-1a9928ca-cb87-473a-9e57-fb258beec170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d84565784b4c62ae9fd1d1d155d5f4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:34.673235 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-1a9928ca-cb87-473a-9e57-fb258beec170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d84565784b4c62ae9fd1d1d155d5f4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:34.706022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-1a9928ca-cb87-473a-9e57-fb258beec170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d84565784b4c62ae9fd1d1d155d5f4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:34.735872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-1a9928ca-cb87-473a-9e57-fb258beec170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d84565784b4c62ae9fd1d1d155d5f4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:34.750058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 945/1932] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:34 2022] DELETE /identity/v3/users/f1d84565784b4c62ae9fd1d1d155d5f4 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:34.751238 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9928ca-cb87-473a-9e57-fb258beec170 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:34.755938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-1a9928ca-cb87-473a-9e57-fb258beec170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:34.756084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 988/1933] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:34.760465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759e602-7502-4163-94a4-f186d69a4080 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:34.764370 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1759e602-7502-4163-94a4-f186d69a4080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:34.810725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759e602-7502-4163-94a4-f186d69a4080 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:34.900900 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9928ca-cb87-473a-9e57-fb258beec170 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:34.909088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1235be0-0297-4254-9ff5-71a98e165fc2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6ec4179e0d24fc7a646589661591184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fcc4f181c3a4fd2a7abf60834080534', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:34.910034 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1235be0-0297-4254-9ff5-71a98e165fc2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:34.910752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1235be0-0297-4254-9ff5-71a98e165fc2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:34.910752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1235be0-0297-4254-9ff5-71a98e165fc2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:34.911589 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1235be0-0297-4254-9ff5-71a98e165fc2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:34.914115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1235be0-0297-4254-9ff5-71a98e165fc2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:34.931771 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f67ca-054a-46a2-b7b3-dba15ceaceff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:34.947989 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f67ca-054a-46a2-b7b3-dba15ceaceff admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:34.948636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f67ca-054a-46a2-b7b3-dba15ceaceff admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:34.949201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f67ca-054a-46a2-b7b3-dba15ceaceff admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:34.950726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f67ca-054a-46a2-b7b3-dba15ceaceff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:34.953568 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f67ca-054a-46a2-b7b3-dba15ceaceff admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:34.985535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 946/1934] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:34 2022] POST /identity/v3/projects => generated 353 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:34.996707 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1235be0-0297-4254-9ff5-71a98e165fc2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:35.005654 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 989/1935] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:34 2022] POST /identity/v3/projects => generated 379 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:30:35.008637 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f67ca-054a-46a2-b7b3-dba15ceaceff admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:35.012562 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4b8f67ca-054a-46a2-b7b3-dba15ceaceff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:35.146290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:35.221907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1235be0-0297-4254-9ff5-71a98e165fc2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:35.236020 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f67ca-054a-46a2-b7b3-dba15ceaceff admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:35.244289 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abdd42-e239-4fcd-b73a-340340022699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:35.246076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abdd42-e239-4fcd-b73a-340340022699 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:35.246617 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abdd42-e239-4fcd-b73a-340340022699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:35.247342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abdd42-e239-4fcd-b73a-340340022699 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:35.248307 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abdd42-e239-4fcd-b73a-340340022699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:35.253345 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abdd42-e239-4fcd-b73a-340340022699 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:35.290040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 990/1936] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:35 2022] POST /identity/v3/users => generated 290 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:30:35.294318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abdd42-e239-4fcd-b73a-340340022699 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:35.312287 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202eac32-c13c-4865-b8d1-5656d5af76e2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6ec4179e0d24fc7a646589661591184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fcc4f181c3a4fd2a7abf60834080534', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:35.314175 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202eac32-c13c-4865-b8d1-5656d5af76e2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:35.314393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202eac32-c13c-4865-b8d1-5656d5af76e2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:35.314684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202eac32-c13c-4865-b8d1-5656d5af76e2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:35.315424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202eac32-c13c-4865-b8d1-5656d5af76e2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:35.315784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202eac32-c13c-4865-b8d1-5656d5af76e2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:35.318072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202eac32-c13c-4865-b8d1-5656d5af76e2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:35.338488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abdd42-e239-4fcd-b73a-340340022699 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:35.340336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 947/1937] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:35.378807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84580512-f495-496e-a7d8-315ae4f47821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:35.379553 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580512-f495-496e-a7d8-315ae4f47821 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:35.379848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580512-f495-496e-a7d8-315ae4f47821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:35.380129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580512-f495-496e-a7d8-315ae4f47821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:35.380876 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84580512-f495-496e-a7d8-315ae4f47821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:35.384748 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84580512-f495-496e-a7d8-315ae4f47821 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:35.393899 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:35.408133 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 991/1938] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:30:35.412349 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202eac32-c13c-4865-b8d1-5656d5af76e2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:35.418851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84580512-f495-496e-a7d8-315ae4f47821 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:35.440030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202eac32-c13c-4865-b8d1-5656d5af76e2 tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:35.440677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84580512-f495-496e-a7d8-315ae4f47821 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:35.455952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d5bae-c288-484f-a62d-d1abcf5d6b7e tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6ec4179e0d24fc7a646589661591184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fcc4f181c3a4fd2a7abf60834080534', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:35.457539 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d5bae-c288-484f-a62d-d1abcf5d6b7e tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:35.458010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d5bae-c288-484f-a62d-d1abcf5d6b7e tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:35.458431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d5bae-c288-484f-a62d-d1abcf5d6b7e tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] PATH_INFO: `/v3/projects/3c68833f8f554723920d8ecf64ae1a7f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:35.460192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d5bae-c288-484f-a62d-d1abcf5d6b7e tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3c68833f8f554723920d8ecf64ae1a7f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:35.462918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d5bae-c288-484f-a62d-d1abcf5d6b7e tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:35.466984 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b00a71-8f4a-4589-a185-cc10e45a9421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:35.469544 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b00a71-8f4a-4589-a185-cc10e45a9421 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:35.469836 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b00a71-8f4a-4589-a185-cc10e45a9421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:35.470119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b00a71-8f4a-4589-a185-cc10e45a9421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:35.474126 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b00a71-8f4a-4589-a185-cc10e45a9421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:35.475984 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b00a71-8f4a-4589-a185-cc10e45a9421 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:35.508238 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 948/1939] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:35.510039 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b00a71-8f4a-4589-a185-cc10e45a9421 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:35.531309 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-301d5bae-c288-484f-a62d-d1abcf5d6b7e tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c68833f8f554723920d8ecf64ae1a7f', 'request_id': 'req-301d5bae-c288-484f-a62d-d1abcf5d6b7e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:35.538905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-301d5bae-c288-484f-a62d-d1abcf5d6b7e tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c68833f8f554723920d8ecf64ae1a7f', 'request_id': 'req-301d5bae-c288-484f-a62d-d1abcf5d6b7e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:35.539781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b00a71-8f4a-4589-a185-cc10e45a9421 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:35.549884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-301d5bae-c288-484f-a62d-d1abcf5d6b7e tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c68833f8f554723920d8ecf64ae1a7f', 'request_id': 'req-301d5bae-c288-484f-a62d-d1abcf5d6b7e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:35.575249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-301d5bae-c288-484f-a62d-d1abcf5d6b7e tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] The token cache is being invalidate because project 3c68833f8f554723920d8ecf64ae1a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:35.575542 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-301d5bae-c288-484f-a62d-d1abcf5d6b7e tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:35.578397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-301d5bae-c288-484f-a62d-d1abcf5d6b7e tempest-VolumeQuotaClassesTest-322024124 tempest-VolumeQuotaClassesTest-322024124-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:35.586118 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 992/1940] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:35 2022] DELETE /identity/v3/projects/3c68833f8f554723920d8ecf64ae1a7f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:35.647535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f4c60-48f4-443f-bfd4-6f94db07120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:35.650336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f4c60-48f4-443f-bfd4-6f94db07120b admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:35.650336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f4c60-48f4-443f-bfd4-6f94db07120b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:35.650336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f4c60-48f4-443f-bfd4-6f94db07120b admin admin] PATH_INFO: `/v3/projects/387621e381dd4a9a88e38b6fcdbf1c00/users/6fb6ad64c7d64f3aad1963529ee37020/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:35.669482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f4c60-48f4-443f-bfd4-6f94db07120b admin admin] RBAC: Authorizing `identity:create_grant(project_id=387621e381dd4a9a88e38b6fcdbf1c00, user_id=6fb6ad64c7d64f3aad1963529ee37020, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:35.673164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f4c60-48f4-443f-bfd4-6f94db07120b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:35.694911 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 949/1941] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:35 2022] PUT /identity/v3/projects/387621e381dd4a9a88e38b6fcdbf1c00/users/6fb6ad64c7d64f3aad1963529ee37020/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:35.706428 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3af3c-b3ef-4896-bc51-8b7d03849d3a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:35.707425 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3af3c-b3ef-4896-bc51-8b7d03849d3a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:35.707849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3af3c-b3ef-4896-bc51-8b7d03849d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:35.786285 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-99b3af3c-b3ef-4896-bc51-8b7d03849d3a None None] MFA Rules not processed for user `6fb6ad64c7d64f3aad1963529ee37020`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:35.788419 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-99b3af3c-b3ef-4896-bc51-8b7d03849d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:35.959794 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 993/1942] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:35.961812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f4c60-48f4-443f-bfd4-6f94db07120b admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:35.963652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a81f4c60-48f4-443f-bfd4-6f94db07120b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:35.974027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3af3c-b3ef-4896-bc51-8b7d03849d3a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:35.975323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-99b3af3c-b3ef-4896-bc51-8b7d03849d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:36.101074 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:36.117885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3af3c-b3ef-4896-bc51-8b7d03849d3a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:36.124039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a44643-c62d-4dae-b28c-f371efa44192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:36.125429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a44643-c62d-4dae-b28c-f371efa44192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:36.125726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a44643-c62d-4dae-b28c-f371efa44192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:36.126012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a44643-c62d-4dae-b28c-f371efa44192 admin admin] PATH_INFO: `/v3/users/8ba72a7e419945e9ba74a091640474fe` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:36.133651 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f4c60-48f4-443f-bfd4-6f94db07120b admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:36.134607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a44643-c62d-4dae-b28c-f371efa44192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba72a7e419945e9ba74a091640474fe)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:36.136609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a44643-c62d-4dae-b28c-f371efa44192 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:36.146015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a76eab-da58-4762-9009-1d488e8ead04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:36.146716 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a76eab-da58-4762-9009-1d488e8ead04 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:36.147310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a76eab-da58-4762-9009-1d488e8ead04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:36.147391 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a76eab-da58-4762-9009-1d488e8ead04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:36.148199 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a76eab-da58-4762-9009-1d488e8ead04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:36.150566 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a76eab-da58-4762-9009-1d488e8ead04 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:36.167325 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:36.205641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 950/1943] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:35 2022] POST /identity/v3/projects => generated 377 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:30:36.206882 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a76eab-da58-4762-9009-1d488e8ead04 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:36.210853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-d5a76eab-da58-4762-9009-1d488e8ead04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:36.265953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-52a44643-c62d-4dae-b28c-f371efa44192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba72a7e419945e9ba74a091640474fe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:36.305199 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a76eab-da58-4762-9009-1d488e8ead04 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:36.313226 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876128d-6d84-4d0e-8b44-bf98151e5913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:36.314889 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876128d-6d84-4d0e-8b44-bf98151e5913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:36.314889 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876128d-6d84-4d0e-8b44-bf98151e5913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:36.314889 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876128d-6d84-4d0e-8b44-bf98151e5913 admin admin] PATH_INFO: `/v3/projects/a63d944e862047aeaad1dce1f27335c0` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:36.317575 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876128d-6d84-4d0e-8b44-bf98151e5913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63d944e862047aeaad1dce1f27335c0)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:36.319788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876128d-6d84-4d0e-8b44-bf98151e5913 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:36.332398 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-52a44643-c62d-4dae-b28c-f371efa44192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba72a7e419945e9ba74a091640474fe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:36.356323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-52a44643-c62d-4dae-b28c-f371efa44192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba72a7e419945e9ba74a091640474fe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:36.357293 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-52a44643-c62d-4dae-b28c-f371efa44192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba72a7e419945e9ba74a091640474fe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:36.383111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-52a44643-c62d-4dae-b28c-f371efa44192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba72a7e419945e9ba74a091640474fe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:36.391896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 994/1944] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:35 2022] DELETE /identity/v3/users/8ba72a7e419945e9ba74a091640474fe => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:36.393433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a44643-c62d-4dae-b28c-f371efa44192 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:36.396005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-52a44643-c62d-4dae-b28c-f371efa44192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:36.440676 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f876128d-6d84-4d0e-8b44-bf98151e5913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63d944e862047aeaad1dce1f27335c0', 'request_id': 'req-f876128d-6d84-4d0e-8b44-bf98151e5913'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:36.463605 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f876128d-6d84-4d0e-8b44-bf98151e5913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63d944e862047aeaad1dce1f27335c0', 'request_id': 'req-f876128d-6d84-4d0e-8b44-bf98151e5913'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:36.486981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f876128d-6d84-4d0e-8b44-bf98151e5913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63d944e862047aeaad1dce1f27335c0', 'request_id': 'req-f876128d-6d84-4d0e-8b44-bf98151e5913'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:36.507108 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f876128d-6d84-4d0e-8b44-bf98151e5913 admin admin] The token cache is being invalidate because project a63d944e862047aeaad1dce1f27335c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:36.507431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f876128d-6d84-4d0e-8b44-bf98151e5913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:36.508649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f876128d-6d84-4d0e-8b44-bf98151e5913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:36.510751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 951/1945] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:36 2022] DELETE /identity/v3/projects/a63d944e862047aeaad1dce1f27335c0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:36.511881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4081b5-cb27-466d-bd60-441b8d575c26 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:36.512724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4081b5-cb27-466d-bd60-441b8d575c26 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:36.514091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4081b5-cb27-466d-bd60-441b8d575c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:36.557483 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-8b4081b5-cb27-466d-bd60-441b8d575c26 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:36.561992 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8b4081b5-cb27-466d-bd60-441b8d575c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:36.595685 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a44643-c62d-4dae-b28c-f371efa44192 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:36.686887 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 952/1946] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:36.688206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab721f-8aa8-4b83-8bb4-f5ae9b513d47 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:36.689288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab721f-8aa8-4b83-8bb4-f5ae9b513d47 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:36.692375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab721f-8aa8-4b83-8bb4-f5ae9b513d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:36.727463 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:36.738248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-e7ab721f-8aa8-4b83-8bb4-f5ae9b513d47 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:36.740340 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e7ab721f-8aa8-4b83-8bb4-f5ae9b513d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:36.768620 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d59e2c-47f1-4ba7-a5b9-7229ba942cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:36.773108 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 953/1947] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:36.773689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d59e2c-47f1-4ba7-a5b9-7229ba942cda admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:36.774029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d59e2c-47f1-4ba7-a5b9-7229ba942cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:36.774317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d59e2c-47f1-4ba7-a5b9-7229ba942cda admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:36.775066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d59e2c-47f1-4ba7-a5b9-7229ba942cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:36.777806 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab721f-8aa8-4b83-8bb4-f5ae9b513d47 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:36.783951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e7ab721f-8aa8-4b83-8bb4-f5ae9b513d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:36.786125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d59e2c-47f1-4ba7-a5b9-7229ba942cda admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:36.864472 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 995/1948] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:36 2022] POST /identity/v3/users => generated 295 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:36.867843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df530e-9771-42ee-a4bd-7abaafd251a0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:36.868151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df530e-9771-42ee-a4bd-7abaafd251a0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:36.870958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df530e-9771-42ee-a4bd-7abaafd251a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:36.929172 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-32df530e-9771-42ee-a4bd-7abaafd251a0 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:36.930413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-32df530e-9771-42ee-a4bd-7abaafd251a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:36.951843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 996/1949] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:36.958641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df530e-9771-42ee-a4bd-7abaafd251a0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:36.963850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-32df530e-9771-42ee-a4bd-7abaafd251a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:36.973203 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab721f-8aa8-4b83-8bb4-f5ae9b513d47 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:36.982396 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b065e2e-e59f-4eac-b3b6-6879de44fdc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:36.983069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b065e2e-e59f-4eac-b3b6-6879de44fdc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:36.983396 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b065e2e-e59f-4eac-b3b6-6879de44fdc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:36.983681 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b065e2e-e59f-4eac-b3b6-6879de44fdc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:36.993575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df530e-9771-42ee-a4bd-7abaafd251a0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:37.005961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b065e2e-e59f-4eac-b3b6-6879de44fdc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:37.005961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b065e2e-e59f-4eac-b3b6-6879de44fdc1 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:37.010452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0f056-152e-4c2d-a59f-9f1cb7582e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:37.011134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f056-152e-4c2d-a59f-9f1cb7582e44 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:37.011410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f056-152e-4c2d-a59f-9f1cb7582e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:37.011680 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f056-152e-4c2d-a59f-9f1cb7582e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:37.012406 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0f056-152e-4c2d-a59f-9f1cb7582e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:37.014090 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0f056-152e-4c2d-a59f-9f1cb7582e44 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:37.022876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 954/1950] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:37.023730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b065e2e-e59f-4eac-b3b6-6879de44fdc1 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:37.041719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 997/1951] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:37.046785 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0f056-152e-4c2d-a59f-9f1cb7582e44 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:37.055697 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b065e2e-e59f-4eac-b3b6-6879de44fdc1 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:37.079482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d1f56-ddf7-4846-a3bf-f3543a3fbc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:37.080167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d1f56-ddf7-4846-a3bf-f3543a3fbc73 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:37.080451 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d1f56-ddf7-4846-a3bf-f3543a3fbc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:37.080725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d1f56-ddf7-4846-a3bf-f3543a3fbc73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:37.081523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d1f56-ddf7-4846-a3bf-f3543a3fbc73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:37.081830 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d1f56-ddf7-4846-a3bf-f3543a3fbc73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:37.082238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0f056-152e-4c2d-a59f-9f1cb7582e44 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:37.084699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d1f56-ddf7-4846-a3bf-f3543a3fbc73 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:37.089020 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f716b-d4c9-479d-93ad-d5a9df587705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:37.089936 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f716b-d4c9-479d-93ad-d5a9df587705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:37.090221 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f716b-d4c9-479d-93ad-d5a9df587705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:37.090507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f716b-d4c9-479d-93ad-d5a9df587705 admin admin] PATH_INFO: `/v3/projects/106f56e3368648fa8c7bf0de3f2d4af8/users/0855cd01c30c49cdaa0932b936f15272/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:37.107750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:37.112405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 955/1952] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:37.117205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d1f56-ddf7-4846-a3bf-f3543a3fbc73 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:37.133184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f716b-d4c9-479d-93ad-d5a9df587705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=106f56e3368648fa8c7bf0de3f2d4af8, user_id=0855cd01c30c49cdaa0932b936f15272, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:37.139018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f716b-d4c9-479d-93ad-d5a9df587705 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:37.144243 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d1f56-ddf7-4846-a3bf-f3543a3fbc73 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:37.159863 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bae5df-a32a-4620-b6a3-23946be10b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:37.160948 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bae5df-a32a-4620-b6a3-23946be10b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:37.168125 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bae5df-a32a-4620-b6a3-23946be10b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:37.168125 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bae5df-a32a-4620-b6a3-23946be10b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:37.171350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bae5df-a32a-4620-b6a3-23946be10b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:37.174492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bae5df-a32a-4620-b6a3-23946be10b98 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:37.179576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 998/1953] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:37 2022] PUT /identity/v3/projects/106f56e3368648fa8c7bf0de3f2d4af8/users/0855cd01c30c49cdaa0932b936f15272/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:37.183259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f716b-d4c9-479d-93ad-d5a9df587705 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:37.232268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 956/1954] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:37 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:37.237234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bae5df-a32a-4620-b6a3-23946be10b98 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:37.390716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f716b-d4c9-479d-93ad-d5a9df587705 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:37.420477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bae5df-a32a-4620-b6a3-23946be10b98 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:37.443654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b2c07-20b3-460f-a535-3d74daa06716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:37.444263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b2c07-20b3-460f-a535-3d74daa06716 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:37.444521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b2c07-20b3-460f-a535-3d74daa06716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:37.444828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b2c07-20b3-460f-a535-3d74daa06716 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:37.445767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b2c07-20b3-460f-a535-3d74daa06716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:37.448558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b2c07-20b3-460f-a535-3d74daa06716 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:37.516894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05276fe5-9c6c-4b0f-9897-a80c67a1bbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:37.517945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05276fe5-9c6c-4b0f-9897-a80c67a1bbec admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:37.518306 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05276fe5-9c6c-4b0f-9897-a80c67a1bbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:37.518675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05276fe5-9c6c-4b0f-9897-a80c67a1bbec admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:37.519547 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05276fe5-9c6c-4b0f-9897-a80c67a1bbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:37.521352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05276fe5-9c6c-4b0f-9897-a80c67a1bbec admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:37.531512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 957/1955] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:37 2022] POST /identity/v3/users => generated 294 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:37.531856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b2c07-20b3-460f-a535-3d74daa06716 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:37.543548 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 999/1956] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:37.544967 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05276fe5-9c6c-4b0f-9897-a80c67a1bbec admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:37.559256 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05276fe5-9c6c-4b0f-9897-a80c67a1bbec admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:37.566506 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb0587-e032-456b-b892-4846d4e4e5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:37.567479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb0587-e032-456b-b892-4846d4e4e5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:37.567764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb0587-e032-456b-b892-4846d4e4e5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:37.568039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb0587-e032-456b-b892-4846d4e4e5ec admin admin] PATH_INFO: `/v3/projects/106f56e3368648fa8c7bf0de3f2d4af8/users/0855cd01c30c49cdaa0932b936f15272/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:37.570319 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb0587-e032-456b-b892-4846d4e4e5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=106f56e3368648fa8c7bf0de3f2d4af8, user_id=0855cd01c30c49cdaa0932b936f15272, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:37.574609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb0587-e032-456b-b892-4846d4e4e5ec admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:37.590760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b2c07-20b3-460f-a535-3d74daa06716 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:37.591585 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1000/1957] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:37 2022] PUT /identity/v3/projects/106f56e3368648fa8c7bf0de3f2d4af8/users/0855cd01c30c49cdaa0932b936f15272/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:37.607192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ed82e-414d-4e59-88ea-5830e6080cb8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:37.609554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ed82e-414d-4e59-88ea-5830e6080cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:37.611755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ed82e-414d-4e59-88ea-5830e6080cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:37.752455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1b3ed82e-414d-4e59-88ea-5830e6080cb8 None None] MFA Rules not processed for user `0855cd01c30c49cdaa0932b936f15272`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:37.753609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1b3ed82e-414d-4e59-88ea-5830e6080cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:37.823410 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:37.841710 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ef406-5b39-4bd0-a22d-0099308e59d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:37.842488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ef406-5b39-4bd0-a22d-0099308e59d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:37.843377 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ef406-5b39-4bd0-a22d-0099308e59d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:37.843653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ef406-5b39-4bd0-a22d-0099308e59d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:37.847524 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ef406-5b39-4bd0-a22d-0099308e59d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:37.857102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ef406-5b39-4bd0-a22d-0099308e59d0 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:37.918796 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 958/1958] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:37.925619 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ef406-5b39-4bd0-a22d-0099308e59d0 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:37.932666 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-3e4ef406-5b39-4bd0-a22d-0099308e59d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:38.017453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1001/1959] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:38.018835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ed82e-414d-4e59-88ea-5830e6080cb8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:38.019362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ef406-5b39-4bd0-a22d-0099308e59d0 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:38.032058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:38.033625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:38.034170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:38.034636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:38.035084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1 admin admin] PATH_INFO: `/v3/projects/0fcf5cab87cc4e6189b0ee358781f6f9` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:38.038752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fcf5cab87cc4e6189b0ee358781f6f9)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:38.042854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:38.070184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ed82e-414d-4e59-88ea-5830e6080cb8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:38.088615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40997a3-1730-4b5c-8541-4382ad2e834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:38.089391 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40997a3-1730-4b5c-8541-4382ad2e834b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:38.089619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40997a3-1730-4b5c-8541-4382ad2e834b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:38.089894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40997a3-1730-4b5c-8541-4382ad2e834b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:38.090643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40997a3-1730-4b5c-8541-4382ad2e834b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:38.099689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40997a3-1730-4b5c-8541-4382ad2e834b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:38.137233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1002/1960] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:38.141880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40997a3-1730-4b5c-8541-4382ad2e834b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:38.152782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a40997a3-1730-4b5c-8541-4382ad2e834b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:38.229638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fcf5cab87cc4e6189b0ee358781f6f9', 'request_id': 'req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:38.251598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fcf5cab87cc4e6189b0ee358781f6f9', 'request_id': 'req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:38.262136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fcf5cab87cc4e6189b0ee358781f6f9', 'request_id': 'req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:38.319166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1 admin admin] The token cache is being invalidate because project 0fcf5cab87cc4e6189b0ee358781f6f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:38.321384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:38.326829 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:38.340484 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 959/1961] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:37 2022] DELETE /identity/v3/projects/0fcf5cab87cc4e6189b0ee358781f6f9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:38.344554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:38.353272 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:38.387942 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40997a3-1730-4b5c-8541-4382ad2e834b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:38.504993 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93139db1-b933-4061-90bd-754776681e71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:38.506638 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93139db1-b933-4061-90bd-754776681e71 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:38.506920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93139db1-b933-4061-90bd-754776681e71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:38.507205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93139db1-b933-4061-90bd-754776681e71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:38.512728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-93139db1-b933-4061-90bd-754776681e71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:38.525724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e7c16-9bef-4384-a54f-cd376fbee3a1 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:38.548473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5557c7-3508-4a17-b144-9659035593ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:38.549954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5557c7-3508-4a17-b144-9659035593ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:38.550249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5557c7-3508-4a17-b144-9659035593ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:38.550608 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5557c7-3508-4a17-b144-9659035593ad admin admin] PATH_INFO: `/v3/projects/d1456fa4b9ca40ac9890b04c744c9a82/users/6193a0d8b4744f02ad224d0778f807c9/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:38.573043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5557c7-3508-4a17-b144-9659035593ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1456fa4b9ca40ac9890b04c744c9a82, user_id=6193a0d8b4744f02ad224d0778f807c9, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:38.576537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5557c7-3508-4a17-b144-9659035593ad admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:38.599740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93139db1-b933-4061-90bd-754776681e71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:38.601841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93139db1-b933-4061-90bd-754776681e71 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:38.607010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 960/1962] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:38 2022] PUT /identity/v3/projects/d1456fa4b9ca40ac9890b04c744c9a82/users/6193a0d8b4744f02ad224d0778f807c9/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:38.608729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5557c7-3508-4a17-b144-9659035593ad admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:38.613398 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-5c5557c7-3508-4a17-b144-9659035593ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:38.615826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1003/1963] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:38.618693 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9f827-2ff5-4a83-948c-7eeac968aa35 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:38.619247 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9f827-2ff5-4a83-948c-7eeac968aa35 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:38.619565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9f827-2ff5-4a83-948c-7eeac968aa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:38.661266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-39e9f827-2ff5-4a83-948c-7eeac968aa35 None None] MFA Rules not processed for user `6193a0d8b4744f02ad224d0778f807c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:38.665352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-39e9f827-2ff5-4a83-948c-7eeac968aa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:38.770770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:38.801656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1004/1964] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:38.803668 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9f827-2ff5-4a83-948c-7eeac968aa35 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:38.805134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-39e9f827-2ff5-4a83-948c-7eeac968aa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:38.832006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5557c7-3508-4a17-b144-9659035593ad admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:38.876500 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fbc00-c3e3-4631-918b-23f62ded9b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:38.879820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fbc00-c3e3-4631-918b-23f62ded9b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:38.880230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fbc00-c3e3-4631-918b-23f62ded9b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:38.880705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fbc00-c3e3-4631-918b-23f62ded9b21 admin admin] PATH_INFO: `/v3/users/a6ec4179e0d24fc7a646589661591184` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:38.883615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fbc00-c3e3-4631-918b-23f62ded9b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ec4179e0d24fc7a646589661591184)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:38.886992 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fbc00-c3e3-4631-918b-23f62ded9b21 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:38.896363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:38.996073 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-944fbc00-c3e3-4631-918b-23f62ded9b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ec4179e0d24fc7a646589661591184'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:39.015780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9f827-2ff5-4a83-948c-7eeac968aa35 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:39.022342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d6ad1-da8b-49cc-8302-aa447023fc37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:39.024224 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d6ad1-da8b-49cc-8302-aa447023fc37 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:39.024527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d6ad1-da8b-49cc-8302-aa447023fc37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:39.024809 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d6ad1-da8b-49cc-8302-aa447023fc37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:39.026327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-944fbc00-c3e3-4631-918b-23f62ded9b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ec4179e0d24fc7a646589661591184'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:39.029435 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-944fbc00-c3e3-4631-918b-23f62ded9b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ec4179e0d24fc7a646589661591184'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:39.033537 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dd6d6ad1-da8b-49cc-8302-aa447023fc37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:39.075898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-944fbc00-c3e3-4631-918b-23f62ded9b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ec4179e0d24fc7a646589661591184'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:39.118875 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-944fbc00-c3e3-4631-918b-23f62ded9b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ec4179e0d24fc7a646589661591184'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:39.132456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 961/1965] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:38 2022] DELETE /identity/v3/users/a6ec4179e0d24fc7a646589661591184 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:39.135450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fbc00-c3e3-4631-918b-23f62ded9b21 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:39.138610 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-944fbc00-c3e3-4631-918b-23f62ded9b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:39.468980 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d6ad1-da8b-49cc-8302-aa447023fc37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:39.487659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d6ad1-da8b-49cc-8302-aa447023fc37 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:39.570326 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fbc00-c3e3-4631-918b-23f62ded9b21 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:39.586877 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653b83c-426f-4738-afa0-79d0487eb1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:39.589876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653b83c-426f-4738-afa0-79d0487eb1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:39.591934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653b83c-426f-4738-afa0-79d0487eb1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:39.594360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653b83c-426f-4738-afa0-79d0487eb1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:39.598456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653b83c-426f-4738-afa0-79d0487eb1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:39.606827 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653b83c-426f-4738-afa0-79d0487eb1e5 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:39.641730 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1005/1966] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 838 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:39.741281 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 962/1967] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:39 2022] POST /identity/v3/projects => generated 387 bytes in 607 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:39.745397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d6ad1-da8b-49cc-8302-aa447023fc37 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:39.765625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d6ad1-da8b-49cc-8302-aa447023fc37 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:39.922124 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94c506-f26b-44a4-8910-fd2ee54eff67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:39.922680 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94c506-f26b-44a4-8910-fd2ee54eff67 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:39.923018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94c506-f26b-44a4-8910-fd2ee54eff67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:39.923569 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94c506-f26b-44a4-8910-fd2ee54eff67 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:39.925434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94c506-f26b-44a4-8910-fd2ee54eff67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:39.929807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94c506-f26b-44a4-8910-fd2ee54eff67 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:39.981200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1006/1968] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:39 2022] POST /identity/v3/users => generated 300 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:39.983109 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653b83c-426f-4738-afa0-79d0487eb1e5 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:39.997836 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653b83c-426f-4738-afa0-79d0487eb1e5 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:40.003336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3c2fe-c3aa-4f82-a1a5-ae1ba197a62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:40.004142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3c2fe-c3aa-4f82-a1a5-ae1ba197a62a admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:40.004726 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3c2fe-c3aa-4f82-a1a5-ae1ba197a62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:40.005263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3c2fe-c3aa-4f82-a1a5-ae1ba197a62a admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:40.006189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3c2fe-c3aa-4f82-a1a5-ae1ba197a62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:40.008569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3c2fe-c3aa-4f82-a1a5-ae1ba197a62a admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:40.038074 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 963/1969] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:40.040682 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94c506-f26b-44a4-8910-fd2ee54eff67 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:40.060872 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94c506-f26b-44a4-8910-fd2ee54eff67 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:40.076461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1b8be-79bb-40a3-b95e-7477b883a7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:40.078825 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1b8be-79bb-40a3-b95e-7477b883a7da admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:40.079796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1b8be-79bb-40a3-b95e-7477b883a7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:40.081404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1b8be-79bb-40a3-b95e-7477b883a7da admin admin] PATH_INFO: `/v3/projects/368fced11df2459c855486f4f40e858b/users/1ba7be10e29e4ab3a6a9ce7de35fd96f/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:40.120959 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1b8be-79bb-40a3-b95e-7477b883a7da admin admin] RBAC: Authorizing `identity:create_grant(project_id=368fced11df2459c855486f4f40e858b, user_id=1ba7be10e29e4ab3a6a9ce7de35fd96f, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:40.124688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1b8be-79bb-40a3-b95e-7477b883a7da admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:40.159944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1007/1970] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:40 2022] PUT /identity/v3/projects/368fced11df2459c855486f4f40e858b/users/1ba7be10e29e4ab3a6a9ce7de35fd96f/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:40.161652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3c2fe-c3aa-4f82-a1a5-ae1ba197a62a admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:40.179054 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3c2fe-c3aa-4f82-a1a5-ae1ba197a62a admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:40.309609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:40.322859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd8ed8-0c9e-46d7-8f31-3bdd78c1761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:40.323700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd8ed8-0c9e-46d7-8f31-3bdd78c1761d admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:40.325127 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd8ed8-0c9e-46d7-8f31-3bdd78c1761d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:40.325828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd8ed8-0c9e-46d7-8f31-3bdd78c1761d admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:40.326638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd8ed8-0c9e-46d7-8f31-3bdd78c1761d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:40.328708 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd8ed8-0c9e-46d7-8f31-3bdd78c1761d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:40.339948 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 964/1971] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:30:40.344326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1b8be-79bb-40a3-b95e-7477b883a7da admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:40.367502 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1b8be-79bb-40a3-b95e-7477b883a7da admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:40.383256 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0ff9d-5226-4e2d-b3ba-d07ac9e37251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:40.384233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0ff9d-5226-4e2d-b3ba-d07ac9e37251 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:40.384979 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0ff9d-5226-4e2d-b3ba-d07ac9e37251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:40.385344 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0ff9d-5226-4e2d-b3ba-d07ac9e37251 admin admin] PATH_INFO: `/v3/projects/368fced11df2459c855486f4f40e858b/users/1ba7be10e29e4ab3a6a9ce7de35fd96f/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:40.390386 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0ff9d-5226-4e2d-b3ba-d07ac9e37251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=368fced11df2459c855486f4f40e858b, user_id=1ba7be10e29e4ab3a6a9ce7de35fd96f, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:40.393727 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0ff9d-5226-4e2d-b3ba-d07ac9e37251 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:40.396446 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:40.411401 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1008/1972] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:40 2022] PUT /identity/v3/projects/368fced11df2459c855486f4f40e858b/users/1ba7be10e29e4ab3a6a9ce7de35fd96f/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:40.423035 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84164c4d-9e96-4605-a0a8-c483033c0728 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:40.423631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84164c4d-9e96-4605-a0a8-c483033c0728 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:40.423924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84164c4d-9e96-4605-a0a8-c483033c0728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:40.472438 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-84164c4d-9e96-4605-a0a8-c483033c0728 None None] MFA Rules not processed for user `1ba7be10e29e4ab3a6a9ce7de35fd96f`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:40.474069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-84164c4d-9e96-4605-a0a8-c483033c0728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:40.560431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 965/1973] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:40.572126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0ff9d-5226-4e2d-b3ba-d07ac9e37251 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:40.573861 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cca0ff9d-5226-4e2d-b3ba-d07ac9e37251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:40.633903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0ff9d-5226-4e2d-b3ba-d07ac9e37251 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:40.637516 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a2491-5a29-4490-bf43-23b07d7b2039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:40.638215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a2491-5a29-4490-bf43-23b07d7b2039 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:40.638539 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a2491-5a29-4490-bf43-23b07d7b2039 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:40.638823 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a2491-5a29-4490-bf43-23b07d7b2039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:40.650759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a2491-5a29-4490-bf43-23b07d7b2039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:40.652199 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a2491-5a29-4490-bf43-23b07d7b2039 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:40.664527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1009/1974] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:40.689882 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84164c4d-9e96-4605-a0a8-c483033c0728 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:40.691374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-84164c4d-9e96-4605-a0a8-c483033c0728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:40.790895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84164c4d-9e96-4605-a0a8-c483033c0728 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:40.796071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13133840-cc73-4559-9ad1-ca5ac3173dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:40.796980 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13133840-cc73-4559-9ad1-ca5ac3173dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:40.797341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13133840-cc73-4559-9ad1-ca5ac3173dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:40.797747 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13133840-cc73-4559-9ad1-ca5ac3173dad admin admin] PATH_INFO: `/v3/projects/5fcc4f181c3a4fd2a7abf60834080534` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:40.798824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13133840-cc73-4559-9ad1-ca5ac3173dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fcc4f181c3a4fd2a7abf60834080534)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:40.800991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13133840-cc73-4559-9ad1-ca5ac3173dad admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:40.823291 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a2491-5a29-4490-bf43-23b07d7b2039 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:40.837077 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a2491-5a29-4490-bf43-23b07d7b2039 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:40.842850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add1e82-a07d-461f-b32b-7069cf7d5ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:40.844211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add1e82-a07d-461f-b32b-7069cf7d5ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:40.844440 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add1e82-a07d-461f-b32b-7069cf7d5ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:40.855466 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add1e82-a07d-461f-b32b-7069cf7d5ea2 admin admin] PATH_INFO: `/v3/users/6193a0d8b4744f02ad224d0778f807c9` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:40.860838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add1e82-a07d-461f-b32b-7069cf7d5ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6193a0d8b4744f02ad224d0778f807c9)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:40.865505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add1e82-a07d-461f-b32b-7069cf7d5ea2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:40.872527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-13133840-cc73-4559-9ad1-ca5ac3173dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fcc4f181c3a4fd2a7abf60834080534', 'request_id': 'req-13133840-cc73-4559-9ad1-ca5ac3173dad'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:40.909814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-13133840-cc73-4559-9ad1-ca5ac3173dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fcc4f181c3a4fd2a7abf60834080534', 'request_id': 'req-13133840-cc73-4559-9ad1-ca5ac3173dad'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:40.920198 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-13133840-cc73-4559-9ad1-ca5ac3173dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fcc4f181c3a4fd2a7abf60834080534', 'request_id': 'req-13133840-cc73-4559-9ad1-ca5ac3173dad'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:40.944979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-13133840-cc73-4559-9ad1-ca5ac3173dad admin admin] The token cache is being invalidate because project 5fcc4f181c3a4fd2a7abf60834080534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:40.945316 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-13133840-cc73-4559-9ad1-ca5ac3173dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:40.947815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-13133840-cc73-4559-9ad1-ca5ac3173dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:40.955286 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 966/1975] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:40 2022] DELETE /identity/v3/projects/5fcc4f181c3a4fd2a7abf60834080534 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:40.958450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f679c-402b-483c-82ab-c809388b529a None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:40.959966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f679c-402b-483c-82ab-c809388b529a None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:40.959966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f679c-402b-483c-82ab-c809388b529a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:40.968136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:40.991190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8add1e82-a07d-461f-b32b-7069cf7d5ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6193a0d8b4744f02ad224d0778f807c9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:41.017677 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-a01f679c-402b-483c-82ab-c809388b529a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:41.019459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a01f679c-402b-483c-82ab-c809388b529a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:41.031154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8add1e82-a07d-461f-b32b-7069cf7d5ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6193a0d8b4744f02ad224d0778f807c9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:41.043529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8add1e82-a07d-461f-b32b-7069cf7d5ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6193a0d8b4744f02ad224d0778f807c9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:41.046319 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8add1e82-a07d-461f-b32b-7069cf7d5ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6193a0d8b4744f02ad224d0778f807c9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:41.063080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8add1e82-a07d-461f-b32b-7069cf7d5ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6193a0d8b4744f02ad224d0778f807c9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:41.078997 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1010/1976] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:40 2022] DELETE /identity/v3/users/6193a0d8b4744f02ad224d0778f807c9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:41.082047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d349-3935-4c7d-9db0-1651db686a0f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:41.082341 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d349-3935-4c7d-9db0-1651db686a0f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:41.082624 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d349-3935-4c7d-9db0-1651db686a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:41.119338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a577d349-3935-4c7d-9db0-1651db686a0f None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:41.120571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a577d349-3935-4c7d-9db0-1651db686a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:41.157263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 967/1977] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:41.166015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd198320-3ad8-4e89-814e-3f3b01bdd2bd None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:41.166421 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd198320-3ad8-4e89-814e-3f3b01bdd2bd None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:41.166807 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd198320-3ad8-4e89-814e-3f3b01bdd2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:41.203440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-bd198320-3ad8-4e89-814e-3f3b01bdd2bd None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:41.205307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-bd198320-3ad8-4e89-814e-3f3b01bdd2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:41.260108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1011/1978] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:41.270420 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d349-3935-4c7d-9db0-1651db686a0f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:41.274996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a577d349-3935-4c7d-9db0-1651db686a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:41.302696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:41.311059 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 968/1979] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:41.315645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd198320-3ad8-4e89-814e-3f3b01bdd2bd None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:41.339408 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd198320-3ad8-4e89-814e-3f3b01bdd2bd None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:41.348498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217c32d-ae8f-4645-bbc5-e320ccf607d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:41.349177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217c32d-ae8f-4645-bbc5-e320ccf607d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:41.349490 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217c32d-ae8f-4645-bbc5-e320ccf607d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:41.349801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217c32d-ae8f-4645-bbc5-e320ccf607d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:41.350575 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217c32d-ae8f-4645-bbc5-e320ccf607d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:41.350974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217c32d-ae8f-4645-bbc5-e320ccf607d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:41.354568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217c32d-ae8f-4645-bbc5-e320ccf607d6 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:41.400357 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 969/1980] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:41.401725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217c32d-ae8f-4645-bbc5-e320ccf607d6 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:41.422362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217c32d-ae8f-4645-bbc5-e320ccf607d6 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:41.432591 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6e04d-bbbb-4b47-b4e9-a5f81b9c2c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:41.434131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d349-3935-4c7d-9db0-1651db686a0f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:41.434254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6e04d-bbbb-4b47-b4e9-a5f81b9c2c7f admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:41.434659 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6e04d-bbbb-4b47-b4e9-a5f81b9c2c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:41.435256 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6e04d-bbbb-4b47-b4e9-a5f81b9c2c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:41.436767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6e04d-bbbb-4b47-b4e9-a5f81b9c2c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:41.440200 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6e04d-bbbb-4b47-b4e9-a5f81b9c2c7f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:41.444395 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aca1f-b395-4e16-b804-5cb1a262243e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:41.445257 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aca1f-b395-4e16-b804-5cb1a262243e service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:41.445556 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aca1f-b395-4e16-b804-5cb1a262243e service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:41.445832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aca1f-b395-4e16-b804-5cb1a262243e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:41.483188 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39aca1f-b395-4e16-b804-5cb1a262243e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:41.484945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39aca1f-b395-4e16-b804-5cb1a262243e service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:41.497921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 970/1981] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:41 2022] POST /identity/v3/projects => generated 397 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:41.503665 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6e04d-bbbb-4b47-b4e9-a5f81b9c2c7f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:41.513561 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1012/1982] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:30:41.618009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6e04d-bbbb-4b47-b4e9-a5f81b9c2c7f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:41.624592 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d2de2-0496-4975-9dcd-7c32f42b6226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:41.626069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d2de2-0496-4975-9dcd-7c32f42b6226 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:41.626069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d2de2-0496-4975-9dcd-7c32f42b6226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:41.626069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d2de2-0496-4975-9dcd-7c32f42b6226 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:41.626957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d2de2-0496-4975-9dcd-7c32f42b6226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:41.629687 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d2de2-0496-4975-9dcd-7c32f42b6226 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:41.651872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:41.692027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 971/1983] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:41 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:41.696381 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aca1f-b395-4e16-b804-5cb1a262243e service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:41.709160 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aca1f-b395-4e16-b804-5cb1a262243e service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:41.720639 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4b9dc-5af0-4118-9d00-f2035ceb0908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:41.721416 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4b9dc-5af0-4118-9d00-f2035ceb0908 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:41.721731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4b9dc-5af0-4118-9d00-f2035ceb0908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:41.722119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4b9dc-5af0-4118-9d00-f2035ceb0908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:41.722872 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4b9dc-5af0-4118-9d00-f2035ceb0908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:41.727116 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4b9dc-5af0-4118-9d00-f2035ceb0908 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:41.755656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1013/1984] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:41.756193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d2de2-0496-4975-9dcd-7c32f42b6226 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:41.775493 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d2de2-0496-4975-9dcd-7c32f42b6226 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:41.781934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18518afb-dc67-440d-a3d7-239578902228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:41.782617 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18518afb-dc67-440d-a3d7-239578902228 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:41.782901 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18518afb-dc67-440d-a3d7-239578902228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:41.783256 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18518afb-dc67-440d-a3d7-239578902228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:41.783993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18518afb-dc67-440d-a3d7-239578902228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:41.785682 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18518afb-dc67-440d-a3d7-239578902228 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:41.798278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 972/1985] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:41.802148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4b9dc-5af0-4118-9d00-f2035ceb0908 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:41.815700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4b9dc-5af0-4118-9d00-f2035ceb0908 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:41.830052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362b12b-4135-4d03-b1b0-55ea70fffb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:41.830965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362b12b-4135-4d03-b1b0-55ea70fffb48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:41.831343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362b12b-4135-4d03-b1b0-55ea70fffb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:41.831526 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362b12b-4135-4d03-b1b0-55ea70fffb48 admin admin] PATH_INFO: `/v3/projects/5aa5698c28714b87aa685811ba626b12/users/520561e1d4464eb1a7f1bb7a708067a0/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:41.871780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362b12b-4135-4d03-b1b0-55ea70fffb48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa5698c28714b87aa685811ba626b12, user_id=520561e1d4464eb1a7f1bb7a708067a0, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:41.876778 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362b12b-4135-4d03-b1b0-55ea70fffb48 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:41.906121 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1014/1986] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:41 2022] PUT /identity/v3/projects/5aa5698c28714b87aa685811ba626b12/users/520561e1d4464eb1a7f1bb7a708067a0/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:41.916140 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d70f2-7813-4d54-a1fa-3333f5ad74ea None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:41.916509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d70f2-7813-4d54-a1fa-3333f5ad74ea None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:41.916815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d70f2-7813-4d54-a1fa-3333f5ad74ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:41.965222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-d12d70f2-7813-4d54-a1fa-3333f5ad74ea None None] MFA Rules not processed for user `520561e1d4464eb1a7f1bb7a708067a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:41.967296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-d12d70f2-7813-4d54-a1fa-3333f5ad74ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:42.077561 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 973/1987] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:42.082489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362b12b-4135-4d03-b1b0-55ea70fffb48 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:42.168273 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362b12b-4135-4d03-b1b0-55ea70fffb48 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:42.176666 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6f631-eb5b-4561-acbc-4f5af8a0782e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:42.177576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6f631-eb5b-4561-acbc-4f5af8a0782e admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:42.177951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6f631-eb5b-4561-acbc-4f5af8a0782e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:42.178306 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6f631-eb5b-4561-acbc-4f5af8a0782e admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:42.179089 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6f631-eb5b-4561-acbc-4f5af8a0782e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:42.183486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6f631-eb5b-4561-acbc-4f5af8a0782e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:42.226919 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1015/1988] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:42 2022] POST /identity/v3/projects => generated 399 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:42.231994 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d70f2-7813-4d54-a1fa-3333f5ad74ea None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:42.250516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d70f2-7813-4d54-a1fa-3333f5ad74ea None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:42.349620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a0d63-caff-416d-a382-2edc45415f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:42.350499 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a0d63-caff-416d-a382-2edc45415f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:42.350824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a0d63-caff-416d-a382-2edc45415f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:42.351074 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a0d63-caff-416d-a382-2edc45415f31 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:42.351983 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a0d63-caff-416d-a382-2edc45415f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:42.357182 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a0d63-caff-416d-a382-2edc45415f31 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:42.358910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6f631-eb5b-4561-acbc-4f5af8a0782e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:42.360780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-aae6f631-eb5b-4561-acbc-4f5af8a0782e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:42.381962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6f631-eb5b-4561-acbc-4f5af8a0782e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:42.384525 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 974/1989] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:42 2022] POST /identity/v3/users => generated 306 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:42.396962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a0d63-caff-416d-a382-2edc45415f31 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:42.398900 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:42.399882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:42.400180 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:42.400449 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d admin admin] PATH_INFO: `/v3/projects/d1456fa4b9ca40ac9890b04c744c9a82` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:42.405606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1456fa4b9ca40ac9890b04c744c9a82)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:42.407996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:42.412633 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a0d63-caff-416d-a382-2edc45415f31 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:42.418955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a35ea-c0f4-4945-8557-b69db20b5ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:42.419712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a35ea-c0f4-4945-8557-b69db20b5ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:42.420092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a35ea-c0f4-4945-8557-b69db20b5ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:42.422727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a35ea-c0f4-4945-8557-b69db20b5ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:42.422727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a35ea-c0f4-4945-8557-b69db20b5ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:42.425960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a35ea-c0f4-4945-8557-b69db20b5ea5 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:42.442327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 975/1990] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:42.447480 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a35ea-c0f4-4945-8557-b69db20b5ea5 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:42.466278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a35ea-c0f4-4945-8557-b69db20b5ea5 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:42.472634 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cd81b-0ad5-43ef-8bd8-af4663072765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:42.473571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cd81b-0ad5-43ef-8bd8-af4663072765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:42.473841 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cd81b-0ad5-43ef-8bd8-af4663072765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:42.474119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cd81b-0ad5-43ef-8bd8-af4663072765 admin admin] PATH_INFO: `/v3/projects/d220e6871bc644fabd342fd60c372d67/users/ac7d25b47f4e4473b58ef0322bd8e02d/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:42.493026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cd81b-0ad5-43ef-8bd8-af4663072765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d220e6871bc644fabd342fd60c372d67, user_id=ac7d25b47f4e4473b58ef0322bd8e02d, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:42.493574 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1456fa4b9ca40ac9890b04c744c9a82', 'request_id': 'req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:42.496233 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cd81b-0ad5-43ef-8bd8-af4663072765 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:42.511423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1456fa4b9ca40ac9890b04c744c9a82', 'request_id': 'req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:42.515625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 976/1991] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:42 2022] PUT /identity/v3/projects/d220e6871bc644fabd342fd60c372d67/users/ac7d25b47f4e4473b58ef0322bd8e02d/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:42.519081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:42.520802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cd81b-0ad5-43ef-8bd8-af4663072765 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:42.524049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1456fa4b9ca40ac9890b04c744c9a82', 'request_id': 'req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:42.544147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d admin admin] The token cache is being invalidate because project d1456fa4b9ca40ac9890b04c744c9a82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:42.544600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:42.545508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:42.547600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1016/1992] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:42 2022] DELETE /identity/v3/projects/d1456fa4b9ca40ac9890b04c744c9a82 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:42.551111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:42.552555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:42.572808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:42.613352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cd81b-0ad5-43ef-8bd8-af4663072765 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:42.618486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654b78b-87a5-4ad5-84b5-a28582e2acc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:42.619186 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654b78b-87a5-4ad5-84b5-a28582e2acc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:42.620084 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654b78b-87a5-4ad5-84b5-a28582e2acc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:42.620631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654b78b-87a5-4ad5-84b5-a28582e2acc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:42.621525 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654b78b-87a5-4ad5-84b5-a28582e2acc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:42.623305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654b78b-87a5-4ad5-84b5-a28582e2acc5 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:42.636985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 977/1993] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:42.641907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654b78b-87a5-4ad5-84b5-a28582e2acc5 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:42.643928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a654b78b-87a5-4ad5-84b5-a28582e2acc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:42.666089 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654b78b-87a5-4ad5-84b5-a28582e2acc5 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:42.669799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02113b9-b9ae-4153-a72b-b335ceed3e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:42.670748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02113b9-b9ae-4153-a72b-b335ceed3e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:42.671202 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02113b9-b9ae-4153-a72b-b335ceed3e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:42.671607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02113b9-b9ae-4153-a72b-b335ceed3e9c admin admin] PATH_INFO: `/v3/projects/d220e6871bc644fabd342fd60c372d67/users/ac7d25b47f4e4473b58ef0322bd8e02d/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:42.673852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02113b9-b9ae-4153-a72b-b335ceed3e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d220e6871bc644fabd342fd60c372d67, user_id=ac7d25b47f4e4473b58ef0322bd8e02d, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:42.677570 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02113b9-b9ae-4153-a72b-b335ceed3e9c admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:42.678101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd1093-bb86-41c3-aa53-6fd12fc7873d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:42.684294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929ccb9-bc33-4afb-ac74-791215eb0dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:42.685807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929ccb9-bc33-4afb-ac74-791215eb0dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:42.686207 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929ccb9-bc33-4afb-ac74-791215eb0dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:42.697627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 978/1994] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:42 2022] PUT /identity/v3/projects/d220e6871bc644fabd342fd60c372d67/users/ac7d25b47f4e4473b58ef0322bd8e02d/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:42.698223 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929ccb9-bc33-4afb-ac74-791215eb0dbb admin admin] PATH_INFO: `/v3/users/1ba7be10e29e4ab3a6a9ce7de35fd96f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:42.703648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929ccb9-bc33-4afb-ac74-791215eb0dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba7be10e29e4ab3a6a9ce7de35fd96f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:42.706111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929ccb9-bc33-4afb-ac74-791215eb0dbb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:42.713458 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9985142-6d1e-4642-afe2-86c825bd0d6f None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:42.713752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9985142-6d1e-4642-afe2-86c825bd0d6f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:42.714042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9985142-6d1e-4642-afe2-86c825bd0d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:42.754230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-a9985142-6d1e-4642-afe2-86c825bd0d6f None None] MFA Rules not processed for user `ac7d25b47f4e4473b58ef0322bd8e02d`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:42.758243 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a9985142-6d1e-4642-afe2-86c825bd0d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:42.828160 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5929ccb9-bc33-4afb-ac74-791215eb0dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba7be10e29e4ab3a6a9ce7de35fd96f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:42.849156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5929ccb9-bc33-4afb-ac74-791215eb0dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba7be10e29e4ab3a6a9ce7de35fd96f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:42.864958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 979/1995] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:42.866707 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5929ccb9-bc33-4afb-ac74-791215eb0dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba7be10e29e4ab3a6a9ce7de35fd96f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:42.867659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5929ccb9-bc33-4afb-ac74-791215eb0dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba7be10e29e4ab3a6a9ce7de35fd96f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:42.877399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9985142-6d1e-4642-afe2-86c825bd0d6f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:42.878854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a9985142-6d1e-4642-afe2-86c825bd0d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:42.893548 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5929ccb9-bc33-4afb-ac74-791215eb0dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba7be10e29e4ab3a6a9ce7de35fd96f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:42.903814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1017/1996] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:42 2022] DELETE /identity/v3/users/1ba7be10e29e4ab3a6a9ce7de35fd96f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:43.004276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9985142-6d1e-4642-afe2-86c825bd0d6f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:43.131037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c83244-0ddb-4dcb-80cb-32b7d1216b65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:43.131703 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c83244-0ddb-4dcb-80cb-32b7d1216b65 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:43.131991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c83244-0ddb-4dcb-80cb-32b7d1216b65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:43.132273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c83244-0ddb-4dcb-80cb-32b7d1216b65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:43.134257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-17c83244-0ddb-4dcb-80cb-32b7d1216b65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:43.149694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:43.213189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c83244-0ddb-4dcb-80cb-32b7d1216b65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:43.214793 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c83244-0ddb-4dcb-80cb-32b7d1216b65 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:43.245090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 980/1997] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:42 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:43.348642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929ccb9-bc33-4afb-ac74-791215eb0dbb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:43.350349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5929ccb9-bc33-4afb-ac74-791215eb0dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:43.366228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929ccb9-bc33-4afb-ac74-791215eb0dbb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:43.374055 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441bf19-4d6a-4857-ad5e-543c95acf587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:43.375358 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441bf19-4d6a-4857-ad5e-543c95acf587 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:43.375719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441bf19-4d6a-4857-ad5e-543c95acf587 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:43.376037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441bf19-4d6a-4857-ad5e-543c95acf587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:43.379457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5441bf19-4d6a-4857-ad5e-543c95acf587 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:43.399722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c83244-0ddb-4dcb-80cb-32b7d1216b65 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:43.402085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-17c83244-0ddb-4dcb-80cb-32b7d1216b65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:43.459432 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441bf19-4d6a-4857-ad5e-543c95acf587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:43.461116 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441bf19-4d6a-4857-ad5e-543c95acf587 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:43.472809 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1018/1998] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:43.473859 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441bf19-4d6a-4857-ad5e-543c95acf587 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:43.475087 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5441bf19-4d6a-4857-ad5e-543c95acf587 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:43.480978 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:43.511323 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c83244-0ddb-4dcb-80cb-32b7d1216b65 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:43.516598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d1b28-80f0-4339-9ba5-2399565c1210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:43.517517 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d1b28-80f0-4339-9ba5-2399565c1210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:43.517859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d1b28-80f0-4339-9ba5-2399565c1210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:43.518066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d1b28-80f0-4339-9ba5-2399565c1210 admin admin] PATH_INFO: `/v3/users/68baea7f581b41bfafc7380529e26bac` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:43.519274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d1b28-80f0-4339-9ba5-2399565c1210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68baea7f581b41bfafc7380529e26bac)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:43.521779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d1b28-80f0-4339-9ba5-2399565c1210 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:43.571626 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441bf19-4d6a-4857-ad5e-543c95acf587 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:43.578157 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36fecd-d4df-4875-a0cd-5bb339674bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:43.579035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36fecd-d4df-4875-a0cd-5bb339674bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:43.579323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36fecd-d4df-4875-a0cd-5bb339674bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:43.579606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36fecd-d4df-4875-a0cd-5bb339674bcd admin admin] PATH_INFO: `/v3/projects/368fced11df2459c855486f4f40e858b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:43.582040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ad7d1b28-80f0-4339-9ba5-2399565c1210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68baea7f581b41bfafc7380529e26bac'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:43.585909 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36fecd-d4df-4875-a0cd-5bb339674bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=368fced11df2459c855486f4f40e858b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:43.588024 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36fecd-d4df-4875-a0cd-5bb339674bcd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:43.590410 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ad7d1b28-80f0-4339-9ba5-2399565c1210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68baea7f581b41bfafc7380529e26bac'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:43.591507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ad7d1b28-80f0-4339-9ba5-2399565c1210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68baea7f581b41bfafc7380529e26bac'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:43.609007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ad7d1b28-80f0-4339-9ba5-2399565c1210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68baea7f581b41bfafc7380529e26bac'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:43.620561 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ad7d1b28-80f0-4339-9ba5-2399565c1210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68baea7f581b41bfafc7380529e26bac'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:43.632879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 981/1999] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:43 2022] DELETE /identity/v3/users/68baea7f581b41bfafc7380529e26bac => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:43.637613 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ca0a6-e757-4d6d-ba0e-9daaa8250cb9 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:43.637906 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ca0a6-e757-4d6d-ba0e-9daaa8250cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:43.638189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ca0a6-e757-4d6d-ba0e-9daaa8250cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:43.650071 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ff36fecd-d4df-4875-a0cd-5bb339674bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368fced11df2459c855486f4f40e858b', 'request_id': 'req-ff36fecd-d4df-4875-a0cd-5bb339674bcd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:43.657114 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ff36fecd-d4df-4875-a0cd-5bb339674bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368fced11df2459c855486f4f40e858b', 'request_id': 'req-ff36fecd-d4df-4875-a0cd-5bb339674bcd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:43.663805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-4e4ca0a6-e757-4d6d-ba0e-9daaa8250cb9 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:43.665401 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4e4ca0a6-e757-4d6d-ba0e-9daaa8250cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:43.666422 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ff36fecd-d4df-4875-a0cd-5bb339674bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368fced11df2459c855486f4f40e858b', 'request_id': 'req-ff36fecd-d4df-4875-a0cd-5bb339674bcd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:43.693731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ff36fecd-d4df-4875-a0cd-5bb339674bcd admin admin] The token cache is being invalidate because project 368fced11df2459c855486f4f40e858b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:43.694125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ff36fecd-d4df-4875-a0cd-5bb339674bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:43.694530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:43.696868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ff36fecd-d4df-4875-a0cd-5bb339674bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:43.699932 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1019/2000] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:43 2022] DELETE /identity/v3/projects/368fced11df2459c855486f4f40e858b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:43.705815 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8e994-f0b1-401f-bbf6-f112e872f5fc None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:43.706113 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8e994-f0b1-401f-bbf6-f112e872f5fc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:43.706380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8e994-f0b1-401f-bbf6-f112e872f5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:43.734902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-46b8e994-f0b1-401f-bbf6-f112e872f5fc None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:43.736544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-46b8e994-f0b1-401f-bbf6-f112e872f5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:43.750886 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 982/2001] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:43.761525 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ca0a6-e757-4d6d-ba0e-9daaa8250cb9 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:43.763106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4e4ca0a6-e757-4d6d-ba0e-9daaa8250cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:43.857298 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1020/2002] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:43.867347 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11296173-f126-42dc-91c8-d5a2d880f632 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:43.867631 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11296173-f126-42dc-91c8-d5a2d880f632 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:43.867912 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11296173-f126-42dc-91c8-d5a2d880f632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:43.892454 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ca0a6-e757-4d6d-ba0e-9daaa8250cb9 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:43.893666 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-11296173-f126-42dc-91c8-d5a2d880f632 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:43.895583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-11296173-f126-42dc-91c8-d5a2d880f632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:43.896690 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39be11-db1a-4c5d-8e85-26695f507719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:43.897831 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39be11-db1a-4c5d-8e85-26695f507719 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:43.898119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39be11-db1a-4c5d-8e85-26695f507719 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:43.898417 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39be11-db1a-4c5d-8e85-26695f507719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:43.912672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1021/2003] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:43.913033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39be11-db1a-4c5d-8e85-26695f507719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:43.914672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39be11-db1a-4c5d-8e85-26695f507719 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:43.917346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11296173-f126-42dc-91c8-d5a2d880f632 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:43.933147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 983/2004] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:43.934434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11296173-f126-42dc-91c8-d5a2d880f632 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:43.942948 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3729d04-683d-4d32-87b9-cd4671db7023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:43.946258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3729d04-683d-4d32-87b9-cd4671db7023 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:43.946258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3729d04-683d-4d32-87b9-cd4671db7023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:43.946258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3729d04-683d-4d32-87b9-cd4671db7023 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:43.946258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3729d04-683d-4d32-87b9-cd4671db7023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:43.946258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3729d04-683d-4d32-87b9-cd4671db7023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:43.955536 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3729d04-683d-4d32-87b9-cd4671db7023 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:43.972545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1022/2005] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:43.977585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39be11-db1a-4c5d-8e85-26695f507719 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:43.992140 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39be11-db1a-4c5d-8e85-26695f507719 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:44.000256 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fab551-7722-4dc0-809e-de7792963d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:44.001674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fab551-7722-4dc0-809e-de7792963d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:44.002861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fab551-7722-4dc0-809e-de7792963d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:44.003387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fab551-7722-4dc0-809e-de7792963d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:44.004551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fab551-7722-4dc0-809e-de7792963d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:44.006803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fab551-7722-4dc0-809e-de7792963d22 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:44.046314 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 984/2006] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:43 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:44.050149 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3729d04-683d-4d32-87b9-cd4671db7023 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:44.069505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3729d04-683d-4d32-87b9-cd4671db7023 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:44.088294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:44.214957 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94553e7-4816-4d6d-a095-253fbd2e420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:44.215604 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94553e7-4816-4d6d-a095-253fbd2e420d admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:44.215935 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94553e7-4816-4d6d-a095-253fbd2e420d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:44.216295 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94553e7-4816-4d6d-a095-253fbd2e420d admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:44.217313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94553e7-4816-4d6d-a095-253fbd2e420d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:44.219673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94553e7-4816-4d6d-a095-253fbd2e420d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:44.251378 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1023/2007] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:44 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:44.255851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fab551-7722-4dc0-809e-de7792963d22 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:44.269569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fab551-7722-4dc0-809e-de7792963d22 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:44.277155 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc801b8f-7517-4d34-a88f-3280a7d46ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:44.277837 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc801b8f-7517-4d34-a88f-3280a7d46ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:44.278499 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc801b8f-7517-4d34-a88f-3280a7d46ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:44.278499 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc801b8f-7517-4d34-a88f-3280a7d46ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:44.279236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc801b8f-7517-4d34-a88f-3280a7d46ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:44.281417 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc801b8f-7517-4d34-a88f-3280a7d46ec0 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:44.305187 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 985/2008] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:44.309263 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94553e7-4816-4d6d-a095-253fbd2e420d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:44.339384 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94553e7-4816-4d6d-a095-253fbd2e420d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:44.346774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c17c50-f108-4cd2-af09-1ef1ac112f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:44.349913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c17c50-f108-4cd2-af09-1ef1ac112f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:44.349913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c17c50-f108-4cd2-af09-1ef1ac112f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:44.349913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c17c50-f108-4cd2-af09-1ef1ac112f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:44.349913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c17c50-f108-4cd2-af09-1ef1ac112f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:44.351146 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc801b8f-7517-4d34-a88f-3280a7d46ec0 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:44.352416 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c17c50-f108-4cd2-af09-1ef1ac112f6e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:44.352894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-cc801b8f-7517-4d34-a88f-3280a7d46ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:44.376679 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1024/2009] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:44.377845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c17c50-f108-4cd2-af09-1ef1ac112f6e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:44.387865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc801b8f-7517-4d34-a88f-3280a7d46ec0 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:44.395006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:44.396058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:44.396459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:44.396740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3 admin admin] PATH_INFO: `/v3/projects/672e6d3f6bdb4e2f841e083186ab2506` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:44.398131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=672e6d3f6bdb4e2f841e083186ab2506)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:44.400040 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:44.402046 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c17c50-f108-4cd2-af09-1ef1ac112f6e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:44.408753 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da165c-6237-4edd-8c7c-ac9cf7e80014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:44.409844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da165c-6237-4edd-8c7c-ac9cf7e80014 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:44.410147 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da165c-6237-4edd-8c7c-ac9cf7e80014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:44.410429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da165c-6237-4edd-8c7c-ac9cf7e80014 admin admin] PATH_INFO: `/v3/projects/ab0081d468394fa0ae3b79771c6e17f4/users/df730406013e48ae859502b7546809e2/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:44.428721 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da165c-6237-4edd-8c7c-ac9cf7e80014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0081d468394fa0ae3b79771c6e17f4, user_id=df730406013e48ae859502b7546809e2, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:44.431410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da165c-6237-4edd-8c7c-ac9cf7e80014 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:44.446639 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1025/2010] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:44 2022] PUT /identity/v3/projects/ab0081d468394fa0ae3b79771c6e17f4/users/df730406013e48ae859502b7546809e2/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:44.457947 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003b779-5689-4137-90b0-46b7b96d8b70 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:44.458761 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003b779-5689-4137-90b0-46b7b96d8b70 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:44.459222 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003b779-5689-4137-90b0-46b7b96d8b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:44.463082 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672e6d3f6bdb4e2f841e083186ab2506', 'request_id': 'req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:44.472967 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672e6d3f6bdb4e2f841e083186ab2506', 'request_id': 'req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:44.479677 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672e6d3f6bdb4e2f841e083186ab2506', 'request_id': 'req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:44.490505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0003b779-5689-4137-90b0-46b7b96d8b70 None None] MFA Rules not processed for user `df730406013e48ae859502b7546809e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:44.491709 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0003b779-5689-4137-90b0-46b7b96d8b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:44.492546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3 admin admin] The token cache is being invalidate because project 672e6d3f6bdb4e2f841e083186ab2506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:44.492838 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:44.494655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:44.496740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 986/2011] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:44 2022] DELETE /identity/v3/projects/672e6d3f6bdb4e2f841e083186ab2506 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:44.502082 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:44.503154 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:44.528063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:44.565492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1026/2012] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:44.570247 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003b779-5689-4137-90b0-46b7b96d8b70 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:44.571525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0003b779-5689-4137-90b0-46b7b96d8b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:44.572840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96a7aa-c230-4f9a-a919-8733da6a7ab3 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:44.578246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ffd54-8d0b-43ba-a56a-21eae1806d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:44.579181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ffd54-8d0b-43ba-a56a-21eae1806d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:44.579464 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ffd54-8d0b-43ba-a56a-21eae1806d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:44.579744 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ffd54-8d0b-43ba-a56a-21eae1806d1a admin admin] PATH_INFO: `/v3/users/6fb6ad64c7d64f3aad1963529ee37020` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:44.581052 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ffd54-8d0b-43ba-a56a-21eae1806d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb6ad64c7d64f3aad1963529ee37020)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:44.583186 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ffd54-8d0b-43ba-a56a-21eae1806d1a admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:44.588601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003b779-5689-4137-90b0-46b7b96d8b70 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:44.593525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f383c49-adc2-4080-90a3-fdf787cabe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:44.594190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f383c49-adc2-4080-90a3-fdf787cabe28 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:44.594489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f383c49-adc2-4080-90a3-fdf787cabe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:44.594745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f383c49-adc2-4080-90a3-fdf787cabe28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:44.595462 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f383c49-adc2-4080-90a3-fdf787cabe28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:44.597413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f383c49-adc2-4080-90a3-fdf787cabe28 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:44.630864 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1027/2013] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:44 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:30:44.634873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f383c49-adc2-4080-90a3-fdf787cabe28 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:44.651352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a86ffd54-8d0b-43ba-a56a-21eae1806d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb6ad64c7d64f3aad1963529ee37020'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:44.661147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a86ffd54-8d0b-43ba-a56a-21eae1806d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb6ad64c7d64f3aad1963529ee37020'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:44.661969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a86ffd54-8d0b-43ba-a56a-21eae1806d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb6ad64c7d64f3aad1963529ee37020'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:44.675174 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a86ffd54-8d0b-43ba-a56a-21eae1806d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb6ad64c7d64f3aad1963529ee37020'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:44.681507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:44.683165 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a86ffd54-8d0b-43ba-a56a-21eae1806d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb6ad64c7d64f3aad1963529ee37020'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:44.690142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 987/2014] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:44 2022] DELETE /identity/v3/users/6fb6ad64c7d64f3aad1963529ee37020 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:44.708836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f383c49-adc2-4080-90a3-fdf787cabe28 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:44.778396 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97806408-0e6a-4bae-9bea-a18def9f26ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:44.779178 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97806408-0e6a-4bae-9bea-a18def9f26ae admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:44.779464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97806408-0e6a-4bae-9bea-a18def9f26ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:44.780369 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97806408-0e6a-4bae-9bea-a18def9f26ae admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:44.781354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97806408-0e6a-4bae-9bea-a18def9f26ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:44.783258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97806408-0e6a-4bae-9bea-a18def9f26ae admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:44.806799 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1028/2015] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:44 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:30:44.808177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ffd54-8d0b-43ba-a56a-21eae1806d1a admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:44.809789 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a86ffd54-8d0b-43ba-a56a-21eae1806d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:44.822535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ffd54-8d0b-43ba-a56a-21eae1806d1a admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:44.827878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e62c7-76ff-4463-86da-330d84ac664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:44.828542 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e62c7-76ff-4463-86da-330d84ac664b admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:44.828828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e62c7-76ff-4463-86da-330d84ac664b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:44.829134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e62c7-76ff-4463-86da-330d84ac664b admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:44.829867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e62c7-76ff-4463-86da-330d84ac664b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:44.831453 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e62c7-76ff-4463-86da-330d84ac664b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:44.841827 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 988/2016] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:30:44.846176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97806408-0e6a-4bae-9bea-a18def9f26ae admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:44.856569 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97806408-0e6a-4bae-9bea-a18def9f26ae admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:44.861906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f5bdd-ae47-4f77-b62a-690b15d56d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:44.862803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f5bdd-ae47-4f77-b62a-690b15d56d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:44.863096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f5bdd-ae47-4f77-b62a-690b15d56d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:44.863379 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f5bdd-ae47-4f77-b62a-690b15d56d32 admin admin] PATH_INFO: `/v3/projects/75c13365e8e04cf4ba25a326aeaec0df/users/b47f224fc14243b0a0b69dc21d3dcb8b/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:44.881301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f5bdd-ae47-4f77-b62a-690b15d56d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c13365e8e04cf4ba25a326aeaec0df, user_id=b47f224fc14243b0a0b69dc21d3dcb8b, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:44.884062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f5bdd-ae47-4f77-b62a-690b15d56d32 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:44.899880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1029/2017] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:44 2022] PUT /identity/v3/projects/75c13365e8e04cf4ba25a326aeaec0df/users/b47f224fc14243b0a0b69dc21d3dcb8b/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:44.903563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e62c7-76ff-4463-86da-330d84ac664b admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:44.917702 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e62c7-76ff-4463-86da-330d84ac664b admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:45.002911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f5bdd-ae47-4f77-b62a-690b15d56d32 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:45.005494 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-978f5bdd-ae47-4f77-b62a-690b15d56d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:45.016420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0299d-979f-406a-a127-3f0f24184d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:45.017290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0299d-979f-406a-a127-3f0f24184d8d admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:45.017595 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0299d-979f-406a-a127-3f0f24184d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:45.017851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0299d-979f-406a-a127-3f0f24184d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:45.018716 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0299d-979f-406a-a127-3f0f24184d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:45.020584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0299d-979f-406a-a127-3f0f24184d8d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:45.043116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 989/2018] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:30:45.047865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0299d-979f-406a-a127-3f0f24184d8d admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:45.063088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0299d-979f-406a-a127-3f0f24184d8d admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:45.074104 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f2abc-f2aa-48ab-a75a-77fb566a75bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:45.075403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f2abc-f2aa-48ab-a75a-77fb566a75bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:45.075803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f2abc-f2aa-48ab-a75a-77fb566a75bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:45.076237 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f2abc-f2aa-48ab-a75a-77fb566a75bd admin admin] PATH_INFO: `/v3/projects/75c13365e8e04cf4ba25a326aeaec0df/users/b47f224fc14243b0a0b69dc21d3dcb8b/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:45.078551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f2abc-f2aa-48ab-a75a-77fb566a75bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c13365e8e04cf4ba25a326aeaec0df, user_id=b47f224fc14243b0a0b69dc21d3dcb8b, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:45.085190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f2abc-f2aa-48ab-a75a-77fb566a75bd admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:45.105000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 990/2019] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:45 2022] PUT /identity/v3/projects/75c13365e8e04cf4ba25a326aeaec0df/users/b47f224fc14243b0a0b69dc21d3dcb8b/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:45.114625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079737b4-f6f2-47b8-ac08-3c20c152bfcf None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:45.115112 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079737b4-f6f2-47b8-ac08-3c20c152bfcf None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:45.115675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079737b4-f6f2-47b8-ac08-3c20c152bfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:45.130514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f5bdd-ae47-4f77-b62a-690b15d56d32 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:45.143065 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:45.157101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-079737b4-f6f2-47b8-ac08-3c20c152bfcf None None] MFA Rules not processed for user `b47f224fc14243b0a0b69dc21d3dcb8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:45.159064 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-079737b4-f6f2-47b8-ac08-3c20c152bfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:45.186154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:45.198120 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:45.199175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:45.199494 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:45.199892 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394 admin admin] PATH_INFO: `/v3/projects/387621e381dd4a9a88e38b6fcdbf1c00` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:45.201236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=387621e381dd4a9a88e38b6fcdbf1c00)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:45.203317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:45.241011 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 991/2020] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:45.252482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079737b4-f6f2-47b8-ac08-3c20c152bfcf None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:45.254672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-079737b4-f6f2-47b8-ac08-3c20c152bfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:45.257150 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '387621e381dd4a9a88e38b6fcdbf1c00', 'request_id': 'req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:45.265653 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '387621e381dd4a9a88e38b6fcdbf1c00', 'request_id': 'req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:45.274278 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '387621e381dd4a9a88e38b6fcdbf1c00', 'request_id': 'req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:45.300359 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394 admin admin] The token cache is being invalidate because project 387621e381dd4a9a88e38b6fcdbf1c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:45.300666 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:45.301787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:45.305037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1030/2021] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:45 2022] DELETE /identity/v3/projects/387621e381dd4a9a88e38b6fcdbf1c00 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:45.307921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:45.309475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:45.334896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079737b4-f6f2-47b8-ac08-3c20c152bfcf None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:45.390784 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00773b99-d4f8-4336-8ba9-cd2bbc1a5394 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:45.395312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f45997-7292-4211-8aea-e874c6f7fee1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:45.395817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9339d10-397a-4a91-8c33-2f719348cb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:45.395967 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f45997-7292-4211-8aea-e874c6f7fee1 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:45.396258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f45997-7292-4211-8aea-e874c6f7fee1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:45.396551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f45997-7292-4211-8aea-e874c6f7fee1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:45.396839 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9339d10-397a-4a91-8c33-2f719348cb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:45.397149 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9339d10-397a-4a91-8c33-2f719348cb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:45.397428 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9339d10-397a-4a91-8c33-2f719348cb0a admin admin] PATH_INFO: `/v3/users/0855cd01c30c49cdaa0932b936f15272` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:45.398587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-79f45997-7292-4211-8aea-e874c6f7fee1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:45.398694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9339d10-397a-4a91-8c33-2f719348cb0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0855cd01c30c49cdaa0932b936f15272)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:45.400570 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9339d10-397a-4a91-8c33-2f719348cb0a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:45.475211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f9339d10-397a-4a91-8c33-2f719348cb0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0855cd01c30c49cdaa0932b936f15272'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:45.486477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f45997-7292-4211-8aea-e874c6f7fee1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:45.488019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f45997-7292-4211-8aea-e874c6f7fee1 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:45.509250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 992/2022] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:30:45.522554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f9339d10-397a-4a91-8c33-2f719348cb0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0855cd01c30c49cdaa0932b936f15272'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:45.541848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f9339d10-397a-4a91-8c33-2f719348cb0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0855cd01c30c49cdaa0932b936f15272'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:45.544045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f9339d10-397a-4a91-8c33-2f719348cb0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0855cd01c30c49cdaa0932b936f15272'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:45.572002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f9339d10-397a-4a91-8c33-2f719348cb0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0855cd01c30c49cdaa0932b936f15272'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:45.580982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1031/2023] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:45 2022] DELETE /identity/v3/users/0855cd01c30c49cdaa0932b936f15272 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:46.108227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f45997-7292-4211-8aea-e874c6f7fee1 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:46.119767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f45997-7292-4211-8aea-e874c6f7fee1 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:46.123756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:46.177974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c8fbc-3b88-4149-ad05-bbc0fc628748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:46.178840 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c8fbc-3b88-4149-ad05-bbc0fc628748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:46.179126 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c8fbc-3b88-4149-ad05-bbc0fc628748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:46.179395 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c8fbc-3b88-4149-ad05-bbc0fc628748 admin admin] PATH_INFO: `/v3/projects/106f56e3368648fa8c7bf0de3f2d4af8` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:46.180556 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c8fbc-3b88-4149-ad05-bbc0fc628748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=106f56e3368648fa8c7bf0de3f2d4af8)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:46.182476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c8fbc-3b88-4149-ad05-bbc0fc628748 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:46.226667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-987c8fbc-3b88-4149-ad05-bbc0fc628748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106f56e3368648fa8c7bf0de3f2d4af8', 'request_id': 'req-987c8fbc-3b88-4149-ad05-bbc0fc628748'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:46.233377 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-987c8fbc-3b88-4149-ad05-bbc0fc628748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106f56e3368648fa8c7bf0de3f2d4af8', 'request_id': 'req-987c8fbc-3b88-4149-ad05-bbc0fc628748'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:46.238827 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-987c8fbc-3b88-4149-ad05-bbc0fc628748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106f56e3368648fa8c7bf0de3f2d4af8', 'request_id': 'req-987c8fbc-3b88-4149-ad05-bbc0fc628748'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:46.249625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-987c8fbc-3b88-4149-ad05-bbc0fc628748 admin admin] The token cache is being invalidate because project 106f56e3368648fa8c7bf0de3f2d4af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:46.249909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-987c8fbc-3b88-4149-ad05-bbc0fc628748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:46.250531 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-987c8fbc-3b88-4149-ad05-bbc0fc628748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:46.252063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 993/2024] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:46 2022] DELETE /identity/v3/projects/106f56e3368648fa8c7bf0de3f2d4af8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:46.258368 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154acb3-e597-49b7-9187-029ae83236df None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:46.258669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154acb3-e597-49b7-9187-029ae83236df None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:46.258982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154acb3-e597-49b7-9187-029ae83236df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:46.267303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:46.279436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9154acb3-e597-49b7-9187-029ae83236df None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:46.281835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9154acb3-e597-49b7-9187-029ae83236df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:46.339346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1032/2025] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:46.348105 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d7fd7-1f64-492b-9d1c-ac1859e39263 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:46.348324 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d7fd7-1f64-492b-9d1c-ac1859e39263 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:46.348620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d7fd7-1f64-492b-9d1c-ac1859e39263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:46.366832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-a08d7fd7-1f64-492b-9d1c-ac1859e39263 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:46.368030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a08d7fd7-1f64-492b-9d1c-ac1859e39263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:46.376799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 994/2026] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:46.381177 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154acb3-e597-49b7-9187-029ae83236df None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:46.397494 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154acb3-e597-49b7-9187-029ae83236df None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:46.402145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da40a9-c1ff-43e6-b8bd-36e808f4c097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:46.402807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da40a9-c1ff-43e6-b8bd-36e808f4c097 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:46.403090 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da40a9-c1ff-43e6-b8bd-36e808f4c097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:46.403365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da40a9-c1ff-43e6-b8bd-36e808f4c097 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:46.404092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da40a9-c1ff-43e6-b8bd-36e808f4c097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:46.404426 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da40a9-c1ff-43e6-b8bd-36e808f4c097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:46.406342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da40a9-c1ff-43e6-b8bd-36e808f4c097 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:46.418112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1033/2027] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:46.423069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d7fd7-1f64-492b-9d1c-ac1859e39263 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:46.447362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d7fd7-1f64-492b-9d1c-ac1859e39263 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:46.459236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d094f9-7553-42be-9b5a-7c94d652bad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:46.460030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d094f9-7553-42be-9b5a-7c94d652bad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:46.460313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d094f9-7553-42be-9b5a-7c94d652bad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:46.460972 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d094f9-7553-42be-9b5a-7c94d652bad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:46.462017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d094f9-7553-42be-9b5a-7c94d652bad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:46.464643 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d094f9-7553-42be-9b5a-7c94d652bad1 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:46.505139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 995/2028] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:46 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:30:46.506254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da40a9-c1ff-43e6-b8bd-36e808f4c097 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:46.520607 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da40a9-c1ff-43e6-b8bd-36e808f4c097 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:46.598056 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d094f9-7553-42be-9b5a-7c94d652bad1 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:46.602805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-79d094f9-7553-42be-9b5a-7c94d652bad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:46.607660 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eddab-ae04-4eae-bcbf-d7719d4d6283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:46.608513 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eddab-ae04-4eae-bcbf-d7719d4d6283 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:46.609038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eddab-ae04-4eae-bcbf-d7719d4d6283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:46.609640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eddab-ae04-4eae-bcbf-d7719d4d6283 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:46.610977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581eddab-ae04-4eae-bcbf-d7719d4d6283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:46.613057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581eddab-ae04-4eae-bcbf-d7719d4d6283 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:46.624267 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d094f9-7553-42be-9b5a-7c94d652bad1 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:46.630963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238ad59-f84d-42fb-a798-9739d8d0529f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:46.632273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238ad59-f84d-42fb-a798-9739d8d0529f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:46.632578 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238ad59-f84d-42fb-a798-9739d8d0529f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:46.632858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238ad59-f84d-42fb-a798-9739d8d0529f admin admin] PATH_INFO: `/v3/users/0230a16f181d4b3b97bbecc1ebc4a266` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:46.634392 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238ad59-f84d-42fb-a798-9739d8d0529f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0230a16f181d4b3b97bbecc1ebc4a266)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:46.636508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238ad59-f84d-42fb-a798-9739d8d0529f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:46.646249 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1034/2029] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:46 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:46.650552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eddab-ae04-4eae-bcbf-d7719d4d6283 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:46.663115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eddab-ae04-4eae-bcbf-d7719d4d6283 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:46.668210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8754b-6aea-4c9d-854b-33267fd40a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:46.668891 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8754b-6aea-4c9d-854b-33267fd40a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:46.669213 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8754b-6aea-4c9d-854b-33267fd40a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:46.669490 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8754b-6aea-4c9d-854b-33267fd40a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:46.670223 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8754b-6aea-4c9d-854b-33267fd40a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:46.672519 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8754b-6aea-4c9d-854b-33267fd40a79 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:46.684992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1035/2030] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:46.688570 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8754b-6aea-4c9d-854b-33267fd40a79 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:46.696386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2238ad59-f84d-42fb-a798-9739d8d0529f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0230a16f181d4b3b97bbecc1ebc4a266'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:46.698317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8754b-6aea-4c9d-854b-33267fd40a79 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:46.703209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93715a00-0e5f-4e44-bdc2-1acc12004558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:46.703536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2238ad59-f84d-42fb-a798-9739d8d0529f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0230a16f181d4b3b97bbecc1ebc4a266'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:46.703849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93715a00-0e5f-4e44-bdc2-1acc12004558 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:46.704131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93715a00-0e5f-4e44-bdc2-1acc12004558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:46.704234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2238ad59-f84d-42fb-a798-9739d8d0529f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0230a16f181d4b3b97bbecc1ebc4a266'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:46.704406 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93715a00-0e5f-4e44-bdc2-1acc12004558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:46.705183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93715a00-0e5f-4e44-bdc2-1acc12004558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:46.706819 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93715a00-0e5f-4e44-bdc2-1acc12004558 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:46.709756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:46.718402 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1036/2031] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:30:46.722672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93715a00-0e5f-4e44-bdc2-1acc12004558 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:46.723435 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2238ad59-f84d-42fb-a798-9739d8d0529f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0230a16f181d4b3b97bbecc1ebc4a266'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:46.730991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2238ad59-f84d-42fb-a798-9739d8d0529f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0230a16f181d4b3b97bbecc1ebc4a266'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:46.732480 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93715a00-0e5f-4e44-bdc2-1acc12004558 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:46.737627 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428465c0-0692-4bbe-8bb3-53a803226f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:46.738588 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428465c0-0692-4bbe-8bb3-53a803226f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:46.738715 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 996/2032] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:46 2022] DELETE /identity/v3/users/0230a16f181d4b3b97bbecc1ebc4a266 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:46.738869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428465c0-0692-4bbe-8bb3-53a803226f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:46.739150 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428465c0-0692-4bbe-8bb3-53a803226f01 admin admin] PATH_INFO: `/v3/projects/7c19ff6748484183b85f10135db27197/users/09c0a7a61e4445a982cd2ba2bbe043e3/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:46.743204 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2cb23-e2da-452e-86b9-ba7ed3b4c250 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:46.743560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2cb23-e2da-452e-86b9-ba7ed3b4c250 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:46.743842 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2cb23-e2da-452e-86b9-ba7ed3b4c250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:46.754134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428465c0-0692-4bbe-8bb3-53a803226f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c19ff6748484183b85f10135db27197, user_id=09c0a7a61e4445a982cd2ba2bbe043e3, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:46.756858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428465c0-0692-4bbe-8bb3-53a803226f01 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:46.762163 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-52d2cb23-e2da-452e-86b9-ba7ed3b4c250 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:46.763718 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-52d2cb23-e2da-452e-86b9-ba7ed3b4c250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:46.771821 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1037/2033] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:46 2022] PUT /identity/v3/projects/7c19ff6748484183b85f10135db27197/users/09c0a7a61e4445a982cd2ba2bbe043e3/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:46.785498 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc088ca-95ea-42c4-acf6-e17fded127a3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:46.785793 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc088ca-95ea-42c4-acf6-e17fded127a3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:46.786128 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc088ca-95ea-42c4-acf6-e17fded127a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:46.818975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2cc088ca-95ea-42c4-acf6-e17fded127a3 None None] MFA Rules not processed for user `09c0a7a61e4445a982cd2ba2bbe043e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:46.820290 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2cc088ca-95ea-42c4-acf6-e17fded127a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:46.830072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 997/2034] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:46.840979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2cb23-e2da-452e-86b9-ba7ed3b4c250 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:46.841728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-52d2cb23-e2da-452e-86b9-ba7ed3b4c250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:46.848441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:46.904483 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2cb23-e2da-452e-86b9-ba7ed3b4c250 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:46.911274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a9ecf-1d71-478a-81d0-eb1d1dc5b100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:46.912057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a9ecf-1d71-478a-81d0-eb1d1dc5b100 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:46.912434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a9ecf-1d71-478a-81d0-eb1d1dc5b100 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:46.912817 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a9ecf-1d71-478a-81d0-eb1d1dc5b100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:46.917020 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1038/2035] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:46.930027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a9ecf-1d71-478a-81d0-eb1d1dc5b100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:46.932388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc088ca-95ea-42c4-acf6-e17fded127a3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:46.933150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a9ecf-1d71-478a-81d0-eb1d1dc5b100 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:46.934234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2cc088ca-95ea-42c4-acf6-e17fded127a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:46.954306 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 998/2036] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:30:47.035132 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc088ca-95ea-42c4-acf6-e17fded127a3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:47.039701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2414b4e-033b-40b0-9030-1bf04d7ac604 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefb0fe4d09b451a861510508bb9cf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:47.041200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2414b4e-033b-40b0-9030-1bf04d7ac604 service glance] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:47.042004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2414b4e-033b-40b0-9030-1bf04d7ac604 service glance] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:47.042431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2414b4e-033b-40b0-9030-1bf04d7ac604 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:47.053115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2414b4e-033b-40b0-9030-1bf04d7ac604 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:47.055332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2414b4e-033b-40b0-9030-1bf04d7ac604 service glance] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:47.066989 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1039/2037] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:30:47.911535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a9ecf-1d71-478a-81d0-eb1d1dc5b100 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:47.913950 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-650a9ecf-1d71-478a-81d0-eb1d1dc5b100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:47.931102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a9ecf-1d71-478a-81d0-eb1d1dc5b100 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:47.941533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b76442-9fce-455f-95f1-a0f2e2d49929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:47.942722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b76442-9fce-455f-95f1-a0f2e2d49929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:47.943225 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b76442-9fce-455f-95f1-a0f2e2d49929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:47.943609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b76442-9fce-455f-95f1-a0f2e2d49929 admin admin] PATH_INFO: `/v3/projects/7f8dcc3b82464b1384540b34486b13a9` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:47.946166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b76442-9fce-455f-95f1-a0f2e2d49929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f8dcc3b82464b1384540b34486b13a9)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:47.948656 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b76442-9fce-455f-95f1-a0f2e2d49929 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:48.035331 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78b76442-9fce-455f-95f1-a0f2e2d49929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f8dcc3b82464b1384540b34486b13a9', 'request_id': 'req-78b76442-9fce-455f-95f1-a0f2e2d49929'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:48.057434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78b76442-9fce-455f-95f1-a0f2e2d49929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f8dcc3b82464b1384540b34486b13a9', 'request_id': 'req-78b76442-9fce-455f-95f1-a0f2e2d49929'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:48.065477 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2414b4e-033b-40b0-9030-1bf04d7ac604 service glance] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:48.067271 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d2414b4e-033b-40b0-9030-1bf04d7ac604 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:48.080580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78b76442-9fce-455f-95f1-a0f2e2d49929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f8dcc3b82464b1384540b34486b13a9', 'request_id': 'req-78b76442-9fce-455f-95f1-a0f2e2d49929'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:48.087807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2414b4e-033b-40b0-9030-1bf04d7ac604 service glance] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:48.101529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78b76442-9fce-455f-95f1-a0f2e2d49929 admin admin] The token cache is being invalidate because project 7f8dcc3b82464b1384540b34486b13a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:48.101937 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78b76442-9fce-455f-95f1-a0f2e2d49929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:48.102683 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78b76442-9fce-455f-95f1-a0f2e2d49929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:48.104634 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 999/2038] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:47 2022] DELETE /identity/v3/projects/7f8dcc3b82464b1384540b34486b13a9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:48.108733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b76442-9fce-455f-95f1-a0f2e2d49929 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:48.110774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-78b76442-9fce-455f-95f1-a0f2e2d49929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:48.122224 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:48.164556 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437ff72-16ea-4521-b5d5-41e0133a8883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:48.165484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437ff72-16ea-4521-b5d5-41e0133a8883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:48.165766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437ff72-16ea-4521-b5d5-41e0133a8883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:48.166039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437ff72-16ea-4521-b5d5-41e0133a8883 admin admin] PATH_INFO: `/v3/users/520561e1d4464eb1a7f1bb7a708067a0` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:48.167701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437ff72-16ea-4521-b5d5-41e0133a8883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=520561e1d4464eb1a7f1bb7a708067a0)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:48.169544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437ff72-16ea-4521-b5d5-41e0133a8883 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:48.241179 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b76442-9fce-455f-95f1-a0f2e2d49929 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:48.252557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7739b-ba3f-4f91-9ebe-81c4d84e7f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:48.253853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7739b-ba3f-4f91-9ebe-81c4d84e7f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:48.254298 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7739b-ba3f-4f91-9ebe-81c4d84e7f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:48.254719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7739b-ba3f-4f91-9ebe-81c4d84e7f7e admin admin] PATH_INFO: `/v3/users/aa55714153fe4a35ad73693bbb012f8a` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:48.256118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7739b-ba3f-4f91-9ebe-81c4d84e7f7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa55714153fe4a35ad73693bbb012f8a)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:48.259075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7739b-ba3f-4f91-9ebe-81c4d84e7f7e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:48.293296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b437ff72-16ea-4521-b5d5-41e0133a8883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520561e1d4464eb1a7f1bb7a708067a0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:48.296634 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:48.327217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ace7739b-ba3f-4f91-9ebe-81c4d84e7f7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa55714153fe4a35ad73693bbb012f8a'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:48.331189 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b437ff72-16ea-4521-b5d5-41e0133a8883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520561e1d4464eb1a7f1bb7a708067a0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:48.354284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b437ff72-16ea-4521-b5d5-41e0133a8883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520561e1d4464eb1a7f1bb7a708067a0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:48.354284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b437ff72-16ea-4521-b5d5-41e0133a8883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520561e1d4464eb1a7f1bb7a708067a0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:48.354845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ace7739b-ba3f-4f91-9ebe-81c4d84e7f7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa55714153fe4a35ad73693bbb012f8a'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:48.359615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ace7739b-ba3f-4f91-9ebe-81c4d84e7f7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa55714153fe4a35ad73693bbb012f8a'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:48.361507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b437ff72-16ea-4521-b5d5-41e0133a8883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520561e1d4464eb1a7f1bb7a708067a0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:48.373909 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1040/2039] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:48 2022] DELETE /identity/v3/users/520561e1d4464eb1a7f1bb7a708067a0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:48.379107 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e4384-a0af-4bc0-aa2d-e9b246092706 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:48.379397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e4384-a0af-4bc0-aa2d-e9b246092706 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:48.379674 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e4384-a0af-4bc0-aa2d-e9b246092706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:48.396946 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ace7739b-ba3f-4f91-9ebe-81c4d84e7f7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa55714153fe4a35ad73693bbb012f8a'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:48.408036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9d6e4384-a0af-4bc0-aa2d-e9b246092706 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:48.409384 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9d6e4384-a0af-4bc0-aa2d-e9b246092706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:48.411436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ace7739b-ba3f-4f91-9ebe-81c4d84e7f7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa55714153fe4a35ad73693bbb012f8a'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:48.427623 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1000/2040] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:48 2022] DELETE /identity/v3/users/aa55714153fe4a35ad73693bbb012f8a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:48.538714 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1041/2041] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:48.553936 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7739b-ba3f-4f91-9ebe-81c4d84e7f7e admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:48.556025 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ace7739b-ba3f-4f91-9ebe-81c4d84e7f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:48.652563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7739b-ba3f-4f91-9ebe-81c4d84e7f7e admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:48.658569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03838320-ea7e-4daa-9863-83f7eb2d851b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:48.659709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838320-ea7e-4daa-9863-83f7eb2d851b service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:48.660076 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838320-ea7e-4daa-9863-83f7eb2d851b service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:48.660485 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838320-ea7e-4daa-9863-83f7eb2d851b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:48.792371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:48.843283 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03838320-ea7e-4daa-9863-83f7eb2d851b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:48.847739 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03838320-ea7e-4daa-9863-83f7eb2d851b service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:48.869764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1001/2042] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:30:49.161726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e4384-a0af-4bc0-aa2d-e9b246092706 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:49.164508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9d6e4384-a0af-4bc0-aa2d-e9b246092706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:49.191880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e4384-a0af-4bc0-aa2d-e9b246092706 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:49.198296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:49.203134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:49.203434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:49.203726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7 admin admin] PATH_INFO: `/v3/projects/99d65f8190104f098cdc95902fd089bd` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:49.209752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d65f8190104f098cdc95902fd089bd)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:49.211808 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:49.304117 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d65f8190104f098cdc95902fd089bd', 'request_id': 'req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:49.313954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d65f8190104f098cdc95902fd089bd', 'request_id': 'req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:49.322270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d65f8190104f098cdc95902fd089bd', 'request_id': 'req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:49.337938 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7 admin admin] The token cache is being invalidate because project 99d65f8190104f098cdc95902fd089bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:49.338350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:49.339275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:49.341109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1042/2043] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:49 2022] DELETE /identity/v3/projects/99d65f8190104f098cdc95902fd089bd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:49.347279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a7d15-ebc0-4240-88ff-9b47ffb1679f None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:49.347812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a7d15-ebc0-4240-88ff-9b47ffb1679f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:49.347910 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a7d15-ebc0-4240-88ff-9b47ffb1679f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:49.365153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:49.366744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:49.372302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-6f6a7d15-ebc0-4240-88ff-9b47ffb1679f None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:49.374244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6f6a7d15-ebc0-4240-88ff-9b47ffb1679f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:49.433642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:49.450898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9967e0-65f7-4871-a9cd-6f1b0e246dc7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:49.457627 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c2e82-6a77-405d-a157-a710b9597f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:49.458306 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1002/2044] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:49.466014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c2e82-6a77-405d-a157-a710b9597f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:49.466370 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c2e82-6a77-405d-a157-a710b9597f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:49.466655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c2e82-6a77-405d-a157-a710b9597f70 admin admin] PATH_INFO: `/v3/projects/5aa5698c28714b87aa685811ba626b12` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:49.468724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c2e82-6a77-405d-a157-a710b9597f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa5698c28714b87aa685811ba626b12)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:49.472587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af33f7-ce8a-498f-9bcb-1687d1cb5cee None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:49.472587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af33f7-ce8a-498f-9bcb-1687d1cb5cee None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:49.472587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af33f7-ce8a-498f-9bcb-1687d1cb5cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:49.474172 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c2e82-6a77-405d-a157-a710b9597f70 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:49.492787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-53af33f7-ce8a-498f-9bcb-1687d1cb5cee None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:49.494474 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-53af33f7-ce8a-498f-9bcb-1687d1cb5cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:49.507685 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1003/2045] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:49.509586 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af33f7-ce8a-498f-9bcb-1687d1cb5cee None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:49.520741 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af33f7-ce8a-498f-9bcb-1687d1cb5cee None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:49.536331 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-364c2e82-6a77-405d-a157-a710b9597f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa5698c28714b87aa685811ba626b12', 'request_id': 'req-364c2e82-6a77-405d-a157-a710b9597f70'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:49.545455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-364c2e82-6a77-405d-a157-a710b9597f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa5698c28714b87aa685811ba626b12', 'request_id': 'req-364c2e82-6a77-405d-a157-a710b9597f70'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:49.552044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-364c2e82-6a77-405d-a157-a710b9597f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa5698c28714b87aa685811ba626b12', 'request_id': 'req-364c2e82-6a77-405d-a157-a710b9597f70'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:49.570687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-364c2e82-6a77-405d-a157-a710b9597f70 admin admin] The token cache is being invalidate because project 5aa5698c28714b87aa685811ba626b12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:49.570687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-364c2e82-6a77-405d-a157-a710b9597f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:49.571388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-364c2e82-6a77-405d-a157-a710b9597f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:49.575913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1043/2046] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:49 2022] DELETE /identity/v3/projects/5aa5698c28714b87aa685811ba626b12 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:49.578439 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c2e82-6a77-405d-a157-a710b9597f70 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:49.579880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-364c2e82-6a77-405d-a157-a710b9597f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:49.621591 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec9a20-a717-44a3-a0b8-b3fbc70bd377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:49.622393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec9a20-a717-44a3-a0b8-b3fbc70bd377 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:49.622687 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec9a20-a717-44a3-a0b8-b3fbc70bd377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:49.622970 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec9a20-a717-44a3-a0b8-b3fbc70bd377 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:49.624624 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec9a20-a717-44a3-a0b8-b3fbc70bd377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:49.624961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec9a20-a717-44a3-a0b8-b3fbc70bd377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:49.628073 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec9a20-a717-44a3-a0b8-b3fbc70bd377 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:49.646947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1004/2047] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:49.658068 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec9a20-a717-44a3-a0b8-b3fbc70bd377 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:49.660096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-13ec9a20-a717-44a3-a0b8-b3fbc70bd377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:49.672865 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c2e82-6a77-405d-a157-a710b9597f70 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:49.673543 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec9a20-a717-44a3-a0b8-b3fbc70bd377 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:49.677760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d4944-b30c-4f15-939d-fdb4ad8d1416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:49.678628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d4944-b30c-4f15-939d-fdb4ad8d1416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:49.678849 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471436f8-29a3-4a72-bba8-607874293414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:49.678969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d4944-b30c-4f15-939d-fdb4ad8d1416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:49.679171 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d4944-b30c-4f15-939d-fdb4ad8d1416 admin admin] PATH_INFO: `/v3/users/ac7d25b47f4e4473b58ef0322bd8e02d` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:49.679513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471436f8-29a3-4a72-bba8-607874293414 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:49.679847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471436f8-29a3-4a72-bba8-607874293414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:49.680126 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471436f8-29a3-4a72-bba8-607874293414 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:49.680350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d4944-b30c-4f15-939d-fdb4ad8d1416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7d25b47f4e4473b58ef0322bd8e02d)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:49.681003 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471436f8-29a3-4a72-bba8-607874293414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:49.682321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d4944-b30c-4f15-939d-fdb4ad8d1416 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:49.682891 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471436f8-29a3-4a72-bba8-607874293414 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:49.722037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1005/2048] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:49 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:49.723015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471436f8-29a3-4a72-bba8-607874293414 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:49.737305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-771d4944-b30c-4f15-939d-fdb4ad8d1416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7d25b47f4e4473b58ef0322bd8e02d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:49.751246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-771d4944-b30c-4f15-939d-fdb4ad8d1416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7d25b47f4e4473b58ef0322bd8e02d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:49.759080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-771d4944-b30c-4f15-939d-fdb4ad8d1416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7d25b47f4e4473b58ef0322bd8e02d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:49.760243 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-771d4944-b30c-4f15-939d-fdb4ad8d1416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7d25b47f4e4473b58ef0322bd8e02d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:49.774848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-771d4944-b30c-4f15-939d-fdb4ad8d1416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7d25b47f4e4473b58ef0322bd8e02d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:49.778656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:49.784708 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1044/2049] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:49 2022] DELETE /identity/v3/users/ac7d25b47f4e4473b58ef0322bd8e02d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:49.787650 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:49.822069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471436f8-29a3-4a72-bba8-607874293414 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:49.896111 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f41334-bd4a-4a64-b611-3fef50bb5f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:49.896823 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f41334-bd4a-4a64-b611-3fef50bb5f87 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:49.897140 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f41334-bd4a-4a64-b611-3fef50bb5f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:49.897423 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f41334-bd4a-4a64-b611-3fef50bb5f87 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:49.898276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f41334-bd4a-4a64-b611-3fef50bb5f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:49.900496 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f41334-bd4a-4a64-b611-3fef50bb5f87 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:49.926204 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1006/2050] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:49 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:30:49.927424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d4944-b30c-4f15-939d-fdb4ad8d1416 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:49.929080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-771d4944-b30c-4f15-939d-fdb4ad8d1416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:49.945022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d4944-b30c-4f15-939d-fdb4ad8d1416 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:49.949953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660ae5d-3b28-40e5-9738-30a0965e381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:49.950816 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660ae5d-3b28-40e5-9738-30a0965e381d admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:49.951396 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660ae5d-3b28-40e5-9738-30a0965e381d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:49.951951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660ae5d-3b28-40e5-9738-30a0965e381d admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:49.953302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660ae5d-3b28-40e5-9738-30a0965e381d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:49.955171 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660ae5d-3b28-40e5-9738-30a0965e381d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:49.968566 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1045/2051] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:49.973029 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f41334-bd4a-4a64-b611-3fef50bb5f87 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:49.984557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f41334-bd4a-4a64-b611-3fef50bb5f87 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:49.989628 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6563e7f-7681-49ab-9b32-195bf9c76fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:49.990411 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6563e7f-7681-49ab-9b32-195bf9c76fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:49.990598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6563e7f-7681-49ab-9b32-195bf9c76fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:49.990878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6563e7f-7681-49ab-9b32-195bf9c76fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:49.991613 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6563e7f-7681-49ab-9b32-195bf9c76fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:49.993402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6563e7f-7681-49ab-9b32-195bf9c76fd3 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:50.006055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1007/2052] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:50.010296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660ae5d-3b28-40e5-9738-30a0965e381d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:50.021886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660ae5d-3b28-40e5-9738-30a0965e381d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:50.026680 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fcb60-d0ac-4d2b-ad61-d9a15a52a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:50.027781 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fcb60-d0ac-4d2b-ad61-d9a15a52a08c admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.028069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fcb60-d0ac-4d2b-ad61-d9a15a52a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.028350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fcb60-d0ac-4d2b-ad61-d9a15a52a08c admin admin] PATH_INFO: `/v3/projects/78094e13aee948a19be912b6edc6f0c8/users/a9da0f22ccdf4f47be19af3c4b10ecf4/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.045217 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fcb60-d0ac-4d2b-ad61-d9a15a52a08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=78094e13aee948a19be912b6edc6f0c8, user_id=a9da0f22ccdf4f47be19af3c4b10ecf4, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:50.047936 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fcb60-d0ac-4d2b-ad61-d9a15a52a08c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:50.067899 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1046/2053] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:50 2022] PUT /identity/v3/projects/78094e13aee948a19be912b6edc6f0c8/users/a9da0f22ccdf4f47be19af3c4b10ecf4/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:50.079094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8698b-f767-49f4-af89-80b8ede14c1f None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.079514 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8698b-f767-49f4-af89-80b8ede14c1f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.079942 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8698b-f767-49f4-af89-80b8ede14c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.110541 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-0ca8698b-f767-49f4-af89-80b8ede14c1f None None] MFA Rules not processed for user `a9da0f22ccdf4f47be19af3c4b10ecf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:50.111528 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fcb60-d0ac-4d2b-ad61-d9a15a52a08c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:50.111936 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0ca8698b-f767-49f4-af89-80b8ede14c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:50.113319 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-283fcb60-d0ac-4d2b-ad61-d9a15a52a08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:50.182958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1008/2054] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:50.187477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8698b-f767-49f4-af89-80b8ede14c1f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:50.191900 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fcb60-d0ac-4d2b-ad61-d9a15a52a08c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:50.197492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e732f-59e3-42e5-a12d-abf561ff48db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:50.197971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8698b-f767-49f4-af89-80b8ede14c1f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:50.198393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e732f-59e3-42e5-a12d-abf561ff48db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.198675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e732f-59e3-42e5-a12d-abf561ff48db admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.198943 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e732f-59e3-42e5-a12d-abf561ff48db admin admin] PATH_INFO: `/v3/projects/d220e6871bc644fabd342fd60c372d67` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.200105 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e732f-59e3-42e5-a12d-abf561ff48db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d220e6871bc644fabd342fd60c372d67)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:50.202605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e732f-59e3-42e5-a12d-abf561ff48db admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:50.203249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa077063-57e0-4384-918a-22551a47ce84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:50.204292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa077063-57e0-4384-918a-22551a47ce84 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.204600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa077063-57e0-4384-918a-22551a47ce84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.204876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa077063-57e0-4384-918a-22551a47ce84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.205594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa077063-57e0-4384-918a-22551a47ce84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:50.207477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa077063-57e0-4384-918a-22551a47ce84 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:50.248906 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1009/2055] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:50 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:30:50.248906 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa077063-57e0-4384-918a-22551a47ce84 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:50.253454 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-229e732f-59e3-42e5-a12d-abf561ff48db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd220e6871bc644fabd342fd60c372d67', 'request_id': 'req-229e732f-59e3-42e5-a12d-abf561ff48db'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:50.260741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-229e732f-59e3-42e5-a12d-abf561ff48db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd220e6871bc644fabd342fd60c372d67', 'request_id': 'req-229e732f-59e3-42e5-a12d-abf561ff48db'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:50.272655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-229e732f-59e3-42e5-a12d-abf561ff48db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd220e6871bc644fabd342fd60c372d67', 'request_id': 'req-229e732f-59e3-42e5-a12d-abf561ff48db'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:50.288685 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-229e732f-59e3-42e5-a12d-abf561ff48db admin admin] The token cache is being invalidate because project d220e6871bc644fabd342fd60c372d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:50.288901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-229e732f-59e3-42e5-a12d-abf561ff48db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:50.289603 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-229e732f-59e3-42e5-a12d-abf561ff48db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:50.296042 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1047/2056] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:50 2022] DELETE /identity/v3/projects/d220e6871bc644fabd342fd60c372d67 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:50.296214 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:50.298366 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6f0ac-59e3-4ea9-921f-110060e87f87 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.298661 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6f0ac-59e3-4ea9-921f-110060e87f87 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.298952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6f0ac-59e3-4ea9-921f-110060e87f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.321255 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c2a6f0ac-59e3-4ea9-921f-110060e87f87 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:50.321668 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa077063-57e0-4384-918a-22551a47ce84 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:50.322963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c2a6f0ac-59e3-4ea9-921f-110060e87f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:50.379756 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:50.382193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6d7cc-3eed-4312-a6b8-4df99157a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:50.382907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6d7cc-3eed-4312-a6b8-4df99157a61b admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.383219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6d7cc-3eed-4312-a6b8-4df99157a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.383520 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6d7cc-3eed-4312-a6b8-4df99157a61b admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.384165 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6d7cc-3eed-4312-a6b8-4df99157a61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:50.386144 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6d7cc-3eed-4312-a6b8-4df99157a61b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:50.394544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1048/2057] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:50.395179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6f0ac-59e3-4ea9-921f-110060e87f87 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:50.396640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c2a6f0ac-59e3-4ea9-921f-110060e87f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:50.412402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1010/2058] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:50 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:50.412402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a8639-22d3-4c0d-b0f5-b5fb97c8d42e None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.412402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a8639-22d3-4c0d-b0f5-b5fb97c8d42e None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.412402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a8639-22d3-4c0d-b0f5-b5fb97c8d42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.429988 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-8b7a8639-22d3-4c0d-b0f5-b5fb97c8d42e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:50.431179 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8b7a8639-22d3-4c0d-b0f5-b5fb97c8d42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:50.440221 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1011/2059] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:50.441354 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a8639-22d3-4c0d-b0f5-b5fb97c8d42e None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:50.442742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8b7a8639-22d3-4c0d-b0f5-b5fb97c8d42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:50.454917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a8639-22d3-4c0d-b0f5-b5fb97c8d42e None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:50.456278 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6f0ac-59e3-4ea9-921f-110060e87f87 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:50.459507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6375cae-921c-4bf2-a30c-ae71859d9abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:50.459998 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af178d46-b658-4019-804e-e44de57acbfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:50.460175 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6375cae-921c-4bf2-a30c-ae71859d9abe admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.460460 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6375cae-921c-4bf2-a30c-ae71859d9abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.460643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af178d46-b658-4019-804e-e44de57acbfd service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.460748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6375cae-921c-4bf2-a30c-ae71859d9abe admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.460949 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af178d46-b658-4019-804e-e44de57acbfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.461239 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af178d46-b658-4019-804e-e44de57acbfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.461484 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6375cae-921c-4bf2-a30c-ae71859d9abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:50.463058 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-af178d46-b658-4019-804e-e44de57acbfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:50.463172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6375cae-921c-4bf2-a30c-ae71859d9abe admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:50.473530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1012/2060] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:50.474326 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6375cae-921c-4bf2-a30c-ae71859d9abe admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:50.484104 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6375cae-921c-4bf2-a30c-ae71859d9abe admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:50.488711 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a926e0a-4ba0-40d9-8890-45b5ae97f98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:50.489370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a926e0a-4ba0-40d9-8890-45b5ae97f98a admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.489656 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a926e0a-4ba0-40d9-8890-45b5ae97f98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.489936 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a926e0a-4ba0-40d9-8890-45b5ae97f98a admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.490650 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a926e0a-4ba0-40d9-8890-45b5ae97f98a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:50.490958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a926e0a-4ba0-40d9-8890-45b5ae97f98a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:50.492517 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a926e0a-4ba0-40d9-8890-45b5ae97f98a admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:50.504748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1013/2061] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:50.505613 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a926e0a-4ba0-40d9-8890-45b5ae97f98a admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:50.515166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a926e0a-4ba0-40d9-8890-45b5ae97f98a admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:50.520004 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1e8e2-fdd1-4dc3-868e-ee53118c2d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:50.520893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1e8e2-fdd1-4dc3-868e-ee53118c2d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.521205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1e8e2-fdd1-4dc3-868e-ee53118c2d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.521487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1e8e2-fdd1-4dc3-868e-ee53118c2d64 admin admin] PATH_INFO: `/v3/projects/3085021f9ae4474daa17f79230fdb087/users/55859329f9f14a35808937e387c1b42c/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.534471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af178d46-b658-4019-804e-e44de57acbfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:50.536116 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af178d46-b658-4019-804e-e44de57acbfd service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:50.536634 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1e8e2-fdd1-4dc3-868e-ee53118c2d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3085021f9ae4474daa17f79230fdb087, user_id=55859329f9f14a35808937e387c1b42c, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:50.539309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1e8e2-fdd1-4dc3-868e-ee53118c2d64 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:50.548435 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1049/2062] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:50.549236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af178d46-b658-4019-804e-e44de57acbfd service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:50.556824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1014/2063] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:50 2022] PUT /identity/v3/projects/3085021f9ae4474daa17f79230fdb087/users/55859329f9f14a35808937e387c1b42c/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:50.560432 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af178d46-b658-4019-804e-e44de57acbfd service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:50.561727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1e8e2-fdd1-4dc3-868e-ee53118c2d64 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:50.634812 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b06b1f-3387-4d11-afd8-a98892c44a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:50.635591 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b06b1f-3387-4d11-afd8-a98892c44a49 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.635874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b06b1f-3387-4d11-afd8-a98892c44a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.636286 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b06b1f-3387-4d11-afd8-a98892c44a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.640704 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b06b1f-3387-4d11-afd8-a98892c44a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:50.642296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b06b1f-3387-4d11-afd8-a98892c44a49 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:50.651874 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1e8e2-fdd1-4dc3-868e-ee53118c2d64 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:50.659992 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeada9b-2fe4-44fb-b518-ffd79613e9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:50.660688 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeada9b-2fe4-44fb-b518-ffd79613e9ee admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.660998 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeada9b-2fe4-44fb-b518-ffd79613e9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.661283 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeada9b-2fe4-44fb-b518-ffd79613e9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.662015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeada9b-2fe4-44fb-b518-ffd79613e9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:50.664366 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeada9b-2fe4-44fb-b518-ffd79613e9ee admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:50.677782 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1015/2064] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:50.681700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeada9b-2fe4-44fb-b518-ffd79613e9ee admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:50.686538 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1050/2065] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:50 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:50.687445 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b06b1f-3387-4d11-afd8-a98892c44a49 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:50.705801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeada9b-2fe4-44fb-b518-ffd79613e9ee admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:50.721315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:50.739796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:50.784919 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b06b1f-3387-4d11-afd8-a98892c44a49 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:50.797243 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c564c8-30cc-41fb-91e1-02e561ed3551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:50.798099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c564c8-30cc-41fb-91e1-02e561ed3551 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.798381 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c564c8-30cc-41fb-91e1-02e561ed3551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.798652 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c564c8-30cc-41fb-91e1-02e561ed3551 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.799352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c564c8-30cc-41fb-91e1-02e561ed3551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:50.801593 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c564c8-30cc-41fb-91e1-02e561ed3551 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:50.817343 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a9b7e-5e68-49a2-86b5-bf2e1b796e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:50.820559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9b7e-5e68-49a2-86b5-bf2e1b796e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.820874 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9b7e-5e68-49a2-86b5-bf2e1b796e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.821179 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9b7e-5e68-49a2-86b5-bf2e1b796e73 admin admin] PATH_INFO: `/v3/projects/3085021f9ae4474daa17f79230fdb087/users/55859329f9f14a35808937e387c1b42c/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.823418 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a9b7e-5e68-49a2-86b5-bf2e1b796e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3085021f9ae4474daa17f79230fdb087, user_id=55859329f9f14a35808937e387c1b42c, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:50.826915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a9b7e-5e68-49a2-86b5-bf2e1b796e73 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:50.853009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1016/2066] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:50 2022] PUT /identity/v3/projects/3085021f9ae4474daa17f79230fdb087/users/55859329f9f14a35808937e387c1b42c/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:50.858156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1051/2067] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:50 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:50.862985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a9b7e-5e68-49a2-86b5-bf2e1b796e73 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:50.867062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bc59e-2ad3-4110-bea4-d5cca6452c41 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.867062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bc59e-2ad3-4110-bea4-d5cca6452c41 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.867062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bc59e-2ad3-4110-bea4-d5cca6452c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.922089 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-033bc59e-2ad3-4110-bea4-d5cca6452c41 None None] MFA Rules not processed for user `55859329f9f14a35808937e387c1b42c`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:50.924226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-033bc59e-2ad3-4110-bea4-d5cca6452c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:50.985312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a9b7e-5e68-49a2-86b5-bf2e1b796e73 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:50.993453 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3321a4-6418-4ed0-a73b-5c9ee0b99e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:50.994548 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3321a4-6418-4ed0-a73b-5c9ee0b99e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:50.994956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3321a4-6418-4ed0-a73b-5c9ee0b99e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:50.995871 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3321a4-6418-4ed0-a73b-5c9ee0b99e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:50.997031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3321a4-6418-4ed0-a73b-5c9ee0b99e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:51.000066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3321a4-6418-4ed0-a73b-5c9ee0b99e20 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:51.014619 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1017/2068] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:51.023540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3321a4-6418-4ed0-a73b-5c9ee0b99e20 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:51.038944 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3321a4-6418-4ed0-a73b-5c9ee0b99e20 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:51.047722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438db9a-901a-424d-b8df-06bdc4fda046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:51.049020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438db9a-901a-424d-b8df-06bdc4fda046 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:51.049424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438db9a-901a-424d-b8df-06bdc4fda046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:51.049813 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438db9a-901a-424d-b8df-06bdc4fda046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:51.052069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438db9a-901a-424d-b8df-06bdc4fda046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:51.054254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438db9a-901a-424d-b8df-06bdc4fda046 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:51.074504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1052/2069] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:51.084956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1018/2070] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:51.089557 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bc59e-2ad3-4110-bea4-d5cca6452c41 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:51.105925 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bc59e-2ad3-4110-bea4-d5cca6452c41 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:51.135130 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c92917-25a7-4846-8759-ef6131035e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:51.136048 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c92917-25a7-4846-8759-ef6131035e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:51.136327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c92917-25a7-4846-8759-ef6131035e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:51.137084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c92917-25a7-4846-8759-ef6131035e36 admin admin] PATH_INFO: `/v3/projects/e5e8fa8f710c4253a5006a04a5218228/users/fbb011ef0f634a519939cac01a1c063f/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:51.140102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438db9a-901a-424d-b8df-06bdc4fda046 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:51.141777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6438db9a-901a-424d-b8df-06bdc4fda046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:51.173839 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c92917-25a7-4846-8759-ef6131035e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e8fa8f710c4253a5006a04a5218228, user_id=fbb011ef0f634a519939cac01a1c063f, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:51.176631 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c92917-25a7-4846-8759-ef6131035e36 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:51.201329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1053/2071] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:51 2022] PUT /identity/v3/projects/e5e8fa8f710c4253a5006a04a5218228/users/fbb011ef0f634a519939cac01a1c063f/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:51.213216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094edf44-bfc7-45ca-9744-7f38c069885c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:51.213539 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094edf44-bfc7-45ca-9744-7f38c069885c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:51.213988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094edf44-bfc7-45ca-9744-7f38c069885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:51.244898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438db9a-901a-424d-b8df-06bdc4fda046 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:51.246826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-094edf44-bfc7-45ca-9744-7f38c069885c None None] MFA Rules not processed for user `fbb011ef0f634a519939cac01a1c063f`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:51.248081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-094edf44-bfc7-45ca-9744-7f38c069885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:51.303331 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:51.309566 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384af234-1f01-4137-a243-2f1a5d916496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:51.312286 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af234-1f01-4137-a243-2f1a5d916496 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:51.312699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af234-1f01-4137-a243-2f1a5d916496 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:51.313174 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af234-1f01-4137-a243-2f1a5d916496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:51.333296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1054/2072] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:51.344413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094edf44-bfc7-45ca-9744-7f38c069885c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:51.357578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:51.391447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384af234-1f01-4137-a243-2f1a5d916496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:51.392800 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384af234-1f01-4137-a243-2f1a5d916496 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:51.409148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1019/2073] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:51.421241 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094edf44-bfc7-45ca-9744-7f38c069885c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:51.427269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981b618-45f6-495f-88a8-8df16d011bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:51.428112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981b618-45f6-495f-88a8-8df16d011bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:51.428490 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981b618-45f6-495f-88a8-8df16d011bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:51.428892 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981b618-45f6-495f-88a8-8df16d011bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:51.429754 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981b618-45f6-495f-88a8-8df16d011bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:51.431911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981b618-45f6-495f-88a8-8df16d011bf3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:51.470629 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1055/2074] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:51 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:51.471734 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384af234-1f01-4137-a243-2f1a5d916496 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:51.483307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384af234-1f01-4137-a243-2f1a5d916496 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:51.517746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981b618-45f6-495f-88a8-8df16d011bf3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:51.556302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6e5f0-49b7-43f7-bb6c-374acad47e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:51.557131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6e5f0-49b7-43f7-bb6c-374acad47e02 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:51.559250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6e5f0-49b7-43f7-bb6c-374acad47e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:51.559250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6e5f0-49b7-43f7-bb6c-374acad47e02 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:51.559250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6e5f0-49b7-43f7-bb6c-374acad47e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:51.560527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6e5f0-49b7-43f7-bb6c-374acad47e02 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:51.584419 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981b618-45f6-495f-88a8-8df16d011bf3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:51.587652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1020/2075] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:51 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:51.588641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6e5f0-49b7-43f7-bb6c-374acad47e02 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:51.589836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a2bfc-3f26-4645-8ba7-e596c10e1e39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:51.590548 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a2bfc-3f26-4645-8ba7-e596c10e1e39 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:51.590832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a2bfc-3f26-4645-8ba7-e596c10e1e39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:51.591112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a2bfc-3f26-4645-8ba7-e596c10e1e39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:51.594135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-422a2bfc-3f26-4645-8ba7-e596c10e1e39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:51.598642 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6e5f0-49b7-43f7-bb6c-374acad47e02 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:51.603411 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1264981-27f4-4a0f-ad18-3e55f86d3af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:51.604102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1264981-27f4-4a0f-ad18-3e55f86d3af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:51.604375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1264981-27f4-4a0f-ad18-3e55f86d3af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:51.604662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1264981-27f4-4a0f-ad18-3e55f86d3af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:51.605465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1264981-27f4-4a0f-ad18-3e55f86d3af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:51.607073 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1264981-27f4-4a0f-ad18-3e55f86d3af3 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:51.618086 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1021/2076] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:51.621961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1264981-27f4-4a0f-ad18-3e55f86d3af3 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:51.632331 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1264981-27f4-4a0f-ad18-3e55f86d3af3 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:51.637203 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8ed81-9220-4ebd-a97d-5c6c53756950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:51.638320 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8ed81-9220-4ebd-a97d-5c6c53756950 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:51.638443 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8ed81-9220-4ebd-a97d-5c6c53756950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:51.638710 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8ed81-9220-4ebd-a97d-5c6c53756950 admin admin] PATH_INFO: `/v3/projects/dcb0b31ecf1348e0bf15a2b093e0e94e/users/ac3f01d899634a08beec02bba6141b18/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:51.661310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8ed81-9220-4ebd-a97d-5c6c53756950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb0b31ecf1348e0bf15a2b093e0e94e, user_id=ac3f01d899634a08beec02bba6141b18, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:51.664159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8ed81-9220-4ebd-a97d-5c6c53756950 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:51.666262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a2bfc-3f26-4645-8ba7-e596c10e1e39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:51.667723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a2bfc-3f26-4645-8ba7-e596c10e1e39 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:51.679301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1056/2077] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:51.679739 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1022/2078] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:51 2022] PUT /identity/v3/projects/dcb0b31ecf1348e0bf15a2b093e0e94e/users/ac3f01d899634a08beec02bba6141b18/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:51.683661 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a2bfc-3f26-4645-8ba7-e596c10e1e39 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:51.697439 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a2bfc-3f26-4645-8ba7-e596c10e1e39 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:51.757120 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:51.769270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d5e97-a5be-4433-987b-61f57e3f315d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:51.770162 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d5e97-a5be-4433-987b-61f57e3f315d admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:51.770605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d5e97-a5be-4433-987b-61f57e3f315d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:51.770886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d5e97-a5be-4433-987b-61f57e3f315d admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:51.772096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d5e97-a5be-4433-987b-61f57e3f315d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:51.773751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d5e97-a5be-4433-987b-61f57e3f315d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:51.786136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1057/2079] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:51.793187 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8ed81-9220-4ebd-a97d-5c6c53756950 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:51.802112 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8ed81-9220-4ebd-a97d-5c6c53756950 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:51.807302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f0d4e-6e03-4aa1-98a0-082230bdaa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:51.808288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f0d4e-6e03-4aa1-98a0-082230bdaa97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:51.808770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f0d4e-6e03-4aa1-98a0-082230bdaa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:51.809044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f0d4e-6e03-4aa1-98a0-082230bdaa97 admin admin] PATH_INFO: `/v3/projects/dcb0b31ecf1348e0bf15a2b093e0e94e/users/ac3f01d899634a08beec02bba6141b18/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:51.811694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f0d4e-6e03-4aa1-98a0-082230bdaa97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb0b31ecf1348e0bf15a2b093e0e94e, user_id=ac3f01d899634a08beec02bba6141b18, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:51.814552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f0d4e-6e03-4aa1-98a0-082230bdaa97 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:51.826013 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1023/2080] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:51 2022] PUT /identity/v3/projects/dcb0b31ecf1348e0bf15a2b093e0e94e/users/ac3f01d899634a08beec02bba6141b18/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:51.837755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326992be-151b-4f68-9980-30787f4f8c67 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:51.838049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326992be-151b-4f68-9980-30787f4f8c67 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:51.838468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326992be-151b-4f68-9980-30787f4f8c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:51.875222 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-326992be-151b-4f68-9980-30787f4f8c67 None None] MFA Rules not processed for user `ac3f01d899634a08beec02bba6141b18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:51.876459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-326992be-151b-4f68-9980-30787f4f8c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:51.969079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1058/2081] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:51.981701 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f0d4e-6e03-4aa1-98a0-082230bdaa97 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:52.050545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:52.073915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f0d4e-6e03-4aa1-98a0-082230bdaa97 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:52.082039 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738a323-dcf9-44ba-ae8c-fc9554540559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:52.082805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738a323-dcf9-44ba-ae8c-fc9554540559 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:52.083017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738a323-dcf9-44ba-ae8c-fc9554540559 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:52.083302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738a323-dcf9-44ba-ae8c-fc9554540559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:52.108260 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738a323-dcf9-44ba-ae8c-fc9554540559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:52.110019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738a323-dcf9-44ba-ae8c-fc9554540559 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:52.146236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1024/2082] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:52.841083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326992be-151b-4f68-9980-30787f4f8c67 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:52.913100 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326992be-151b-4f68-9980-30787f4f8c67 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:52.917642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c400b-8b2b-4abd-bd61-944d038ed1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:52.919175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c400b-8b2b-4abd-bd61-944d038ed1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:52.919462 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c400b-8b2b-4abd-bd61-944d038ed1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:52.919740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c400b-8b2b-4abd-bd61-944d038ed1fb admin admin] PATH_INFO: `/v3/users/fbb011ef0f634a519939cac01a1c063f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:52.922154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c400b-8b2b-4abd-bd61-944d038ed1fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb011ef0f634a519939cac01a1c063f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:52.924152 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c400b-8b2b-4abd-bd61-944d038ed1fb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:52.984093 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2b8c400b-8b2b-4abd-bd61-944d038ed1fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb011ef0f634a519939cac01a1c063f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:52.997218 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2b8c400b-8b2b-4abd-bd61-944d038ed1fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb011ef0f634a519939cac01a1c063f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:53.005030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2b8c400b-8b2b-4abd-bd61-944d038ed1fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb011ef0f634a519939cac01a1c063f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:53.005851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2b8c400b-8b2b-4abd-bd61-944d038ed1fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb011ef0f634a519939cac01a1c063f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:53.007733 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:53.029022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2b8c400b-8b2b-4abd-bd61-944d038ed1fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb011ef0f634a519939cac01a1c063f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:53.049836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1059/2083] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:52 2022] DELETE /identity/v3/users/fbb011ef0f634a519939cac01a1c063f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:53.055104 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69fbd6-c2ca-448e-a3c7-86036003de7c None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:53.056081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69fbd6-c2ca-448e-a3c7-86036003de7c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:53.056950 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69fbd6-c2ca-448e-a3c7-86036003de7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:53.079808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-be69fbd6-c2ca-448e-a3c7-86036003de7c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:53.081041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-be69fbd6-c2ca-448e-a3c7-86036003de7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:53.164124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1025/2084] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:53.175975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c400b-8b2b-4abd-bd61-944d038ed1fb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:53.178784 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2b8c400b-8b2b-4abd-bd61-944d038ed1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:53.331992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c400b-8b2b-4abd-bd61-944d038ed1fb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:53.335783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e401584-ad00-4795-9009-f5aac4bbee7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:53.336444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401584-ad00-4795-9009-f5aac4bbee7c service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:53.336730 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401584-ad00-4795-9009-f5aac4bbee7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:53.337043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401584-ad00-4795-9009-f5aac4bbee7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:53.360612 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e401584-ad00-4795-9009-f5aac4bbee7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:53.362392 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e401584-ad00-4795-9009-f5aac4bbee7c service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:53.376966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1060/2085] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:54.132865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69fbd6-c2ca-448e-a3c7-86036003de7c None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:54.134392 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-be69fbd6-c2ca-448e-a3c7-86036003de7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:54.149074 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69fbd6-c2ca-448e-a3c7-86036003de7c None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:54.155039 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4860f5-98d6-4655-82a8-8626233debdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:54.156176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4860f5-98d6-4655-82a8-8626233debdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:54.156459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4860f5-98d6-4655-82a8-8626233debdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:54.156736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4860f5-98d6-4655-82a8-8626233debdd admin admin] PATH_INFO: `/v3/projects/e5e8fa8f710c4253a5006a04a5218228` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:54.157995 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4860f5-98d6-4655-82a8-8626233debdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e8fa8f710c4253a5006a04a5218228)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:54.159939 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4860f5-98d6-4655-82a8-8626233debdd admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:54.216276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cf4860f5-98d6-4655-82a8-8626233debdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e8fa8f710c4253a5006a04a5218228', 'request_id': 'req-cf4860f5-98d6-4655-82a8-8626233debdd'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:54.225990 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cf4860f5-98d6-4655-82a8-8626233debdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e8fa8f710c4253a5006a04a5218228', 'request_id': 'req-cf4860f5-98d6-4655-82a8-8626233debdd'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:54.233053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cf4860f5-98d6-4655-82a8-8626233debdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e8fa8f710c4253a5006a04a5218228', 'request_id': 'req-cf4860f5-98d6-4655-82a8-8626233debdd'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:54.244274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cf4860f5-98d6-4655-82a8-8626233debdd admin admin] The token cache is being invalidate because project e5e8fa8f710c4253a5006a04a5218228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:54.244518 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cf4860f5-98d6-4655-82a8-8626233debdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:54.245196 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cf4860f5-98d6-4655-82a8-8626233debdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:54.246793 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1026/2086] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:54 2022] DELETE /identity/v3/projects/e5e8fa8f710c4253a5006a04a5218228 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:54.251256 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e401584-ad00-4795-9009-f5aac4bbee7c service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:54.261492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e401584-ad00-4795-9009-f5aac4bbee7c service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:54.339856 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957faf50-8963-46c7-8bd5-8408c1e96764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:54.340770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957faf50-8963-46c7-8bd5-8408c1e96764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:54.341094 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957faf50-8963-46c7-8bd5-8408c1e96764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:54.341375 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957faf50-8963-46c7-8bd5-8408c1e96764 admin admin] PATH_INFO: `/v3/users/ac3f01d899634a08beec02bba6141b18` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:54.342605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957faf50-8963-46c7-8bd5-8408c1e96764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3f01d899634a08beec02bba6141b18)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:54.344528 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957faf50-8963-46c7-8bd5-8408c1e96764 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:54.396351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-957faf50-8963-46c7-8bd5-8408c1e96764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3f01d899634a08beec02bba6141b18'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:54.410764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-957faf50-8963-46c7-8bd5-8408c1e96764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3f01d899634a08beec02bba6141b18'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:54.419956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-957faf50-8963-46c7-8bd5-8408c1e96764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3f01d899634a08beec02bba6141b18'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:54.422548 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-957faf50-8963-46c7-8bd5-8408c1e96764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3f01d899634a08beec02bba6141b18'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:54.432727 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-957faf50-8963-46c7-8bd5-8408c1e96764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3f01d899634a08beec02bba6141b18'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:54.439990 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1061/2087] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:54 2022] DELETE /identity/v3/users/ac3f01d899634a08beec02bba6141b18 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:54.476141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4860f5-98d6-4655-82a8-8626233debdd admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:54.477832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-cf4860f5-98d6-4655-82a8-8626233debdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:54.491143 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4860f5-98d6-4655-82a8-8626233debdd admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:54.590817 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de283166-4c3c-4b69-b048-53188298eb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:54.592969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de283166-4c3c-4b69-b048-53188298eb6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:54.593380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de283166-4c3c-4b69-b048-53188298eb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:54.593761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de283166-4c3c-4b69-b048-53188298eb6b admin admin] PATH_INFO: `/v3/users/a9da0f22ccdf4f47be19af3c4b10ecf4` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:54.595136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de283166-4c3c-4b69-b048-53188298eb6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9da0f22ccdf4f47be19af3c4b10ecf4)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:54.597654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de283166-4c3c-4b69-b048-53188298eb6b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:54.606079 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:54.664733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-de283166-4c3c-4b69-b048-53188298eb6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9da0f22ccdf4f47be19af3c4b10ecf4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:54.691078 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-de283166-4c3c-4b69-b048-53188298eb6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9da0f22ccdf4f47be19af3c4b10ecf4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:54.693517 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-de283166-4c3c-4b69-b048-53188298eb6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9da0f22ccdf4f47be19af3c4b10ecf4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:54.747488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-de283166-4c3c-4b69-b048-53188298eb6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9da0f22ccdf4f47be19af3c4b10ecf4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:54.763258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-de283166-4c3c-4b69-b048-53188298eb6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9da0f22ccdf4f47be19af3c4b10ecf4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:54.779103 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336e2f2-e2e6-4d4e-9b0d-340a4afa3307 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:54.780248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336e2f2-e2e6-4d4e-9b0d-340a4afa3307 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:54.781032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336e2f2-e2e6-4d4e-9b0d-340a4afa3307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:54.782985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1027/2088] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:54 2022] DELETE /identity/v3/users/a9da0f22ccdf4f47be19af3c4b10ecf4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:54.805792 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4336e2f2-e2e6-4d4e-9b0d-340a4afa3307 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:54.807433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4336e2f2-e2e6-4d4e-9b0d-340a4afa3307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:54.824165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:54.952441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1062/2089] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:54.962144 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de283166-4c3c-4b69-b048-53188298eb6b admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:54.964037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-de283166-4c3c-4b69-b048-53188298eb6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:55.052022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de283166-4c3c-4b69-b048-53188298eb6b admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:55.056374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe8405-a480-4d3a-9aab-8dfbbd99662b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:55.058767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe8405-a480-4d3a-9aab-8dfbbd99662b service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:55.059065 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe8405-a480-4d3a-9aab-8dfbbd99662b service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:55.059592 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe8405-a480-4d3a-9aab-8dfbbd99662b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:55.076628 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe8405-a480-4d3a-9aab-8dfbbd99662b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:55.078389 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe8405-a480-4d3a-9aab-8dfbbd99662b service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:55.089069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1028/2090] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:55.220868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336e2f2-e2e6-4d4e-9b0d-340a4afa3307 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:55.223029 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4336e2f2-e2e6-4d4e-9b0d-340a4afa3307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:55.249990 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336e2f2-e2e6-4d4e-9b0d-340a4afa3307 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:55.253515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7fa10-66f7-4ceb-a8de-e32841168d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:55.255132 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7fa10-66f7-4ceb-a8de-e32841168d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:55.255671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7fa10-66f7-4ceb-a8de-e32841168d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:55.256187 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7fa10-66f7-4ceb-a8de-e32841168d16 admin admin] PATH_INFO: `/v3/projects/dcb0b31ecf1348e0bf15a2b093e0e94e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:55.257693 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7fa10-66f7-4ceb-a8de-e32841168d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb0b31ecf1348e0bf15a2b093e0e94e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:55.259746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7fa10-66f7-4ceb-a8de-e32841168d16 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:55.347243 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-76a7fa10-66f7-4ceb-a8de-e32841168d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb0b31ecf1348e0bf15a2b093e0e94e', 'request_id': 'req-76a7fa10-66f7-4ceb-a8de-e32841168d16'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.353976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-76a7fa10-66f7-4ceb-a8de-e32841168d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb0b31ecf1348e0bf15a2b093e0e94e', 'request_id': 'req-76a7fa10-66f7-4ceb-a8de-e32841168d16'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.372320 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-76a7fa10-66f7-4ceb-a8de-e32841168d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb0b31ecf1348e0bf15a2b093e0e94e', 'request_id': 'req-76a7fa10-66f7-4ceb-a8de-e32841168d16'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.395583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-76a7fa10-66f7-4ceb-a8de-e32841168d16 admin admin] The token cache is being invalidate because project dcb0b31ecf1348e0bf15a2b093e0e94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:55.395886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-76a7fa10-66f7-4ceb-a8de-e32841168d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.397350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-76a7fa10-66f7-4ceb-a8de-e32841168d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.399677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1063/2091] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:55 2022] DELETE /identity/v3/projects/dcb0b31ecf1348e0bf15a2b093e0e94e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:55.405255 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac163e36-fa44-4a65-961a-036cd3c27b90 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:55.405973 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac163e36-fa44-4a65-961a-036cd3c27b90 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:55.406075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac163e36-fa44-4a65-961a-036cd3c27b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:55.428411 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-ac163e36-fa44-4a65-961a-036cd3c27b90 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:55.428411 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ac163e36-fa44-4a65-961a-036cd3c27b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:55.464645 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7fa10-66f7-4ceb-a8de-e32841168d16 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:55.466693 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-76a7fa10-66f7-4ceb-a8de-e32841168d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:55.519463 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1029/2092] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:55.527856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8c9f7-c766-4e84-bab4-7d91e8862f55 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:55.528231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8c9f7-c766-4e84-bab4-7d91e8862f55 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:55.528699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8c9f7-c766-4e84-bab4-7d91e8862f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:55.549169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-9bb8c9f7-c766-4e84-bab4-7d91e8862f55 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:55.550464 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9bb8c9f7-c766-4e84-bab4-7d91e8862f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:55.559656 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1030/2093] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:55.564729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8c9f7-c766-4e84-bab4-7d91e8862f55 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:55.575310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8c9f7-c766-4e84-bab4-7d91e8862f55 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:55.579679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4838916-386b-403b-bd02-54ea409403f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:55.580427 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4838916-386b-403b-bd02-54ea409403f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:55.580786 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4838916-386b-403b-bd02-54ea409403f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:55.581207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4838916-386b-403b-bd02-54ea409403f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:55.582024 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4838916-386b-403b-bd02-54ea409403f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:55.582438 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7fa10-66f7-4ceb-a8de-e32841168d16 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:55.582591 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4838916-386b-403b-bd02-54ea409403f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:55.584249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4838916-386b-403b-bd02-54ea409403f1 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:55.587253 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62facbe-5693-4261-a6e1-e49502a8e650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:55.588164 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62facbe-5693-4261-a6e1-e49502a8e650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:55.588391 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62facbe-5693-4261-a6e1-e49502a8e650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:55.588669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62facbe-5693-4261-a6e1-e49502a8e650 admin admin] PATH_INFO: `/v3/projects/78094e13aee948a19be912b6edc6f0c8` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:55.589862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62facbe-5693-4261-a6e1-e49502a8e650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78094e13aee948a19be912b6edc6f0c8)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:55.591750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62facbe-5693-4261-a6e1-e49502a8e650 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:55.600626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1031/2094] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:30:55.603487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4838916-386b-403b-bd02-54ea409403f1 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:55.616912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4838916-386b-403b-bd02-54ea409403f1 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:55.625533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4207ce-6e53-4a82-b6a4-78a6812f5684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:55.626700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4207ce-6e53-4a82-b6a4-78a6812f5684 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:55.626938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4207ce-6e53-4a82-b6a4-78a6812f5684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:55.627428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4207ce-6e53-4a82-b6a4-78a6812f5684 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:55.628350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4207ce-6e53-4a82-b6a4-78a6812f5684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:55.630864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4207ce-6e53-4a82-b6a4-78a6812f5684 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:55.636033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:55.661154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:55.667638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1032/2095] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:55 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:55.667638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4207ce-6e53-4a82-b6a4-78a6812f5684 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:55.667638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4b4207ce-6e53-4a82-b6a4-78a6812f5684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:55.674313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f62facbe-5693-4261-a6e1-e49502a8e650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78094e13aee948a19be912b6edc6f0c8', 'request_id': 'req-f62facbe-5693-4261-a6e1-e49502a8e650'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.681874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f62facbe-5693-4261-a6e1-e49502a8e650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78094e13aee948a19be912b6edc6f0c8', 'request_id': 'req-f62facbe-5693-4261-a6e1-e49502a8e650'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.687898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f62facbe-5693-4261-a6e1-e49502a8e650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78094e13aee948a19be912b6edc6f0c8', 'request_id': 'req-f62facbe-5693-4261-a6e1-e49502a8e650'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.700100 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f62facbe-5693-4261-a6e1-e49502a8e650 admin admin] The token cache is being invalidate because project 78094e13aee948a19be912b6edc6f0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:55.700668 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f62facbe-5693-4261-a6e1-e49502a8e650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.701368 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f62facbe-5693-4261-a6e1-e49502a8e650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.702987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1064/2096] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:55 2022] DELETE /identity/v3/projects/78094e13aee948a19be912b6edc6f0c8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:55.703763 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62facbe-5693-4261-a6e1-e49502a8e650 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:55.705304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f62facbe-5693-4261-a6e1-e49502a8e650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:55.741014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4207ce-6e53-4a82-b6a4-78a6812f5684 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:55.746353 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c98148-9e7c-47e0-8a64-7a9428d278c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:55.747248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c98148-9e7c-47e0-8a64-7a9428d278c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:55.747527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c98148-9e7c-47e0-8a64-7a9428d278c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:55.747798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c98148-9e7c-47e0-8a64-7a9428d278c9 admin admin] PATH_INFO: `/v3/users/b1855c6320b4438aaa04013d863e789d` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:55.749043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c98148-9e7c-47e0-8a64-7a9428d278c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1855c6320b4438aaa04013d863e789d)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:55.750944 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c98148-9e7c-47e0-8a64-7a9428d278c9 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:55.771248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62facbe-5693-4261-a6e1-e49502a8e650 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:55.782013 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4ccd4-83da-44cd-8f7b-02d57ed59391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:55.782674 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4ccd4-83da-44cd-8f7b-02d57ed59391 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:55.783058 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4ccd4-83da-44cd-8f7b-02d57ed59391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:55.783266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4ccd4-83da-44cd-8f7b-02d57ed59391 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:55.784168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4ccd4-83da-44cd-8f7b-02d57ed59391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:55.786343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4ccd4-83da-44cd-8f7b-02d57ed59391 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:55.802506 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e0c98148-9e7c-47e0-8a64-7a9428d278c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1855c6320b4438aaa04013d863e789d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.807157 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1065/2097] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:55 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:55.808002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4ccd4-83da-44cd-8f7b-02d57ed59391 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:55.809616 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ccb4ccd4-83da-44cd-8f7b-02d57ed59391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:55.812222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e0c98148-9e7c-47e0-8a64-7a9428d278c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1855c6320b4438aaa04013d863e789d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.812952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e0c98148-9e7c-47e0-8a64-7a9428d278c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1855c6320b4438aaa04013d863e789d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.821589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4ccd4-83da-44cd-8f7b-02d57ed59391 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:55.824558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e0c98148-9e7c-47e0-8a64-7a9428d278c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1855c6320b4438aaa04013d863e789d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.826555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bed22b-1656-4785-a015-1cde283a6e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:55.827482 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bed22b-1656-4785-a015-1cde283a6e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:55.827772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bed22b-1656-4785-a015-1cde283a6e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:55.828054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bed22b-1656-4785-a015-1cde283a6e19 admin admin] PATH_INFO: `/v3/users/55859329f9f14a35808937e387c1b42c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:55.829357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bed22b-1656-4785-a015-1cde283a6e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55859329f9f14a35808937e387c1b42c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:55.831583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bed22b-1656-4785-a015-1cde283a6e19 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:55.832202 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e0c98148-9e7c-47e0-8a64-7a9428d278c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1855c6320b4438aaa04013d863e789d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.841563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1033/2098] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:55 2022] DELETE /identity/v3/users/b1855c6320b4438aaa04013d863e789d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:55.841563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c98148-9e7c-47e0-8a64-7a9428d278c9 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:55.846596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e0c98148-9e7c-47e0-8a64-7a9428d278c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:55.897944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-64bed22b-1656-4785-a015-1cde283a6e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55859329f9f14a35808937e387c1b42c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.918146 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-64bed22b-1656-4785-a015-1cde283a6e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55859329f9f14a35808937e387c1b42c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.943822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-64bed22b-1656-4785-a015-1cde283a6e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55859329f9f14a35808937e387c1b42c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.946882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-64bed22b-1656-4785-a015-1cde283a6e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55859329f9f14a35808937e387c1b42c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.964877 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-64bed22b-1656-4785-a015-1cde283a6e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55859329f9f14a35808937e387c1b42c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:55.976415 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1066/2099] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:55 2022] DELETE /identity/v3/users/55859329f9f14a35808937e387c1b42c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:55.977620 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bed22b-1656-4785-a015-1cde283a6e19 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:55.979093 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-64bed22b-1656-4785-a015-1cde283a6e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:55.998794 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c98148-9e7c-47e0-8a64-7a9428d278c9 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:56.015775 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:56.045326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:56.092855 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b12fed-a0a5-4c5c-986e-aa91e51b55a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:56.093884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b12fed-a0a5-4c5c-986e-aa91e51b55a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.095258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b12fed-a0a5-4c5c-986e-aa91e51b55a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.095258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b12fed-a0a5-4c5c-986e-aa91e51b55a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.095614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b12fed-a0a5-4c5c-986e-aa91e51b55a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:56.097486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b12fed-a0a5-4c5c-986e-aa91e51b55a2 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:56.113727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1034/2100] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:56.115271 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b12fed-a0a5-4c5c-986e-aa91e51b55a2 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:56.117253 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-30b12fed-a0a5-4c5c-986e-aa91e51b55a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:56.134256 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bed22b-1656-4785-a015-1cde283a6e19 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:56.135936 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b12fed-a0a5-4c5c-986e-aa91e51b55a2 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:56.142192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7b05b-52c2-49b9-b49d-b8e7883cac18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:56.143022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7b05b-52c2-49b9-b49d-b8e7883cac18 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.143374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7b05b-52c2-49b9-b49d-b8e7883cac18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.143713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7b05b-52c2-49b9-b49d-b8e7883cac18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.144642 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7b05b-52c2-49b9-b49d-b8e7883cac18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:56.146803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7b05b-52c2-49b9-b49d-b8e7883cac18 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:56.148399 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff8ee1-dbf6-453c-a439-fc587ac450d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:56.149421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff8ee1-dbf6-453c-a439-fc587ac450d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.149846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff8ee1-dbf6-453c-a439-fc587ac450d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.150204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff8ee1-dbf6-453c-a439-fc587ac450d1 admin admin] PATH_INFO: `/v3/users/df730406013e48ae859502b7546809e2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.151795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff8ee1-dbf6-453c-a439-fc587ac450d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df730406013e48ae859502b7546809e2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:56.154234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff8ee1-dbf6-453c-a439-fc587ac450d1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:56.160966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1035/2101] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:30:56.163889 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7b05b-52c2-49b9-b49d-b8e7883cac18 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:56.186077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7b05b-52c2-49b9-b49d-b8e7883cac18 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:56.203572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac87e0c-e41d-4942-b12c-c3cbed1fa91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:56.203572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac87e0c-e41d-4942-b12c-c3cbed1fa91f admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.203572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac87e0c-e41d-4942-b12c-c3cbed1fa91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.203572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac87e0c-e41d-4942-b12c-c3cbed1fa91f admin admin] PATH_INFO: `/v3/projects/b4072391d71444c0a8b36187bbf4bf3c/users/866780ecedd44af8b268d846df937474/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.228075 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a7ff8ee1-dbf6-453c-a439-fc587ac450d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df730406013e48ae859502b7546809e2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:56.234463 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac87e0c-e41d-4942-b12c-c3cbed1fa91f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4072391d71444c0a8b36187bbf4bf3c, user_id=866780ecedd44af8b268d846df937474, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:56.237174 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac87e0c-e41d-4942-b12c-c3cbed1fa91f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:56.242551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a7ff8ee1-dbf6-453c-a439-fc587ac450d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df730406013e48ae859502b7546809e2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:56.254184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1036/2102] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:56 2022] PUT /identity/v3/projects/b4072391d71444c0a8b36187bbf4bf3c/users/866780ecedd44af8b268d846df937474/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:56.255467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac87e0c-e41d-4942-b12c-c3cbed1fa91f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:56.255957 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a7ff8ee1-dbf6-453c-a439-fc587ac450d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df730406013e48ae859502b7546809e2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:56.256902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a7ff8ee1-dbf6-453c-a439-fc587ac450d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df730406013e48ae859502b7546809e2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:56.265551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a7ff8ee1-dbf6-453c-a439-fc587ac450d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df730406013e48ae859502b7546809e2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:56.266469 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2ac87e0c-e41d-4942-b12c-c3cbed1fa91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:56.273752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1067/2103] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:55 2022] DELETE /identity/v3/users/df730406013e48ae859502b7546809e2 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:56.275287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa50a48-673f-4acc-a33c-4353a0b89d2e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.275743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa50a48-673f-4acc-a33c-4353a0b89d2e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.276176 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa50a48-673f-4acc-a33c-4353a0b89d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.312627 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5aa50a48-673f-4acc-a33c-4353a0b89d2e None None] MFA Rules not processed for user `866780ecedd44af8b268d846df937474`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:56.314321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5aa50a48-673f-4acc-a33c-4353a0b89d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:56.342652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac87e0c-e41d-4942-b12c-c3cbed1fa91f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:56.397913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1068/2104] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:56.399235 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e563a4f-467b-47ca-bb54-52c1e1befd80 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.399531 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e563a4f-467b-47ca-bb54-52c1e1befd80 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.399808 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e563a4f-467b-47ca-bb54-52c1e1befd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.419260 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5e563a4f-467b-47ca-bb54-52c1e1befd80 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:56.421487 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5e563a4f-467b-47ca-bb54-52c1e1befd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:56.439592 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5f811-7eff-4149-a618-9bca5ba14132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:56.440466 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5f811-7eff-4149-a618-9bca5ba14132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.443566 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5f811-7eff-4149-a618-9bca5ba14132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.443566 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5f811-7eff-4149-a618-9bca5ba14132 admin admin] PATH_INFO: `/v3/projects/6de0bef5eb0249dca3b456a89e8b3fa9` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.443566 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5f811-7eff-4149-a618-9bca5ba14132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de0bef5eb0249dca3b456a89e8b3fa9)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:56.444374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5f811-7eff-4149-a618-9bca5ba14132 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:56.474278 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:56.485016 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:56.509814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-8ae5f811-7eff-4149-a618-9bca5ba14132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de0bef5eb0249dca3b456a89e8b3fa9', 'request_id': 'req-8ae5f811-7eff-4149-a618-9bca5ba14132'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:56.516437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1069/2105] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:56.517305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e563a4f-467b-47ca-bb54-52c1e1befd80 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:56.518180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-8ae5f811-7eff-4149-a618-9bca5ba14132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de0bef5eb0249dca3b456a89e8b3fa9', 'request_id': 'req-8ae5f811-7eff-4149-a618-9bca5ba14132'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:56.519027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5e563a4f-467b-47ca-bb54-52c1e1befd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:56.531690 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-8ae5f811-7eff-4149-a618-9bca5ba14132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de0bef5eb0249dca3b456a89e8b3fa9', 'request_id': 'req-8ae5f811-7eff-4149-a618-9bca5ba14132'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:56.532639 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e563a4f-467b-47ca-bb54-52c1e1befd80 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:56.543081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-8ae5f811-7eff-4149-a618-9bca5ba14132 admin admin] The token cache is being invalidate because project 6de0bef5eb0249dca3b456a89e8b3fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:56.543299 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-8ae5f811-7eff-4149-a618-9bca5ba14132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:56.543956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-8ae5f811-7eff-4149-a618-9bca5ba14132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:56.548969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1037/2106] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:56 2022] DELETE /identity/v3/projects/6de0bef5eb0249dca3b456a89e8b3fa9 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:56.548969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5f811-7eff-4149-a618-9bca5ba14132 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:56.548969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8ae5f811-7eff-4149-a618-9bca5ba14132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:56.595255 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b27d13-5f00-4fd9-a296-453fe8e91095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:56.595917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b27d13-5f00-4fd9-a296-453fe8e91095 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.596202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b27d13-5f00-4fd9-a296-453fe8e91095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.596483 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b27d13-5f00-4fd9-a296-453fe8e91095 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.599034 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b27d13-5f00-4fd9-a296-453fe8e91095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:56.599167 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b27d13-5f00-4fd9-a296-453fe8e91095 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:56.611594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5f811-7eff-4149-a618-9bca5ba14132 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:56.617077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadce97-4ec7-4d8b-98a5-418e3aa9dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:56.617957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadce97-4ec7-4d8b-98a5-418e3aa9dadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.618336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadce97-4ec7-4d8b-98a5-418e3aa9dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.618653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadce97-4ec7-4d8b-98a5-418e3aa9dadf admin admin] PATH_INFO: `/v3/projects/3085021f9ae4474daa17f79230fdb087` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.620087 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadce97-4ec7-4d8b-98a5-418e3aa9dadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3085021f9ae4474daa17f79230fdb087)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:56.622028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadce97-4ec7-4d8b-98a5-418e3aa9dadf admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:56.625721 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1070/2107] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:56 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:56.626094 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b27d13-5f00-4fd9-a296-453fe8e91095 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:56.629933 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-10b27d13-5f00-4fd9-a296-453fe8e91095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:56.675004 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5fadce97-4ec7-4d8b-98a5-418e3aa9dadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3085021f9ae4474daa17f79230fdb087', 'request_id': 'req-5fadce97-4ec7-4d8b-98a5-418e3aa9dadf'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:56.682487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5fadce97-4ec7-4d8b-98a5-418e3aa9dadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3085021f9ae4474daa17f79230fdb087', 'request_id': 'req-5fadce97-4ec7-4d8b-98a5-418e3aa9dadf'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:56.688562 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5fadce97-4ec7-4d8b-98a5-418e3aa9dadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3085021f9ae4474daa17f79230fdb087', 'request_id': 'req-5fadce97-4ec7-4d8b-98a5-418e3aa9dadf'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:56.690365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b27d13-5f00-4fd9-a296-453fe8e91095 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:56.699715 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5fadce97-4ec7-4d8b-98a5-418e3aa9dadf admin admin] The token cache is being invalidate because project 3085021f9ae4474daa17f79230fdb087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:56.700082 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5fadce97-4ec7-4d8b-98a5-418e3aa9dadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:56.700797 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5fadce97-4ec7-4d8b-98a5-418e3aa9dadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:56.702983 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1038/2108] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:56 2022] DELETE /identity/v3/projects/3085021f9ae4474daa17f79230fdb087 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:56.704256 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf29c1-6c82-446e-a5a5-c5543c62b5a8 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.704603 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf29c1-6c82-446e-a5a5-c5543c62b5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.704954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf29c1-6c82-446e-a5a5-c5543c62b5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.727658 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-14cf29c1-6c82-446e-a5a5-c5543c62b5a8 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:56.728871 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-14cf29c1-6c82-446e-a5a5-c5543c62b5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:56.739344 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa8971-cd18-44ae-bdd5-b2b32a729065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:56.739998 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa8971-cd18-44ae-bdd5-b2b32a729065 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.740284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa8971-cd18-44ae-bdd5-b2b32a729065 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.740558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa8971-cd18-44ae-bdd5-b2b32a729065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.742632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3ffa8971-cd18-44ae-bdd5-b2b32a729065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:56.769649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:56.780577 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:56.793302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1039/2109] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:56.801528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf29c1-6c82-446e-a5a5-c5543c62b5a8 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:56.802862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-14cf29c1-6c82-446e-a5a5-c5543c62b5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:56.813957 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa8971-cd18-44ae-bdd5-b2b32a729065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:56.814116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf29c1-6c82-446e-a5a5-c5543c62b5a8 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:56.815434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa8971-cd18-44ae-bdd5-b2b32a729065 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:56.818818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2eb7a-b345-4b3a-bc9b-769f646188c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:56.819564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2eb7a-b345-4b3a-bc9b-769f646188c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.819911 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2eb7a-b345-4b3a-bc9b-769f646188c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.820211 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2eb7a-b345-4b3a-bc9b-769f646188c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.820896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2eb7a-b345-4b3a-bc9b-769f646188c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:56.825399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2eb7a-b345-4b3a-bc9b-769f646188c5 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:56.825570 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1071/2110] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:56.826932 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607ffc0-78a5-416a-be78-9206c439efad None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.827335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607ffc0-78a5-416a-be78-9206c439efad None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.827620 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607ffc0-78a5-416a-be78-9206c439efad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.846757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1040/2111] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:56 2022] POST /identity/v3/users => generated 297 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:56.848294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecc659-b469-4cce-ab39-7b8fe1a5e224 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.848590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecc659-b469-4cce-ab39-7b8fe1a5e224 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.848913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecc659-b469-4cce-ab39-7b8fe1a5e224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.849560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2607ffc0-78a5-416a-be78-9206c439efad None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:56.851007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2607ffc0-78a5-416a-be78-9206c439efad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:56.860810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1072/2112] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:56.861908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607ffc0-78a5-416a-be78-9206c439efad None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:56.867900 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-fbecc659-b469-4cce-ab39-7b8fe1a5e224 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:56.869304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-fbecc659-b469-4cce-ab39-7b8fe1a5e224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:56.880710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607ffc0-78a5-416a-be78-9206c439efad None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:56.882801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1041/2113] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:56.886090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd7df9-0b04-4ee9-aa94-f68d3979122a None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.886090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd7df9-0b04-4ee9-aa94-f68d3979122a None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.886090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd7df9-0b04-4ee9-aa94-f68d3979122a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.886360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bcfa5-13d3-4bfb-a1ea-e92045d1659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:56.886896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bcfa5-13d3-4bfb-a1ea-e92045d1659c admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.887188 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bcfa5-13d3-4bfb-a1ea-e92045d1659c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.887469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bcfa5-13d3-4bfb-a1ea-e92045d1659c admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.888235 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bcfa5-13d3-4bfb-a1ea-e92045d1659c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:56.890520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bcfa5-13d3-4bfb-a1ea-e92045d1659c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:56.905992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1073/2114] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:56.905992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bcfa5-13d3-4bfb-a1ea-e92045d1659c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:56.906279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-fecd7df9-0b04-4ee9-aa94-f68d3979122a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:56.907342 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-fecd7df9-0b04-4ee9-aa94-f68d3979122a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:56.919847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1042/2115] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:56.920879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd7df9-0b04-4ee9-aa94-f68d3979122a None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:56.925597 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bcfa5-13d3-4bfb-a1ea-e92045d1659c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:56.931627 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5684b6-953c-4313-a979-14aa3a65456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:56.931973 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd7df9-0b04-4ee9-aa94-f68d3979122a None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:56.932406 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5684b6-953c-4313-a979-14aa3a65456d admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.932789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5684b6-953c-4313-a979-14aa3a65456d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.933144 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5684b6-953c-4313-a979-14aa3a65456d admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.934050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5684b6-953c-4313-a979-14aa3a65456d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:56.934397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5684b6-953c-4313-a979-14aa3a65456d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:56.936972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5684b6-953c-4313-a979-14aa3a65456d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:56.938849 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a7b00-e185-419c-aff2-b8dd22460863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:56.940046 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a7b00-e185-419c-aff2-b8dd22460863 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.940513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a7b00-e185-419c-aff2-b8dd22460863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.940801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a7b00-e185-419c-aff2-b8dd22460863 admin admin] PATH_INFO: `/v3/projects/170ef438c2004d539d6307a32c67e923/users/443081f003c34d0591e3e54e1a6110be/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.956002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1074/2116] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:56.956002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5684b6-953c-4313-a979-14aa3a65456d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:56.956732 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a7b00-e185-419c-aff2-b8dd22460863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=170ef438c2004d539d6307a32c67e923, user_id=443081f003c34d0591e3e54e1a6110be, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:56.960567 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a7b00-e185-419c-aff2-b8dd22460863 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:56.965130 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5684b6-953c-4313-a979-14aa3a65456d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:56.974181 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5eb35c-5db0-4227-9395-d624e638c2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:56.975033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eb35c-5db0-4227-9395-d624e638c2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:56.975393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eb35c-5db0-4227-9395-d624e638c2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:56.975906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eb35c-5db0-4227-9395-d624e638c2e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:56.976764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5eb35c-5db0-4227-9395-d624e638c2e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:56.980549 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1043/2117] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:56 2022] PUT /identity/v3/projects/170ef438c2004d539d6307a32c67e923/users/443081f003c34d0591e3e54e1a6110be/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:56.980693 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5eb35c-5db0-4227-9395-d624e638c2e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:56.980814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a7b00-e185-419c-aff2-b8dd22460863 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:56.980908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5eb35c-5db0-4227-9395-d624e638c2e0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:56.995082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1075/2118] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:30:56.995082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5eb35c-5db0-4227-9395-d624e638c2e0 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:57.009402 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5eb35c-5db0-4227-9395-d624e638c2e0 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.058427 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a7b00-e185-419c-aff2-b8dd22460863 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.065908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa481418-3127-4cd3-b9a3-89c29bdbdd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.066808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa481418-3127-4cd3-b9a3-89c29bdbdd0b admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.067161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa481418-3127-4cd3-b9a3-89c29bdbdd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.067663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa481418-3127-4cd3-b9a3-89c29bdbdd0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.068756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa481418-3127-4cd3-b9a3-89c29bdbdd0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.075795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa481418-3127-4cd3-b9a3-89c29bdbdd0b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:57.091762 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c34293-856f-47d7-b49f-91cce5b8ddc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.092738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c34293-856f-47d7-b49f-91cce5b8ddc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.093161 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c34293-856f-47d7-b49f-91cce5b8ddc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.093467 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c34293-856f-47d7-b49f-91cce5b8ddc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.094292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c34293-856f-47d7-b49f-91cce5b8ddc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.095807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c34293-856f-47d7-b49f-91cce5b8ddc1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:57.101154 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1044/2119] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:56 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:57.101994 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa481418-3127-4cd3-b9a3-89c29bdbdd0b admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:57.112367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1076/2120] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:57.112367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c34293-856f-47d7-b49f-91cce5b8ddc1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:57.124362 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c34293-856f-47d7-b49f-91cce5b8ddc1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.177498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa481418-3127-4cd3-b9a3-89c29bdbdd0b admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.182605 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fc9a3-f9bb-4a80-a624-af82c0de7a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.183387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fc9a3-f9bb-4a80-a624-af82c0de7a58 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.183774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fc9a3-f9bb-4a80-a624-af82c0de7a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.184259 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fc9a3-f9bb-4a80-a624-af82c0de7a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.185254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fc9a3-f9bb-4a80-a624-af82c0de7a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.187853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fc9a3-f9bb-4a80-a624-af82c0de7a58 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:57.207196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a0cd8-d3ab-4687-a6c1-e9afc549a6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.207838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a0cd8-d3ab-4687-a6c1-e9afc549a6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.208125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a0cd8-d3ab-4687-a6c1-e9afc549a6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.208554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a0cd8-d3ab-4687-a6c1-e9afc549a6c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.209295 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a0cd8-d3ab-4687-a6c1-e9afc549a6c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.210709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:57.211217 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a0cd8-d3ab-4687-a6c1-e9afc549a6c9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:57.219917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1045/2121] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:57 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:57.220147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fc9a3-f9bb-4a80-a624-af82c0de7a58 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:57.237660 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1077/2122] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:57 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:57.238496 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a0cd8-d3ab-4687-a6c1-e9afc549a6c9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:57.240065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-774a0cd8-d3ab-4687-a6c1-e9afc549a6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:57.253101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a0cd8-d3ab-4687-a6c1-e9afc549a6c9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.262474 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:57.305078 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fc9a3-f9bb-4a80-a624-af82c0de7a58 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.314490 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b5471-9ddf-49a8-8592-92355c943e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.315321 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b5471-9ddf-49a8-8592-92355c943e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.315608 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b5471-9ddf-49a8-8592-92355c943e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.315897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b5471-9ddf-49a8-8592-92355c943e3e admin admin] PATH_INFO: `/v3/projects/170ef438c2004d539d6307a32c67e923/users/443081f003c34d0591e3e54e1a6110be/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.318579 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b5471-9ddf-49a8-8592-92355c943e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=170ef438c2004d539d6307a32c67e923, user_id=443081f003c34d0591e3e54e1a6110be, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.321291 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b5471-9ddf-49a8-8592-92355c943e3e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:57.333125 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1046/2123] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:57 2022] PUT /identity/v3/projects/170ef438c2004d539d6307a32c67e923/users/443081f003c34d0591e3e54e1a6110be/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:57.333522 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b5471-9ddf-49a8-8592-92355c943e3e admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:57.346340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a16b97-0f1d-4266-9dce-68692472b4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.347215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a16b97-0f1d-4266-9dce-68692472b4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.347500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a16b97-0f1d-4266-9dce-68692472b4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.347783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a16b97-0f1d-4266-9dce-68692472b4c5 admin admin] PATH_INFO: `/v3/projects/ab0081d468394fa0ae3b79771c6e17f4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.349022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a16b97-0f1d-4266-9dce-68692472b4c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0081d468394fa0ae3b79771c6e17f4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.350949 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a16b97-0f1d-4266-9dce-68692472b4c5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:57.408419 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b5471-9ddf-49a8-8592-92355c943e3e admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.414123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-84a16b97-0f1d-4266-9dce-68692472b4c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0081d468394fa0ae3b79771c6e17f4', 'request_id': 'req-84a16b97-0f1d-4266-9dce-68692472b4c5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:57.421036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-84a16b97-0f1d-4266-9dce-68692472b4c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0081d468394fa0ae3b79771c6e17f4', 'request_id': 'req-84a16b97-0f1d-4266-9dce-68692472b4c5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:57.427181 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-84a16b97-0f1d-4266-9dce-68692472b4c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0081d468394fa0ae3b79771c6e17f4', 'request_id': 'req-84a16b97-0f1d-4266-9dce-68692472b4c5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:57.441633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-84a16b97-0f1d-4266-9dce-68692472b4c5 admin admin] The token cache is being invalidate because project ab0081d468394fa0ae3b79771c6e17f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:57.441927 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-84a16b97-0f1d-4266-9dce-68692472b4c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:57.442569 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-84a16b97-0f1d-4266-9dce-68692472b4c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:57.444148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1078/2124] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:57 2022] DELETE /identity/v3/projects/ab0081d468394fa0ae3b79771c6e17f4 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:57.444901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a16b97-0f1d-4266-9dce-68692472b4c5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:57.446262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-84a16b97-0f1d-4266-9dce-68692472b4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:57.472487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab2be6-cbdd-4f7e-94c5-1da2c45d275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.473192 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab2be6-cbdd-4f7e-94c5-1da2c45d275f admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.473617 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab2be6-cbdd-4f7e-94c5-1da2c45d275f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.473895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab2be6-cbdd-4f7e-94c5-1da2c45d275f admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.474636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab2be6-cbdd-4f7e-94c5-1da2c45d275f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.476911 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab2be6-cbdd-4f7e-94c5-1da2c45d275f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:57.500579 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1047/2125] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:57 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:57.501952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76320ae-e60e-4f2e-aad0-fb701547fba9 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.502309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76320ae-e60e-4f2e-aad0-fb701547fba9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.502506 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76320ae-e60e-4f2e-aad0-fb701547fba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.521982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a16b97-0f1d-4266-9dce-68692472b4c5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.529549 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b47a3a-d169-4ab8-9710-8b4a791f89fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.531598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b47a3a-d169-4ab8-9710-8b4a791f89fe admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.532084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b47a3a-d169-4ab8-9710-8b4a791f89fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.532371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b47a3a-d169-4ab8-9710-8b4a791f89fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.533141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b47a3a-d169-4ab8-9710-8b4a791f89fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.534791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b47a3a-d169-4ab8-9710-8b4a791f89fe admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:57.535877 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-a76320ae-e60e-4f2e-aad0-fb701547fba9 None None] MFA Rules not processed for user `443081f003c34d0591e3e54e1a6110be`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:57.537107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a76320ae-e60e-4f2e-aad0-fb701547fba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:57.545796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1079/2126] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:57.546820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b47a3a-d169-4ab8-9710-8b4a791f89fe admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:57.548961 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-06b47a3a-d169-4ab8-9710-8b4a791f89fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:57.557269 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:57.563530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b47a3a-d169-4ab8-9710-8b4a791f89fe admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.569763 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b14389-ec45-4fbc-b0cf-b594c822d99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.570577 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b14389-ec45-4fbc-b0cf-b594c822d99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.571107 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b14389-ec45-4fbc-b0cf-b594c822d99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.571669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b14389-ec45-4fbc-b0cf-b594c822d99c admin admin] PATH_INFO: `/v3/users/b47f224fc14243b0a0b69dc21d3dcb8b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.572955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b14389-ec45-4fbc-b0cf-b594c822d99c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b47f224fc14243b0a0b69dc21d3dcb8b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.575097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b14389-ec45-4fbc-b0cf-b594c822d99c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:57.613004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:57.613990 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1048/2127] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:57.615117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76320ae-e60e-4f2e-aad0-fb701547fba9 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:57.616717 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a76320ae-e60e-4f2e-aad0-fb701547fba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:57.630623 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-75b14389-ec45-4fbc-b0cf-b594c822d99c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b47f224fc14243b0a0b69dc21d3dcb8b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:57.634242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76320ae-e60e-4f2e-aad0-fb701547fba9 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.639357 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c43d3-60de-441a-a853-9d79a76f3e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.640039 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c43d3-60de-441a-a853-9d79a76f3e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.640302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c43d3-60de-441a-a853-9d79a76f3e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.640578 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c43d3-60de-441a-a853-9d79a76f3e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.641330 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c43d3-60de-441a-a853-9d79a76f3e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.642945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c43d3-60de-441a-a853-9d79a76f3e5d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:57.643134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-75b14389-ec45-4fbc-b0cf-b594c822d99c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b47f224fc14243b0a0b69dc21d3dcb8b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:57.649984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-75b14389-ec45-4fbc-b0cf-b594c822d99c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b47f224fc14243b0a0b69dc21d3dcb8b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:57.650727 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-75b14389-ec45-4fbc-b0cf-b594c822d99c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b47f224fc14243b0a0b69dc21d3dcb8b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:57.657215 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1049/2128] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:57.657215 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c43d3-60de-441a-a853-9d79a76f3e5d admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:57.665316 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-75b14389-ec45-4fbc-b0cf-b594c822d99c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b47f224fc14243b0a0b69dc21d3dcb8b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:57.666853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c43d3-60de-441a-a853-9d79a76f3e5d admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.671487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f966f4-5a6e-410f-b8a7-e1c671e98e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.672268 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1080/2129] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:57 2022] DELETE /identity/v3/users/b47f224fc14243b0a0b69dc21d3dcb8b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:57.672385 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f966f4-5a6e-410f-b8a7-e1c671e98e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.672550 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f966f4-5a6e-410f-b8a7-e1c671e98e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.672834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f966f4-5a6e-410f-b8a7-e1c671e98e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.672996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b14389-ec45-4fbc-b0cf-b594c822d99c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:57.673582 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f966f4-5a6e-410f-b8a7-e1c671e98e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.674202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-75b14389-ec45-4fbc-b0cf-b594c822d99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:57.675553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f966f4-5a6e-410f-b8a7-e1c671e98e6c admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:57.686578 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1050/2130] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:57.687273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f966f4-5a6e-410f-b8a7-e1c671e98e6c admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:57.688914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-49f966f4-5a6e-410f-b8a7-e1c671e98e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:57.702369 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f966f4-5a6e-410f-b8a7-e1c671e98e6c admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.741279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b14389-ec45-4fbc-b0cf-b594c822d99c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.745210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85e010-cbb8-45f6-9cef-9cbb0e5e3453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.745870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85e010-cbb8-45f6-9cef-9cbb0e5e3453 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.746153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85e010-cbb8-45f6-9cef-9cbb0e5e3453 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.746432 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85e010-cbb8-45f6-9cef-9cbb0e5e3453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.748302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fc85e010-cbb8-45f6-9cef-9cbb0e5e3453 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:57.774756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c932d-ed8f-46ae-9c7f-dc75a77c1d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.775478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c932d-ed8f-46ae-9c7f-dc75a77c1d5b admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.776246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c932d-ed8f-46ae-9c7f-dc75a77c1d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.776246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c932d-ed8f-46ae-9c7f-dc75a77c1d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.776755 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c932d-ed8f-46ae-9c7f-dc75a77c1d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.778432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c932d-ed8f-46ae-9c7f-dc75a77c1d5b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:57.795458 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1051/2131] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:57.796130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c932d-ed8f-46ae-9c7f-dc75a77c1d5b admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:57.798111 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2a0c932d-ed8f-46ae-9c7f-dc75a77c1d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:57.811912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c932d-ed8f-46ae-9c7f-dc75a77c1d5b admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.817365 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2723d-373d-4dc8-a273-ae464d3d52f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.818258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2723d-373d-4dc8-a273-ae464d3d52f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.818540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2723d-373d-4dc8-a273-ae464d3d52f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.818818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2723d-373d-4dc8-a273-ae464d3d52f9 admin admin] PATH_INFO: `/v3/projects/7be42fe022534c79a9cdc9475db18993/users/5d6d8f633ebc493f9e5ca2284cd144f2/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.829646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85e010-cbb8-45f6-9cef-9cbb0e5e3453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.831394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85e010-cbb8-45f6-9cef-9cbb0e5e3453 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:57.835671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2723d-373d-4dc8-a273-ae464d3d52f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be42fe022534c79a9cdc9475db18993, user_id=5d6d8f633ebc493f9e5ca2284cd144f2, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.838888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2723d-373d-4dc8-a273-ae464d3d52f9 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:57.842362 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1081/2132] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:57.852595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85e010-cbb8-45f6-9cef-9cbb0e5e3453 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:57.862458 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1052/2133] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:57 2022] PUT /identity/v3/projects/7be42fe022534c79a9cdc9475db18993/users/5d6d8f633ebc493f9e5ca2284cd144f2/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:57.873898 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641ea00-dfcd-4cbf-9de5-368adb084c0f None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.874501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641ea00-dfcd-4cbf-9de5-368adb084c0f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.874836 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641ea00-dfcd-4cbf-9de5-368adb084c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.876521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85e010-cbb8-45f6-9cef-9cbb0e5e3453 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:57.931837 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-6641ea00-dfcd-4cbf-9de5-368adb084c0f None None] MFA Rules not processed for user `5d6d8f633ebc493f9e5ca2284cd144f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:57.933117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6641ea00-dfcd-4cbf-9de5-368adb084c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:57.955597 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d288f2-ee8b-434a-b148-f981525fa50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:57.956497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d288f2-ee8b-434a-b148-f981525fa50c admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:57.956777 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d288f2-ee8b-434a-b148-f981525fa50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:57.957113 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d288f2-ee8b-434a-b148-f981525fa50c admin admin] PATH_INFO: `/v3/projects/52cb5af3119e4f9f8fcd261460420f21/users/6a60cc6a3b194a23a0ec3253440cb1d6/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:57.963510 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:57.989938 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d288f2-ee8b-434a-b148-f981525fa50c admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cb5af3119e4f9f8fcd261460420f21, user_id=6a60cc6a3b194a23a0ec3253440cb1d6, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:57.993003 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d288f2-ee8b-434a-b148-f981525fa50c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:58.017509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1082/2134] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:57 2022] PUT /identity/v3/projects/52cb5af3119e4f9f8fcd261460420f21/users/6a60cc6a3b194a23a0ec3253440cb1d6/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:58.018358 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:58.032889 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b0f84-d8dc-4e14-9abb-3162708bf1e5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.033633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b0f84-d8dc-4e14-9abb-3162708bf1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.034120 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b0f84-d8dc-4e14-9abb-3162708bf1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.054995 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1053/2135] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:58.056328 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641ea00-dfcd-4cbf-9de5-368adb084c0f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:58.058483 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6641ea00-dfcd-4cbf-9de5-368adb084c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.082842 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641ea00-dfcd-4cbf-9de5-368adb084c0f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:58.087932 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-848b0f84-d8dc-4e14-9abb-3162708bf1e5 None None] MFA Rules not processed for user `6a60cc6a3b194a23a0ec3253440cb1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:58.089325 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-848b0f84-d8dc-4e14-9abb-3162708bf1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.164578 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e02a3-3c5b-4810-8629-d50bffa104cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:58.165588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e02a3-3c5b-4810-8629-d50bffa104cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.165878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e02a3-3c5b-4810-8629-d50bffa104cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.167301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1083/2136] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:58.167864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e02a3-3c5b-4810-8629-d50bffa104cb admin admin] PATH_INFO: `/v3/projects/75c13365e8e04cf4ba25a326aeaec0df` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.168385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b0f84-d8dc-4e14-9abb-3162708bf1e5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:58.169510 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e02a3-3c5b-4810-8629-d50bffa104cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c13365e8e04cf4ba25a326aeaec0df)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:58.169977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-848b0f84-d8dc-4e14-9abb-3162708bf1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.171832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e02a3-3c5b-4810-8629-d50bffa104cb admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:58.230282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c8e02a3-3c5b-4810-8629-d50bffa104cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c13365e8e04cf4ba25a326aeaec0df', 'request_id': 'req-4c8e02a3-3c5b-4810-8629-d50bffa104cb'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:58.243631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c8e02a3-3c5b-4810-8629-d50bffa104cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c13365e8e04cf4ba25a326aeaec0df', 'request_id': 'req-4c8e02a3-3c5b-4810-8629-d50bffa104cb'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:58.251203 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c8e02a3-3c5b-4810-8629-d50bffa104cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c13365e8e04cf4ba25a326aeaec0df', 'request_id': 'req-4c8e02a3-3c5b-4810-8629-d50bffa104cb'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:58.259742 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b0f84-d8dc-4e14-9abb-3162708bf1e5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:58.263819 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c8e02a3-3c5b-4810-8629-d50bffa104cb admin admin] The token cache is being invalidate because project 75c13365e8e04cf4ba25a326aeaec0df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:58.264396 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c8e02a3-3c5b-4810-8629-d50bffa104cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:58.265377 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4c8e02a3-3c5b-4810-8629-d50bffa104cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:58.267361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1054/2137] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:58 2022] DELETE /identity/v3/projects/75c13365e8e04cf4ba25a326aeaec0df => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:58.268269 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e02a3-3c5b-4810-8629-d50bffa104cb admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:58.269762 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4c8e02a3-3c5b-4810-8629-d50bffa104cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.333673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bce38-d144-4a74-b47f-f35d4b5394b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:58.333673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bce38-d144-4a74-b47f-f35d4b5394b7 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.333673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bce38-d144-4a74-b47f-f35d4b5394b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.333673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bce38-d144-4a74-b47f-f35d4b5394b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.334581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-666bce38-d144-4a74-b47f-f35d4b5394b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.338866 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e02a3-3c5b-4810-8629-d50bffa104cb admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:58.340857 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:58.344907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7cac-70aa-440a-ad2a-2ceeecd2cf35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:58.345635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7cac-70aa-440a-ad2a-2ceeecd2cf35 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.345938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7cac-70aa-440a-ad2a-2ceeecd2cf35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.346230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7cac-70aa-440a-ad2a-2ceeecd2cf35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.351260 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4c7b7cac-70aa-440a-ad2a-2ceeecd2cf35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.392324 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:58.399321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bce38-d144-4a74-b47f-f35d4b5394b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:58.401084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bce38-d144-4a74-b47f-f35d4b5394b7 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:58.410817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1084/2138] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:58.412148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ef63c-1d0e-41ea-9c3f-2d3f9ed3ca5b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.412438 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ef63c-1d0e-41ea-9c3f-2d3f9ed3ca5b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.412720 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ef63c-1d0e-41ea-9c3f-2d3f9ed3ca5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.418348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b7cac-70aa-440a-ad2a-2ceeecd2cf35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:58.420447 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b7cac-70aa-440a-ad2a-2ceeecd2cf35 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:58.434655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e58ef63c-1d0e-41ea-9c3f-2d3f9ed3ca5b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:58.436445 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e58ef63c-1d0e-41ea-9c3f-2d3f9ed3ca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.436960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1055/2139] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:58.437517 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7cac-70aa-440a-ad2a-2ceeecd2cf35 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:58.438874 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4c7b7cac-70aa-440a-ad2a-2ceeecd2cf35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.517666 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1085/2140] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:58.524346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70a528-e3ca-4fa0-a381-ba0d1113913a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.524679 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70a528-e3ca-4fa0-a381-ba0d1113913a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.526596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70a528-e3ca-4fa0-a381-ba0d1113913a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.533018 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7cac-70aa-440a-ad2a-2ceeecd2cf35 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:58.538473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2b64e-deb4-4310-a1f9-1108102cd39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:58.539364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2b64e-deb4-4310-a1f9-1108102cd39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.539652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2b64e-deb4-4310-a1f9-1108102cd39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.540085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2b64e-deb4-4310-a1f9-1108102cd39e admin admin] PATH_INFO: `/v3/users/866780ecedd44af8b268d846df937474` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.541502 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2b64e-deb4-4310-a1f9-1108102cd39e admin admin] RBAC: Authorizing `identity:delete_user(user_id=866780ecedd44af8b268d846df937474)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:58.543726 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2b64e-deb4-4310-a1f9-1108102cd39e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:58.563408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cd70a528-e3ca-4fa0-a381-ba0d1113913a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:58.564898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cd70a528-e3ca-4fa0-a381-ba0d1113913a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.583673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1086/2141] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:58.588003 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70a528-e3ca-4fa0-a381-ba0d1113913a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:58.600395 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70a528-e3ca-4fa0-a381-ba0d1113913a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:58.609008 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1510750-8338-4ea2-aa95-04aa5674fc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:58.609818 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1510750-8338-4ea2-aa95-04aa5674fc84 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.610101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1510750-8338-4ea2-aa95-04aa5674fc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.610379 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1510750-8338-4ea2-aa95-04aa5674fc84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.611145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1510750-8338-4ea2-aa95-04aa5674fc84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:30:58.611443 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1510750-8338-4ea2-aa95-04aa5674fc84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:58.613071 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1510750-8338-4ea2-aa95-04aa5674fc84 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:58.626301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1087/2142] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:30:58.628536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4da2b64e-deb4-4310-a1f9-1108102cd39e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '866780ecedd44af8b268d846df937474'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:58.630255 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1510750-8338-4ea2-aa95-04aa5674fc84 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:58.641330 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1510750-8338-4ea2-aa95-04aa5674fc84 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:58.648275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81326dd3-c6c4-4421-8a78-5af4f3a8b332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:58.649242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81326dd3-c6c4-4421-8a78-5af4f3a8b332 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.649539 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81326dd3-c6c4-4421-8a78-5af4f3a8b332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.649973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81326dd3-c6c4-4421-8a78-5af4f3a8b332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.650572 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81326dd3-c6c4-4421-8a78-5af4f3a8b332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:58.657207 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81326dd3-c6c4-4421-8a78-5af4f3a8b332 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:58.658458 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4da2b64e-deb4-4310-a1f9-1108102cd39e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '866780ecedd44af8b268d846df937474'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:58.659379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4da2b64e-deb4-4310-a1f9-1108102cd39e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '866780ecedd44af8b268d846df937474'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:58.676565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4da2b64e-deb4-4310-a1f9-1108102cd39e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '866780ecedd44af8b268d846df937474'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:58.694655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4da2b64e-deb4-4310-a1f9-1108102cd39e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '866780ecedd44af8b268d846df937474'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:58.704776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1088/2144] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:30:58 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:58.705487 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81326dd3-c6c4-4421-8a78-5af4f3a8b332 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:58.705893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1056/2144] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:58 2022] DELETE /identity/v3/users/866780ecedd44af8b268d846df937474 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:58.707216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-81326dd3-c6c4-4421-8a78-5af4f3a8b332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.708878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e07f68-2b25-4bd1-b32c-6f9ff14c6eaf None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.709214 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e07f68-2b25-4bd1-b32c-6f9ff14c6eaf None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.709544 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e07f68-2b25-4bd1-b32c-6f9ff14c6eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.740045 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-54e07f68-2b25-4bd1-b32c-6f9ff14c6eaf None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:58.741995 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-54e07f68-2b25-4bd1-b32c-6f9ff14c6eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.801892 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81326dd3-c6c4-4421-8a78-5af4f3a8b332 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:58.817841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:58.825491 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:58.843158 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1057/2145] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:30:58.853071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e07f68-2b25-4bd1-b32c-6f9ff14c6eaf None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:58.854989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-54e07f68-2b25-4bd1-b32c-6f9ff14c6eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:58.890666 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ab3bf-f63f-4806-8c1e-38e0e428246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:58.892464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ab3bf-f63f-4806-8c1e-38e0e428246d admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.892464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ab3bf-f63f-4806-8c1e-38e0e428246d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.892464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ab3bf-f63f-4806-8c1e-38e0e428246d admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.893101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ab3bf-f63f-4806-8c1e-38e0e428246d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:58.896212 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ab3bf-f63f-4806-8c1e-38e0e428246d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:58.936175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1089/2146] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:30:58 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:30:58.946097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ab3bf-f63f-4806-8c1e-38e0e428246d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:58.958485 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e07f68-2b25-4bd1-b32c-6f9ff14c6eaf None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:58.960942 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ab3bf-f63f-4806-8c1e-38e0e428246d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:58.966580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c698d6-2124-4f2f-b213-40784850ee0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:58.968461 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c698d6-2124-4f2f-b213-40784850ee0f service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.968809 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c698d6-2124-4f2f-b213-40784850ee0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.969355 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c698d6-2124-4f2f-b213-40784850ee0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.976234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abee7e5-6afb-42dd-ba98-96a37060920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:58.976969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abee7e5-6afb-42dd-ba98-96a37060920b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:58.977236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abee7e5-6afb-42dd-ba98-96a37060920b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:58.980295 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abee7e5-6afb-42dd-ba98-96a37060920b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:58.980820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abee7e5-6afb-42dd-ba98-96a37060920b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:58.983081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c698d6-2124-4f2f-b213-40784850ee0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:58.984721 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c698d6-2124-4f2f-b213-40784850ee0f service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:58.987277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abee7e5-6afb-42dd-ba98-96a37060920b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:58.996081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1058/2147] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:30:59.003447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1090/2148] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:30:59.007436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c698d6-2124-4f2f-b213-40784850ee0f service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:59.018980 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c698d6-2124-4f2f-b213-40784850ee0f service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:59.024713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b86162-7696-4c7d-aa81-9f8733e9249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:59.025816 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b86162-7696-4c7d-aa81-9f8733e9249d admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:59.026209 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b86162-7696-4c7d-aa81-9f8733e9249d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:59.026646 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b86162-7696-4c7d-aa81-9f8733e9249d admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:59.027580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b86162-7696-4c7d-aa81-9f8733e9249d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:59.029393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b86162-7696-4c7d-aa81-9f8733e9249d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:59.048009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1059/2149] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:30:59.052491 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abee7e5-6afb-42dd-ba98-96a37060920b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:59.080639 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abee7e5-6afb-42dd-ba98-96a37060920b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:59.087352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545550e0-3150-4f59-8953-603836c2d7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:59.088313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545550e0-3150-4f59-8953-603836c2d7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:59.088594 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545550e0-3150-4f59-8953-603836c2d7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:59.092355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545550e0-3150-4f59-8953-603836c2d7b2 admin admin] PATH_INFO: `/v3/projects/fcdcccebd2c1489a80c0db31dea00473/users/5693dd2c32db46dd8e65eed9e183f7bf/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:59.118866 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545550e0-3150-4f59-8953-603836c2d7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcdcccebd2c1489a80c0db31dea00473, user_id=5693dd2c32db46dd8e65eed9e183f7bf, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:59.127834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545550e0-3150-4f59-8953-603836c2d7b2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:59.145702 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1091/2150] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:30:59 2022] PUT /identity/v3/projects/fcdcccebd2c1489a80c0db31dea00473/users/5693dd2c32db46dd8e65eed9e183f7bf/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:59.159291 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01edd29-22cc-48a5-96a2-170c1e44d451 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:59.159528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01edd29-22cc-48a5-96a2-170c1e44d451 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:59.159608 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01edd29-22cc-48a5-96a2-170c1e44d451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:59.194358 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-a01edd29-22cc-48a5-96a2-170c1e44d451 None None] MFA Rules not processed for user `5693dd2c32db46dd8e65eed9e183f7bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:30:59.195779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a01edd29-22cc-48a5-96a2-170c1e44d451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:59.261595 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1060/2151] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:30:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:30:59.275175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545550e0-3150-4f59-8953-603836c2d7b2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:59.277083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-545550e0-3150-4f59-8953-603836c2d7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:59.301151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01edd29-22cc-48a5-96a2-170c1e44d451 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:59.302670 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a01edd29-22cc-48a5-96a2-170c1e44d451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:30:59.346399 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545550e0-3150-4f59-8953-603836c2d7b2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:59.349999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10d53e-6271-4283-9c68-fba942f92188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:59.350642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10d53e-6271-4283-9c68-fba942f92188 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:59.350923 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10d53e-6271-4283-9c68-fba942f92188 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:59.351199 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10d53e-6271-4283-9c68-fba942f92188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:59.359758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10d53e-6271-4283-9c68-fba942f92188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:59.361246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10d53e-6271-4283-9c68-fba942f92188 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:59.370204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1092/2152] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:30:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:30:59.373769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01edd29-22cc-48a5-96a2-170c1e44d451 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:59.379551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01895ac4-dc11-4631-ac18-8b58f6e1a57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:59.380496 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01895ac4-dc11-4631-ac18-8b58f6e1a57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:59.380849 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01895ac4-dc11-4631-ac18-8b58f6e1a57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:59.381240 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01895ac4-dc11-4631-ac18-8b58f6e1a57b admin admin] PATH_INFO: `/v3/projects/b4072391d71444c0a8b36187bbf4bf3c` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:59.382501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01895ac4-dc11-4631-ac18-8b58f6e1a57b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4072391d71444c0a8b36187bbf4bf3c)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:59.384512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01895ac4-dc11-4631-ac18-8b58f6e1a57b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:59.411986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:59.436163 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-01895ac4-dc11-4631-ac18-8b58f6e1a57b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4072391d71444c0a8b36187bbf4bf3c', 'request_id': 'req-01895ac4-dc11-4631-ac18-8b58f6e1a57b'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:59.443990 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-01895ac4-dc11-4631-ac18-8b58f6e1a57b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4072391d71444c0a8b36187bbf4bf3c', 'request_id': 'req-01895ac4-dc11-4631-ac18-8b58f6e1a57b'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:59.451232 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-01895ac4-dc11-4631-ac18-8b58f6e1a57b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4072391d71444c0a8b36187bbf4bf3c', 'request_id': 'req-01895ac4-dc11-4631-ac18-8b58f6e1a57b'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:59.463132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-01895ac4-dc11-4631-ac18-8b58f6e1a57b admin admin] The token cache is being invalidate because project b4072391d71444c0a8b36187bbf4bf3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:30:59.463419 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-01895ac4-dc11-4631-ac18-8b58f6e1a57b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:59.464086 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-01895ac4-dc11-4631-ac18-8b58f6e1a57b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:59.465684 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1061/2153] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:59 2022] DELETE /identity/v3/projects/b4072391d71444c0a8b36187bbf4bf3c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:30:59.470338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10d53e-6271-4283-9c68-fba942f92188 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:59.480879 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10d53e-6271-4283-9c68-fba942f92188 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:30:59.543819 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f0c66-e9ee-49d9-b805-27ded0724f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:30:59.544694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f0c66-e9ee-49d9-b805-27ded0724f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:30:59.545096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f0c66-e9ee-49d9-b805-27ded0724f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:30:59.545394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f0c66-e9ee-49d9-b805-27ded0724f9c admin admin] PATH_INFO: `/v3/users/443081f003c34d0591e3e54e1a6110be` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:30:59.546564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f0c66-e9ee-49d9-b805-27ded0724f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=443081f003c34d0591e3e54e1a6110be)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:30:59.548626 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f0c66-e9ee-49d9-b805-27ded0724f9c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:30:59.562499 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:59.604373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e47f0c66-e9ee-49d9-b805-27ded0724f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443081f003c34d0591e3e54e1a6110be'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:59.617659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e47f0c66-e9ee-49d9-b805-27ded0724f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443081f003c34d0591e3e54e1a6110be'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:59.632076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e47f0c66-e9ee-49d9-b805-27ded0724f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443081f003c34d0591e3e54e1a6110be'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:59.633422 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e47f0c66-e9ee-49d9-b805-27ded0724f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443081f003c34d0591e3e54e1a6110be'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:59.643357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e47f0c66-e9ee-49d9-b805-27ded0724f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443081f003c34d0591e3e54e1a6110be'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:30:59.653040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1093/2154] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:30:59 2022] DELETE /identity/v3/users/443081f003c34d0591e3e54e1a6110be => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:30:59.975257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01895ac4-dc11-4631-ac18-8b58f6e1a57b admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:30:59.977032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-01895ac4-dc11-4631-ac18-8b58f6e1a57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:00.000762 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01895ac4-dc11-4631-ac18-8b58f6e1a57b admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:00.077136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84451bb-5d0a-4c62-b828-0535783a9bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:00.077886 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84451bb-5d0a-4c62-b828-0535783a9bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:00.078155 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84451bb-5d0a-4c62-b828-0535783a9bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:00.078509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84451bb-5d0a-4c62-b828-0535783a9bf1 admin admin] PATH_INFO: `/v3/projects/170ef438c2004d539d6307a32c67e923` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:00.079822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84451bb-5d0a-4c62-b828-0535783a9bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=170ef438c2004d539d6307a32c67e923)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:00.081767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84451bb-5d0a-4c62-b828-0535783a9bf1 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:00.132258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c84451bb-5d0a-4c62-b828-0535783a9bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '170ef438c2004d539d6307a32c67e923', 'request_id': 'req-c84451bb-5d0a-4c62-b828-0535783a9bf1'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:00.141936 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c84451bb-5d0a-4c62-b828-0535783a9bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '170ef438c2004d539d6307a32c67e923', 'request_id': 'req-c84451bb-5d0a-4c62-b828-0535783a9bf1'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:00.149218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c84451bb-5d0a-4c62-b828-0535783a9bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '170ef438c2004d539d6307a32c67e923', 'request_id': 'req-c84451bb-5d0a-4c62-b828-0535783a9bf1'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:00.164342 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c84451bb-5d0a-4c62-b828-0535783a9bf1 admin admin] The token cache is being invalidate because project 170ef438c2004d539d6307a32c67e923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:31:00.164823 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c84451bb-5d0a-4c62-b828-0535783a9bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:00.165638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c84451bb-5d0a-4c62-b828-0535783a9bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:00.167325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1062/2155] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:30:59 2022] DELETE /identity/v3/projects/170ef438c2004d539d6307a32c67e923 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:00.173222 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9230ee-86f4-4b9e-bb04-45bb848c16d2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:00.173603 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9230ee-86f4-4b9e-bb04-45bb848c16d2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:00.173973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9230ee-86f4-4b9e-bb04-45bb848c16d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:00.200317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0b9230ee-86f4-4b9e-bb04-45bb848c16d2 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:00.201922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0b9230ee-86f4-4b9e-bb04-45bb848c16d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:00.276330 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1094/2156] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:00.284910 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b11365-972e-47b3-bf17-284ee2e884a5 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:00.285236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b11365-972e-47b3-bf17-284ee2e884a5 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:00.285531 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b11365-972e-47b3-bf17-284ee2e884a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:00.306082 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-f4b11365-972e-47b3-bf17-284ee2e884a5 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:00.308061 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f4b11365-972e-47b3-bf17-284ee2e884a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:00.318522 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1063/2157] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:00.323328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9230ee-86f4-4b9e-bb04-45bb848c16d2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:00.334178 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9230ee-86f4-4b9e-bb04-45bb848c16d2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:00.339051 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34f2c7-8e3d-4c35-a1bb-a2a322ee79b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:00.339810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34f2c7-8e3d-4c35-a1bb-a2a322ee79b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:00.340385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34f2c7-8e3d-4c35-a1bb-a2a322ee79b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:00.340821 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34f2c7-8e3d-4c35-a1bb-a2a322ee79b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:00.342407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34f2c7-8e3d-4c35-a1bb-a2a322ee79b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:31:00.342908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34f2c7-8e3d-4c35-a1bb-a2a322ee79b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:00.344881 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34f2c7-8e3d-4c35-a1bb-a2a322ee79b9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:00.362156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1095/2158] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:31:00.362727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b11365-972e-47b3-bf17-284ee2e884a5 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:00.372369 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b11365-972e-47b3-bf17-284ee2e884a5 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:00.380152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406ce30-0069-45d3-9bd6-c8872a634234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:00.380884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406ce30-0069-45d3-9bd6-c8872a634234 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:00.381205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406ce30-0069-45d3-9bd6-c8872a634234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:00.381649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406ce30-0069-45d3-9bd6-c8872a634234 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:00.382380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406ce30-0069-45d3-9bd6-c8872a634234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:00.384514 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406ce30-0069-45d3-9bd6-c8872a634234 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:00.429823 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1064/2159] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:31:00 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:00.431023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34f2c7-8e3d-4c35-a1bb-a2a322ee79b9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:00.442495 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34f2c7-8e3d-4c35-a1bb-a2a322ee79b9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:00.521395 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb5055-c452-4443-9051-708c0fffadb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:00.522183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb5055-c452-4443-9051-708c0fffadb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:00.522546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb5055-c452-4443-9051-708c0fffadb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:00.522935 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb5055-c452-4443-9051-708c0fffadb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:00.523604 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb5055-c452-4443-9051-708c0fffadb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:00.525595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb5055-c452-4443-9051-708c0fffadb8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:00.554077 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1096/2160] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:31:00 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:31:00.555357 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406ce30-0069-45d3-9bd6-c8872a634234 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:00.566842 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406ce30-0069-45d3-9bd6-c8872a634234 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:00.572268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bde78-4d29-426f-becc-7e8d5f9a600e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:00.573146 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bde78-4d29-426f-becc-7e8d5f9a600e admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:00.573467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bde78-4d29-426f-becc-7e8d5f9a600e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:00.573744 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bde78-4d29-426f-becc-7e8d5f9a600e admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:00.574562 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bde78-4d29-426f-becc-7e8d5f9a600e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:00.576796 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bde78-4d29-426f-becc-7e8d5f9a600e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:00.583195 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:00.589818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1065/2161] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:00.593728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb5055-c452-4443-9051-708c0fffadb8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:00.604379 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb5055-c452-4443-9051-708c0fffadb8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:00.609947 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3525e2e-4cba-403a-a7b5-66747066be3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:00.610815 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3525e2e-4cba-403a-a7b5-66747066be3c admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:00.611122 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3525e2e-4cba-403a-a7b5-66747066be3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:00.611395 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3525e2e-4cba-403a-a7b5-66747066be3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:00.612119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3525e2e-4cba-403a-a7b5-66747066be3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:00.613809 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3525e2e-4cba-403a-a7b5-66747066be3c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:00.615393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:00.633755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1097/2162] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:00.638117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bde78-4d29-426f-becc-7e8d5f9a600e admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:00.651462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bde78-4d29-426f-becc-7e8d5f9a600e admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:00.657090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106af6c-7795-4461-afd0-a69ad9a94f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:00.658006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106af6c-7795-4461-afd0-a69ad9a94f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:00.658287 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106af6c-7795-4461-afd0-a69ad9a94f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:00.658560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106af6c-7795-4461-afd0-a69ad9a94f4f admin admin] PATH_INFO: `/v3/projects/418fafe7540846f09b6a899029b2b346/users/c0e5c150001c4e60b5562467ce28af88/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:00.673605 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106af6c-7795-4461-afd0-a69ad9a94f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=418fafe7540846f09b6a899029b2b346, user_id=c0e5c150001c4e60b5562467ce28af88, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:00.678958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106af6c-7795-4461-afd0-a69ad9a94f4f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:00.695267 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1066/2163] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:00 2022] PUT /identity/v3/projects/418fafe7540846f09b6a899029b2b346/users/c0e5c150001c4e60b5562467ce28af88/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:00.768342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf20d62-ad00-469c-915b-b7a070663532 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:00.768649 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf20d62-ad00-469c-915b-b7a070663532 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:00.768893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf20d62-ad00-469c-915b-b7a070663532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:00.797887 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0cf20d62-ad00-469c-915b-b7a070663532 None None] MFA Rules not processed for user `c0e5c150001c4e60b5562467ce28af88`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:00.799132 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0cf20d62-ad00-469c-915b-b7a070663532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:00.876940 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1098/2164] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:00.888818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106af6c-7795-4461-afd0-a69ad9a94f4f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:00.890978 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0106af6c-7795-4461-afd0-a69ad9a94f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:00.962801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106af6c-7795-4461-afd0-a69ad9a94f4f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:00.967830 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7d735-54c2-4ff7-9607-278963a27824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:00.968622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7d735-54c2-4ff7-9607-278963a27824 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:00.968912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7d735-54c2-4ff7-9607-278963a27824 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:00.969218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7d735-54c2-4ff7-9607-278963a27824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:00.981079 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7d735-54c2-4ff7-9607-278963a27824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:00.983581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7d735-54c2-4ff7-9607-278963a27824 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:00.994148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1067/2165] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:31:01.804363 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf20d62-ad00-469c-915b-b7a070663532 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:01.805790 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0cf20d62-ad00-469c-915b-b7a070663532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:01.870477 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf20d62-ad00-469c-915b-b7a070663532 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:01.879392 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f42c15-988b-464a-988d-6ebefbbd3de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:01.880281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f42c15-988b-464a-988d-6ebefbbd3de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:01.880561 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f42c15-988b-464a-988d-6ebefbbd3de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:01.880834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f42c15-988b-464a-988d-6ebefbbd3de1 admin admin] PATH_INFO: `/v3/users/6a60cc6a3b194a23a0ec3253440cb1d6` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:01.882067 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f42c15-988b-464a-988d-6ebefbbd3de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a60cc6a3b194a23a0ec3253440cb1d6)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:01.884014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f42c15-988b-464a-988d-6ebefbbd3de1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:01.932467 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-43f42c15-988b-464a-988d-6ebefbbd3de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a60cc6a3b194a23a0ec3253440cb1d6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:01.945378 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-43f42c15-988b-464a-988d-6ebefbbd3de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a60cc6a3b194a23a0ec3253440cb1d6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:01.953075 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-43f42c15-988b-464a-988d-6ebefbbd3de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a60cc6a3b194a23a0ec3253440cb1d6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:01.954976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-43f42c15-988b-464a-988d-6ebefbbd3de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a60cc6a3b194a23a0ec3253440cb1d6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:01.965656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-43f42c15-988b-464a-988d-6ebefbbd3de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a60cc6a3b194a23a0ec3253440cb1d6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:01.967332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7d735-54c2-4ff7-9607-278963a27824 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:01.968828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-07f7d735-54c2-4ff7-9607-278963a27824 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:01.975045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1099/2166] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:31:01 2022] DELETE /identity/v3/users/6a60cc6a3b194a23a0ec3253440cb1d6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:01.979415 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e169093-716b-46b2-8948-435f68e91e44 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:01.979713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e169093-716b-46b2-8948-435f68e91e44 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:01.979995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e169093-716b-46b2-8948-435f68e91e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:01.983268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7d735-54c2-4ff7-9607-278963a27824 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:01.986445 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:01.998956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5e169093-716b-46b2-8948-435f68e91e44 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:02.000275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5e169093-716b-46b2-8948-435f68e91e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:02.044065 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e90518-d68c-4189-8372-b804b29198e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:02.045015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e90518-d68c-4189-8372-b804b29198e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:02.045302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e90518-d68c-4189-8372-b804b29198e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:02.045577 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e90518-d68c-4189-8372-b804b29198e1 admin admin] PATH_INFO: `/v3/users/5693dd2c32db46dd8e65eed9e183f7bf` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:02.046918 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e90518-d68c-4189-8372-b804b29198e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5693dd2c32db46dd8e65eed9e183f7bf)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:02.048914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e90518-d68c-4189-8372-b804b29198e1 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:02.077704 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1100/2167] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:31:02.085770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e169093-716b-46b2-8948-435f68e91e44 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:02.087329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5e169093-716b-46b2-8948-435f68e91e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:02.137846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a6e90518-d68c-4189-8372-b804b29198e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5693dd2c32db46dd8e65eed9e183f7bf'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:02.146503 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a6e90518-d68c-4189-8372-b804b29198e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5693dd2c32db46dd8e65eed9e183f7bf'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:02.147273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a6e90518-d68c-4189-8372-b804b29198e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5693dd2c32db46dd8e65eed9e183f7bf'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:02.160082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e169093-716b-46b2-8948-435f68e91e44 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:02.164258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd9682-77c2-488c-afd6-91d3933be110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:02.164913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd9682-77c2-488c-afd6-91d3933be110 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:02.165275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd9682-77c2-488c-afd6-91d3933be110 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:02.165638 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd9682-77c2-488c-afd6-91d3933be110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:02.165897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a6e90518-d68c-4189-8372-b804b29198e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5693dd2c32db46dd8e65eed9e183f7bf'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:02.176379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a6e90518-d68c-4189-8372-b804b29198e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5693dd2c32db46dd8e65eed9e183f7bf'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:02.178079 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:02.179587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd9682-77c2-488c-afd6-91d3933be110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:02.181498 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd9682-77c2-488c-afd6-91d3933be110 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:02.184194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1068/2168] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:31:01 2022] DELETE /identity/v3/users/5693dd2c32db46dd8e65eed9e183f7bf => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:31:02.188746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc614aca-2600-4d92-9f51-1953ce07533b None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:02.189544 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc614aca-2600-4d92-9f51-1953ce07533b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:02.190089 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc614aca-2600-4d92-9f51-1953ce07533b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:02.194381 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1101/2169] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:02.211171 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-bc614aca-2600-4d92-9f51-1953ce07533b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:02.212798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-bc614aca-2600-4d92-9f51-1953ce07533b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:02.288399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1069/2170] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:31:02.298592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd9682-77c2-488c-afd6-91d3933be110 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:02.300046 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bebd9682-77c2-488c-afd6-91d3933be110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:02.313838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd9682-77c2-488c-afd6-91d3933be110 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:02.385963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18773570-0aad-437c-85ac-21959311d61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:02.386608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18773570-0aad-437c-85ac-21959311d61e service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:02.386897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18773570-0aad-437c-85ac-21959311d61e service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:02.387173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18773570-0aad-437c-85ac-21959311d61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:02.402657 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18773570-0aad-437c-85ac-21959311d61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:02.404888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18773570-0aad-437c-85ac-21959311d61e service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:02.417613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1102/2171] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:31:02.561972 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc614aca-2600-4d92-9f51-1953ce07533b None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:02.563506 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-bc614aca-2600-4d92-9f51-1953ce07533b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:02.578043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc614aca-2600-4d92-9f51-1953ce07533b None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:02.586352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169088d-6c95-4d55-8907-25abba2122e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:02.587310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169088d-6c95-4d55-8907-25abba2122e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:02.587626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169088d-6c95-4d55-8907-25abba2122e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:02.587976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169088d-6c95-4d55-8907-25abba2122e9 admin admin] PATH_INFO: `/v3/projects/52cb5af3119e4f9f8fcd261460420f21` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:02.589364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169088d-6c95-4d55-8907-25abba2122e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52cb5af3119e4f9f8fcd261460420f21)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:02.591292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169088d-6c95-4d55-8907-25abba2122e9 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:02.659846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d169088d-6c95-4d55-8907-25abba2122e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52cb5af3119e4f9f8fcd261460420f21', 'request_id': 'req-d169088d-6c95-4d55-8907-25abba2122e9'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:02.667848 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d169088d-6c95-4d55-8907-25abba2122e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52cb5af3119e4f9f8fcd261460420f21', 'request_id': 'req-d169088d-6c95-4d55-8907-25abba2122e9'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:02.675050 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d169088d-6c95-4d55-8907-25abba2122e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52cb5af3119e4f9f8fcd261460420f21', 'request_id': 'req-d169088d-6c95-4d55-8907-25abba2122e9'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:02.687877 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d169088d-6c95-4d55-8907-25abba2122e9 admin admin] The token cache is being invalidate because project 52cb5af3119e4f9f8fcd261460420f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:31:02.688270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d169088d-6c95-4d55-8907-25abba2122e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:02.689028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d169088d-6c95-4d55-8907-25abba2122e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:02.690732 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1070/2172] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:31:02 2022] DELETE /identity/v3/projects/52cb5af3119e4f9f8fcd261460420f21 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:02.698297 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f79ce-f601-4fc6-9885-00c77b4d0547 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:02.698588 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f79ce-f601-4fc6-9885-00c77b4d0547 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:02.698869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f79ce-f601-4fc6-9885-00c77b4d0547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:02.721611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fb8f79ce-f601-4fc6-9885-00c77b4d0547 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:02.723254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fb8f79ce-f601-4fc6-9885-00c77b4d0547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:02.790735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169088d-6c95-4d55-8907-25abba2122e9 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:02.793160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-d169088d-6c95-4d55-8907-25abba2122e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:02.799999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:02.836103 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1103/2173] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:02.837953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c124c-1a25-4000-8c1e-ded2aa8086a2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:02.838165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c124c-1a25-4000-8c1e-ded2aa8086a2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:02.838456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c124c-1a25-4000-8c1e-ded2aa8086a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:02.858497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-244c124c-1a25-4000-8c1e-ded2aa8086a2 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:02.859710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-244c124c-1a25-4000-8c1e-ded2aa8086a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:02.870040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1104/2174] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:31:02.873931 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c124c-1a25-4000-8c1e-ded2aa8086a2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:02.880725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169088d-6c95-4d55-8907-25abba2122e9 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:02.887213 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c124c-1a25-4000-8c1e-ded2aa8086a2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:02.891464 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1a9eb-9ceb-421c-b4fc-f6929f3c4ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:02.892348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1a9eb-9ceb-421c-b4fc-f6929f3c4ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:02.892619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ede76d-50a3-481f-9d65-4784238cb7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:02.892749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1a9eb-9ceb-421c-b4fc-f6929f3c4ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:02.892904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1a9eb-9ceb-421c-b4fc-f6929f3c4ee7 admin admin] PATH_INFO: `/v3/projects/fcdcccebd2c1489a80c0db31dea00473` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:02.893321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede76d-50a3-481f-9d65-4784238cb7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:02.893610 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede76d-50a3-481f-9d65-4784238cb7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:02.893945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede76d-50a3-481f-9d65-4784238cb7b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:02.894135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1a9eb-9ceb-421c-b4fc-f6929f3c4ee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcdcccebd2c1489a80c0db31dea00473)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:02.894675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ede76d-50a3-481f-9d65-4784238cb7b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:31:02.894989 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ede76d-50a3-481f-9d65-4784238cb7b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:02.896051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1a9eb-9ceb-421c-b4fc-f6929f3c4ee7 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:02.896577 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ede76d-50a3-481f-9d65-4784238cb7b2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:02.915117 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1105/2175] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:31:02.917911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ede76d-50a3-481f-9d65-4784238cb7b2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:02.928069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ede76d-50a3-481f-9d65-4784238cb7b2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:02.930805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:02.933970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d94eb-a202-43eb-8c23-313068ddc53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:02.934846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d94eb-a202-43eb-8c23-313068ddc53f admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:02.935166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d94eb-a202-43eb-8c23-313068ddc53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:02.935518 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d94eb-a202-43eb-8c23-313068ddc53f admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:02.936267 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d94eb-a202-43eb-8c23-313068ddc53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:02.938577 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d94eb-a202-43eb-8c23-313068ddc53f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:02.959730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-29c1a9eb-9ceb-421c-b4fc-f6929f3c4ee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcdcccebd2c1489a80c0db31dea00473', 'request_id': 'req-29c1a9eb-9ceb-421c-b4fc-f6929f3c4ee7'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:02.967608 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-29c1a9eb-9ceb-421c-b4fc-f6929f3c4ee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcdcccebd2c1489a80c0db31dea00473', 'request_id': 'req-29c1a9eb-9ceb-421c-b4fc-f6929f3c4ee7'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:02.971236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1106/2176] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:31:02 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:31:02.972592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d94eb-a202-43eb-8c23-313068ddc53f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:02.974681 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-29c1a9eb-9ceb-421c-b4fc-f6929f3c4ee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcdcccebd2c1489a80c0db31dea00473', 'request_id': 'req-29c1a9eb-9ceb-421c-b4fc-f6929f3c4ee7'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:02.990624 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-29c1a9eb-9ceb-421c-b4fc-f6929f3c4ee7 admin admin] The token cache is being invalidate because project fcdcccebd2c1489a80c0db31dea00473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:31:02.991292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-29c1a9eb-9ceb-421c-b4fc-f6929f3c4ee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:02.991836 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-29c1a9eb-9ceb-421c-b4fc-f6929f3c4ee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:02.994075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1071/2177] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:31:02 2022] DELETE /identity/v3/projects/fcdcccebd2c1489a80c0db31dea00473 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:02.998966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b14e7-6b36-4a88-94a9-283a76b63fc2 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:02.999266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b14e7-6b36-4a88-94a9-283a76b63fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:02.999547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b14e7-6b36-4a88-94a9-283a76b63fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.019562 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-6a4b14e7-6b36-4a88-94a9-283a76b63fc2 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:03.020901 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6a4b14e7-6b36-4a88-94a9-283a76b63fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:03.050154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d94eb-a202-43eb-8c23-313068ddc53f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:03.057317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c915f98-6339-4895-8c2d-e473dde9f352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:03.064179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c915f98-6339-4895-8c2d-e473dde9f352 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.064179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c915f98-6339-4895-8c2d-e473dde9f352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.064179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c915f98-6339-4895-8c2d-e473dde9f352 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.064179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c915f98-6339-4895-8c2d-e473dde9f352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:03.064179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c915f98-6339-4895-8c2d-e473dde9f352 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:03.093461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1107/2178] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:31:02 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:31:03.097456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c915f98-6339-4895-8c2d-e473dde9f352 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:03.099077 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8c915f98-6339-4895-8c2d-e473dde9f352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:03.102194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1072/2179] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:31:03.111203 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec07989-2884-49fd-81a1-5d9dc6aa009b None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.111497 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec07989-2884-49fd-81a1-5d9dc6aa009b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.111601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c915f98-6339-4895-8c2d-e473dde9f352 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:03.111782 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec07989-2884-49fd-81a1-5d9dc6aa009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.116063 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328c81c-1145-410b-84c1-0576858dc07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:03.116763 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328c81c-1145-410b-84c1-0576858dc07f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.117083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328c81c-1145-410b-84c1-0576858dc07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.117357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328c81c-1145-410b-84c1-0576858dc07f admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.118101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328c81c-1145-410b-84c1-0576858dc07f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:03.119846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328c81c-1145-410b-84c1-0576858dc07f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:03.132115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1108/2180] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:31:03.133862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-dec07989-2884-49fd-81a1-5d9dc6aa009b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:03.135161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-dec07989-2884-49fd-81a1-5d9dc6aa009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:03.136154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328c81c-1145-410b-84c1-0576858dc07f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:03.144202 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1073/2181] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:31:03.147090 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328c81c-1145-410b-84c1-0576858dc07f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:03.148265 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec07989-2884-49fd-81a1-5d9dc6aa009b None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:03.152411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db69abf-3ee7-44fb-a7d9-8ce56f2f63db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:03.153111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db69abf-3ee7-44fb-a7d9-8ce56f2f63db admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.153402 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db69abf-3ee7-44fb-a7d9-8ce56f2f63db admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.153676 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db69abf-3ee7-44fb-a7d9-8ce56f2f63db admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.156936 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db69abf-3ee7-44fb-a7d9-8ce56f2f63db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:03.156936 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db69abf-3ee7-44fb-a7d9-8ce56f2f63db admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:03.158422 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec07989-2884-49fd-81a1-5d9dc6aa009b None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:03.163631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d93855-c189-401c-88c6-006cae0f3f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:03.164303 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d93855-c189-401c-88c6-006cae0f3f5d admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.164588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d93855-c189-401c-88c6-006cae0f3f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.164866 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d93855-c189-401c-88c6-006cae0f3f5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.165667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d93855-c189-401c-88c6-006cae0f3f5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:31:03.165949 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d93855-c189-401c-88c6-006cae0f3f5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:03.167528 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1109/2182] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:31:03.167811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d93855-c189-401c-88c6-006cae0f3f5d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:03.171427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db69abf-3ee7-44fb-a7d9-8ce56f2f63db admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:03.181752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1074/2183] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:31:03.182520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db69abf-3ee7-44fb-a7d9-8ce56f2f63db admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:03.187026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d93855-c189-401c-88c6-006cae0f3f5d admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:03.188284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c69e2-4f11-4f70-a40f-847316821155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:03.189415 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c69e2-4f11-4f70-a40f-847316821155 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.189867 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c69e2-4f11-4f70-a40f-847316821155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.190154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c69e2-4f11-4f70-a40f-847316821155 admin admin] PATH_INFO: `/v3/projects/09d3e4a826704bbcb21602b97532b8a0/users/291bbfd399314cb6b9d7af01fcc0d31b/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.196817 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d93855-c189-401c-88c6-006cae0f3f5d admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:03.201623 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947c2fd-1b4d-4605-8230-375d2a990907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:03.202268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947c2fd-1b4d-4605-8230-375d2a990907 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.202559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947c2fd-1b4d-4605-8230-375d2a990907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.202834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947c2fd-1b4d-4605-8230-375d2a990907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.204006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947c2fd-1b4d-4605-8230-375d2a990907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:03.205885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c69e2-4f11-4f70-a40f-847316821155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d3e4a826704bbcb21602b97532b8a0, user_id=291bbfd399314cb6b9d7af01fcc0d31b, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:03.205998 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947c2fd-1b4d-4605-8230-375d2a990907 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:03.208525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c69e2-4f11-4f70-a40f-847316821155 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:03.222925 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1110/2184] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:03 2022] PUT /identity/v3/projects/09d3e4a826704bbcb21602b97532b8a0/users/291bbfd399314cb6b9d7af01fcc0d31b/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:31:03.228261 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f8079-a92c-4562-bf7d-014887087ba1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.228555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f8079-a92c-4562-bf7d-014887087ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.228831 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f8079-a92c-4562-bf7d-014887087ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.233384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1075/2185] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:31:03 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:31:03.237566 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947c2fd-1b4d-4605-8230-375d2a990907 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:03.246800 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-da8f8079-a92c-4562-bf7d-014887087ba1 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:03.248537 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-da8f8079-a92c-4562-bf7d-014887087ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:03.299455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:03.319302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947c2fd-1b4d-4605-8230-375d2a990907 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:03.320963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1111/2186] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:03.325636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3896a-9ef7-4462-8953-8522db694918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:03.326962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3896a-9ef7-4462-8953-8522db694918 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.327255 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3896a-9ef7-4462-8953-8522db694918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.327521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3896a-9ef7-4462-8953-8522db694918 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.328221 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3896a-9ef7-4462-8953-8522db694918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:03.330160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3896a-9ef7-4462-8953-8522db694918 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:03.346831 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f8079-a92c-4562-bf7d-014887087ba1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:03.347958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:03.348203 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-da8f8079-a92c-4562-bf7d-014887087ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:03.357974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1076/2187] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:31:03 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:31:03.359636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3896a-9ef7-4462-8953-8522db694918 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:03.371256 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3896a-9ef7-4462-8953-8522db694918 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:03.375971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66bd87-596a-4751-9236-21a074ef30bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:03.376633 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66bd87-596a-4751-9236-21a074ef30bd admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.376916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66bd87-596a-4751-9236-21a074ef30bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.377231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66bd87-596a-4751-9236-21a074ef30bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.377960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66bd87-596a-4751-9236-21a074ef30bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:03.379544 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66bd87-596a-4751-9236-21a074ef30bd admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:03.392978 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1077/2188] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:03.395674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66bd87-596a-4751-9236-21a074ef30bd admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:03.406583 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66bd87-596a-4751-9236-21a074ef30bd admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:03.413214 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7951e86-6169-4739-9ff8-5a90dde8ff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:03.414112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f8079-a92c-4562-bf7d-014887087ba1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:03.414723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7951e86-6169-4739-9ff8-5a90dde8ff15 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.415252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7951e86-6169-4739-9ff8-5a90dde8ff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.415760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7951e86-6169-4739-9ff8-5a90dde8ff15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.417202 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7951e86-6169-4739-9ff8-5a90dde8ff15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:03.417943 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afe0b7-b31f-4949-9eb6-54e648113867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:03.418589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afe0b7-b31f-4949-9eb6-54e648113867 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.419208 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afe0b7-b31f-4949-9eb6-54e648113867 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.419208 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afe0b7-b31f-4949-9eb6-54e648113867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.420385 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7951e86-6169-4739-9ff8-5a90dde8ff15 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:03.430685 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afe0b7-b31f-4949-9eb6-54e648113867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:03.432121 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afe0b7-b31f-4949-9eb6-54e648113867 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:03.441087 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1078/2189] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:03.442537 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1112/2190] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:31:03.449718 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7951e86-6169-4739-9ff8-5a90dde8ff15 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:03.460160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7951e86-6169-4739-9ff8-5a90dde8ff15 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:03.464733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2157c-2321-4df0-8181-6153608d0038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:03.465711 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2157c-2321-4df0-8181-6153608d0038 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.466026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2157c-2321-4df0-8181-6153608d0038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.466306 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2157c-2321-4df0-8181-6153608d0038 admin admin] PATH_INFO: `/v3/projects/ef2b6916aadb417aa27ff2b30f3312df/users/9d3040d82a814912a3dfeef27739b573/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.482671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2157c-2321-4df0-8181-6153608d0038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2b6916aadb417aa27ff2b30f3312df, user_id=9d3040d82a814912a3dfeef27739b573, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:03.485417 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2157c-2321-4df0-8181-6153608d0038 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:03.498815 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1079/2191] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:03 2022] PUT /identity/v3/projects/ef2b6916aadb417aa27ff2b30f3312df/users/9d3040d82a814912a3dfeef27739b573/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:03.503902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628502b-d0f3-40ab-b947-0df3defc5156 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.506150 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628502b-d0f3-40ab-b947-0df3defc5156 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.506499 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628502b-d0f3-40ab-b947-0df3defc5156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.529777 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1628502b-d0f3-40ab-b947-0df3defc5156 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:03.531389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1628502b-d0f3-40ab-b947-0df3defc5156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:03.615301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1113/2192] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:03.637659 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2157c-2321-4df0-8181-6153608d0038 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:03.640511 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f3c2157c-2321-4df0-8181-6153608d0038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:03.724021 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2157c-2321-4df0-8181-6153608d0038 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:03.736131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00cf75-0a5a-442b-b648-374424ff516c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:03.748557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00cf75-0a5a-442b-b648-374424ff516c service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:03.748861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00cf75-0a5a-442b-b648-374424ff516c service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:03.752543 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00cf75-0a5a-442b-b648-374424ff516c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:03.772032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00cf75-0a5a-442b-b648-374424ff516c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:03.773644 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00cf75-0a5a-442b-b648-374424ff516c service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:03.785022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1080/2193] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:04.082413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628502b-d0f3-40ab-b947-0df3defc5156 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:04.084851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1628502b-d0f3-40ab-b947-0df3defc5156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:04.102682 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628502b-d0f3-40ab-b947-0df3defc5156 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:04.109245 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c950af-9cf0-411b-b891-4357624914fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:04.110373 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c950af-9cf0-411b-b891-4357624914fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:04.110931 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c950af-9cf0-411b-b891-4357624914fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:04.111615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c950af-9cf0-411b-b891-4357624914fa admin admin] PATH_INFO: `/v3/users/5d6d8f633ebc493f9e5ca2284cd144f2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:04.113279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c950af-9cf0-411b-b891-4357624914fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6d8f633ebc493f9e5ca2284cd144f2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:04.115523 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c950af-9cf0-411b-b891-4357624914fa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:04.180732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-83c950af-9cf0-411b-b891-4357624914fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6d8f633ebc493f9e5ca2284cd144f2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:04.200408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-83c950af-9cf0-411b-b891-4357624914fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6d8f633ebc493f9e5ca2284cd144f2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:04.210553 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-83c950af-9cf0-411b-b891-4357624914fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6d8f633ebc493f9e5ca2284cd144f2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:04.211310 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-83c950af-9cf0-411b-b891-4357624914fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6d8f633ebc493f9e5ca2284cd144f2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:04.223952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-83c950af-9cf0-411b-b891-4357624914fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6d8f633ebc493f9e5ca2284cd144f2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:04.237233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1114/2194] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:31:04 2022] DELETE /identity/v3/users/5d6d8f633ebc493f9e5ca2284cd144f2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:04.241866 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59e1f2-72c4-49c9-91e5-876051a1a597 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:04.242339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59e1f2-72c4-49c9-91e5-876051a1a597 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:04.242431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59e1f2-72c4-49c9-91e5-876051a1a597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:04.265190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-7b59e1f2-72c4-49c9-91e5-876051a1a597 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:04.266429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-7b59e1f2-72c4-49c9-91e5-876051a1a597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:04.336159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1081/2195] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:04.349251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c950af-9cf0-411b-b891-4357624914fa admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:04.353535 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-83c950af-9cf0-411b-b891-4357624914fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:04.369780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:04.431827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c950af-9cf0-411b-b891-4357624914fa admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:04.438648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205487cb-1523-4236-a6a1-b08eda43abb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:04.439656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205487cb-1523-4236-a6a1-b08eda43abb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:04.440316 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205487cb-1523-4236-a6a1-b08eda43abb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:04.440609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205487cb-1523-4236-a6a1-b08eda43abb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:04.455936 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205487cb-1523-4236-a6a1-b08eda43abb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:04.462532 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205487cb-1523-4236-a6a1-b08eda43abb1 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:04.490481 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1115/2196] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:04.897973 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59e1f2-72c4-49c9-91e5-876051a1a597 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:04.899560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-7b59e1f2-72c4-49c9-91e5-876051a1a597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:04.918931 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59e1f2-72c4-49c9-91e5-876051a1a597 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:04.925734 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99458750-e3ba-41e2-8487-cac7bfd2e308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:04.927185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99458750-e3ba-41e2-8487-cac7bfd2e308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:04.927546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99458750-e3ba-41e2-8487-cac7bfd2e308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:04.927816 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99458750-e3ba-41e2-8487-cac7bfd2e308 admin admin] PATH_INFO: `/v3/projects/7be42fe022534c79a9cdc9475db18993` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:04.929920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99458750-e3ba-41e2-8487-cac7bfd2e308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7be42fe022534c79a9cdc9475db18993)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:04.932752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99458750-e3ba-41e2-8487-cac7bfd2e308 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:05.015072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-99458750-e3ba-41e2-8487-cac7bfd2e308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be42fe022534c79a9cdc9475db18993', 'request_id': 'req-99458750-e3ba-41e2-8487-cac7bfd2e308'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:05.018909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:05.026315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-99458750-e3ba-41e2-8487-cac7bfd2e308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be42fe022534c79a9cdc9475db18993', 'request_id': 'req-99458750-e3ba-41e2-8487-cac7bfd2e308'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:05.038264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-99458750-e3ba-41e2-8487-cac7bfd2e308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be42fe022534c79a9cdc9475db18993', 'request_id': 'req-99458750-e3ba-41e2-8487-cac7bfd2e308'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:05.056522 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-99458750-e3ba-41e2-8487-cac7bfd2e308 admin admin] The token cache is being invalidate because project 7be42fe022534c79a9cdc9475db18993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:31:05.056522 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-99458750-e3ba-41e2-8487-cac7bfd2e308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:05.056522 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-99458750-e3ba-41e2-8487-cac7bfd2e308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:05.058612 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1082/2197] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:31:04 2022] DELETE /identity/v3/projects/7be42fe022534c79a9cdc9475db18993 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:05.063574 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c95f4d-150b-4ea4-893a-1d3e12f70dcb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:05.064625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c95f4d-150b-4ea4-893a-1d3e12f70dcb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:05.064625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c95f4d-150b-4ea4-893a-1d3e12f70dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:05.095614 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b4c95f4d-150b-4ea4-893a-1d3e12f70dcb None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:05.096843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b4c95f4d-150b-4ea4-893a-1d3e12f70dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:05.168814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1116/2198] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:05.177042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616e3b5-955a-4f59-abd3-bf0d4d97bbe5 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:05.177486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616e3b5-955a-4f59-abd3-bf0d4d97bbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:05.177770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616e3b5-955a-4f59-abd3-bf0d4d97bbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:05.200002 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-7616e3b5-955a-4f59-abd3-bf0d4d97bbe5 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:05.202314 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-7616e3b5-955a-4f59-abd3-bf0d4d97bbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:05.212173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1083/2199] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:31:05.216581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c95f4d-150b-4ea4-893a-1d3e12f70dcb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:05.229014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c95f4d-150b-4ea4-893a-1d3e12f70dcb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:05.235881 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea3c7d-6d64-464f-8d2f-bc925ed2d64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:05.236834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea3c7d-6d64-464f-8d2f-bc925ed2d64c admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:05.238226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea3c7d-6d64-464f-8d2f-bc925ed2d64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:05.238730 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea3c7d-6d64-464f-8d2f-bc925ed2d64c admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:05.239646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea3c7d-6d64-464f-8d2f-bc925ed2d64c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:31:05.240067 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea3c7d-6d64-464f-8d2f-bc925ed2d64c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:05.242131 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea3c7d-6d64-464f-8d2f-bc925ed2d64c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:05.261155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1117/2200] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:31:05.263156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616e3b5-955a-4f59-abd3-bf0d4d97bbe5 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:05.278017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616e3b5-955a-4f59-abd3-bf0d4d97bbe5 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:05.286426 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59b5cc-8068-4ff9-9f4e-a73d7b82ccf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:05.287690 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59b5cc-8068-4ff9-9f4e-a73d7b82ccf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:05.288314 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59b5cc-8068-4ff9-9f4e-a73d7b82ccf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:05.288824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59b5cc-8068-4ff9-9f4e-a73d7b82ccf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:05.290312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59b5cc-8068-4ff9-9f4e-a73d7b82ccf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:05.293293 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59b5cc-8068-4ff9-9f4e-a73d7b82ccf0 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:05.330918 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1084/2201] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:31:05 2022] POST /identity/v3/projects => generated 363 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:05.335130 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea3c7d-6d64-464f-8d2f-bc925ed2d64c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:05.348489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea3c7d-6d64-464f-8d2f-bc925ed2d64c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:05.445383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b1e84-d644-40ef-938b-3d85fdaf1420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:05.446220 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b1e84-d644-40ef-938b-3d85fdaf1420 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:05.446514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b1e84-d644-40ef-938b-3d85fdaf1420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:05.446793 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b1e84-d644-40ef-938b-3d85fdaf1420 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:05.447581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b1e84-d644-40ef-938b-3d85fdaf1420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:05.449946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b1e84-d644-40ef-938b-3d85fdaf1420 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:05.478880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1118/2202] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:31:05 2022] POST /identity/v3/users => generated 282 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:05.483436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59b5cc-8068-4ff9-9f4e-a73d7b82ccf0 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:05.499694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59b5cc-8068-4ff9-9f4e-a73d7b82ccf0 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:05.508974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a112590-a115-49a5-95c2-b3bb943e1790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:05.509673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a112590-a115-49a5-95c2-b3bb943e1790 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:05.509971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a112590-a115-49a5-95c2-b3bb943e1790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:05.510243 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a112590-a115-49a5-95c2-b3bb943e1790 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:05.510986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a112590-a115-49a5-95c2-b3bb943e1790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:05.512835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a112590-a115-49a5-95c2-b3bb943e1790 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:05.527384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1085/2203] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:05.531728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b1e84-d644-40ef-938b-3d85fdaf1420 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:05.543123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b1e84-d644-40ef-938b-3d85fdaf1420 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:05.549367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ba8b7-b8de-4895-ab65-546093a57833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:05.550132 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ba8b7-b8de-4895-ab65-546093a57833 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:05.550512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ba8b7-b8de-4895-ab65-546093a57833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:05.550888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ba8b7-b8de-4895-ab65-546093a57833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:05.556797 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ba8b7-b8de-4895-ab65-546093a57833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:05.558490 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ba8b7-b8de-4895-ab65-546093a57833 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:05.570894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1119/2204] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:05.575233 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a112590-a115-49a5-95c2-b3bb943e1790 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:05.595282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a112590-a115-49a5-95c2-b3bb943e1790 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:05.601145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce474d-8fa3-4d7a-bbe3-1f938ac39dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:05.602457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce474d-8fa3-4d7a-bbe3-1f938ac39dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:05.602752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce474d-8fa3-4d7a-bbe3-1f938ac39dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:05.603130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce474d-8fa3-4d7a-bbe3-1f938ac39dc6 admin admin] PATH_INFO: `/v3/projects/57834c1db62941edb859f0258e2a1c8b/users/d2947510ba1c451cba3657e8699c7b94/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:05.643133 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce474d-8fa3-4d7a-bbe3-1f938ac39dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57834c1db62941edb859f0258e2a1c8b, user_id=d2947510ba1c451cba3657e8699c7b94, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:05.651669 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce474d-8fa3-4d7a-bbe3-1f938ac39dc6 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:05.691342 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1086/2205] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:05 2022] PUT /identity/v3/projects/57834c1db62941edb859f0258e2a1c8b/users/d2947510ba1c451cba3657e8699c7b94/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:31:05.703871 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ebb68-33f4-4468-be1c-e3b18b0b26c2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:05.704174 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ebb68-33f4-4468-be1c-e3b18b0b26c2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:05.704632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ebb68-33f4-4468-be1c-e3b18b0b26c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:05.764597 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-073ebb68-33f4-4468-be1c-e3b18b0b26c2 None None] MFA Rules not processed for user `d2947510ba1c451cba3657e8699c7b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:05.766003 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-073ebb68-33f4-4468-be1c-e3b18b0b26c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:05.778353 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:05.933339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1120/2206] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:05.937666 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce474d-8fa3-4d7a-bbe3-1f938ac39dc6 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:06.094627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce474d-8fa3-4d7a-bbe3-1f938ac39dc6 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:06.124501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75703836-52ed-4bb4-8336-e56b41e20a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:06.125405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75703836-52ed-4bb4-8336-e56b41e20a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:06.126781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75703836-52ed-4bb4-8336-e56b41e20a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:06.127142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75703836-52ed-4bb4-8336-e56b41e20a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:06.127958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75703836-52ed-4bb4-8336-e56b41e20a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:06.130896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75703836-52ed-4bb4-8336-e56b41e20a57 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:06.199553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1087/2207] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:31:05 2022] POST /identity/v3/projects => generated 363 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:31:06.204697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ebb68-33f4-4468-be1c-e3b18b0b26c2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:06.222285 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ebb68-33f4-4468-be1c-e3b18b0b26c2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:06.407136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871d91a-65ee-4703-bfb4-a36f96f65182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:06.407845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871d91a-65ee-4703-bfb4-a36f96f65182 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:06.408132 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871d91a-65ee-4703-bfb4-a36f96f65182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:06.408409 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871d91a-65ee-4703-bfb4-a36f96f65182 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:06.409151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871d91a-65ee-4703-bfb4-a36f96f65182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:06.411129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871d91a-65ee-4703-bfb4-a36f96f65182 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:06.467986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75703836-52ed-4bb4-8336-e56b41e20a57 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:06.469109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1121/2208] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:31:06 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:06.486645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75703836-52ed-4bb4-8336-e56b41e20a57 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:06.501916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f2f96-fe74-4d66-908f-773d9c102083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:06.508044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f2f96-fe74-4d66-908f-773d9c102083 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:06.508337 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f2f96-fe74-4d66-908f-773d9c102083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:06.508608 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f2f96-fe74-4d66-908f-773d9c102083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:06.510433 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f2f96-fe74-4d66-908f-773d9c102083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:06.512090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f2f96-fe74-4d66-908f-773d9c102083 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:06.558724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1088/2209] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:31:06.563056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871d91a-65ee-4703-bfb4-a36f96f65182 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:06.583889 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871d91a-65ee-4703-bfb4-a36f96f65182 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:06.590197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03034033-b05b-4ed7-8492-357b6f37fad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:06.591324 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034033-b05b-4ed7-8492-357b6f37fad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:06.592133 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034033-b05b-4ed7-8492-357b6f37fad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:06.592541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034033-b05b-4ed7-8492-357b6f37fad7 admin admin] PATH_INFO: `/v3/projects/d998c81cc2854dd9bbdecb3d0d4ad46e/users/b3bf3e7ac9b44979bc176801cda5e26b/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:06.613723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03034033-b05b-4ed7-8492-357b6f37fad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d998c81cc2854dd9bbdecb3d0d4ad46e, user_id=b3bf3e7ac9b44979bc176801cda5e26b, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:06.617081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03034033-b05b-4ed7-8492-357b6f37fad7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:06.637363 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1122/2210] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:06 2022] PUT /identity/v3/projects/d998c81cc2854dd9bbdecb3d0d4ad46e/users/b3bf3e7ac9b44979bc176801cda5e26b/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:06.641143 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f2f96-fe74-4d66-908f-773d9c102083 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:06.656078 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f2f96-fe74-4d66-908f-773d9c102083 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:06.735251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:06.751273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec855dda-cd84-4fdf-8ffd-51391bf2a382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:06.752218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec855dda-cd84-4fdf-8ffd-51391bf2a382 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:06.752578 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec855dda-cd84-4fdf-8ffd-51391bf2a382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:06.752982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec855dda-cd84-4fdf-8ffd-51391bf2a382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:06.753988 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec855dda-cd84-4fdf-8ffd-51391bf2a382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:06.757811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec855dda-cd84-4fdf-8ffd-51391bf2a382 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:06.777983 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1089/2211] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:31:06.783880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03034033-b05b-4ed7-8492-357b6f37fad7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:06.800706 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03034033-b05b-4ed7-8492-357b6f37fad7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:06.806554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60f5cc-4b79-4c10-b0a4-10ef8de01dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:06.807954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60f5cc-4b79-4c10-b0a4-10ef8de01dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:06.808204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60f5cc-4b79-4c10-b0a4-10ef8de01dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:06.808616 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60f5cc-4b79-4c10-b0a4-10ef8de01dfa admin admin] PATH_INFO: `/v3/projects/d998c81cc2854dd9bbdecb3d0d4ad46e/users/b3bf3e7ac9b44979bc176801cda5e26b/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:06.815234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60f5cc-4b79-4c10-b0a4-10ef8de01dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d998c81cc2854dd9bbdecb3d0d4ad46e, user_id=b3bf3e7ac9b44979bc176801cda5e26b, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:06.818101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60f5cc-4b79-4c10-b0a4-10ef8de01dfa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:06.841245 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1123/2212] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:06 2022] PUT /identity/v3/projects/d998c81cc2854dd9bbdecb3d0d4ad46e/users/b3bf3e7ac9b44979bc176801cda5e26b/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:06.843140 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017843f0-57b7-41d3-8b78-e9daa86f53c5 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:06.843588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017843f0-57b7-41d3-8b78-e9daa86f53c5 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:06.843701 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017843f0-57b7-41d3-8b78-e9daa86f53c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:06.880857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-017843f0-57b7-41d3-8b78-e9daa86f53c5 None None] MFA Rules not processed for user `b3bf3e7ac9b44979bc176801cda5e26b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:06.883347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-017843f0-57b7-41d3-8b78-e9daa86f53c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:06.976766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1090/2213] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:06 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:31:06.992837 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60f5cc-4b79-4c10-b0a4-10ef8de01dfa admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:06.995197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8b60f5cc-4b79-4c10-b0a4-10ef8de01dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:07.142525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60f5cc-4b79-4c10-b0a4-10ef8de01dfa admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:07.147802 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626e989-8e61-4b54-950c-1abe43ce0b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:07.148514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626e989-8e61-4b54-950c-1abe43ce0b80 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:07.148803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626e989-8e61-4b54-950c-1abe43ce0b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:07.149128 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626e989-8e61-4b54-950c-1abe43ce0b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:07.165869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626e989-8e61-4b54-950c-1abe43ce0b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:07.167398 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626e989-8e61-4b54-950c-1abe43ce0b80 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:07.193732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1124/2214] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:06 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:07.801073 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017843f0-57b7-41d3-8b78-e9daa86f53c5 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:07.955571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017843f0-57b7-41d3-8b78-e9daa86f53c5 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:07.978539 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550421c7-9ca3-4ee8-9de6-7bb1b2d74a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:07.979429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550421c7-9ca3-4ee8-9de6-7bb1b2d74a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:07.984470 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550421c7-9ca3-4ee8-9de6-7bb1b2d74a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:07.985077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550421c7-9ca3-4ee8-9de6-7bb1b2d74a0e admin admin] PATH_INFO: `/v3/users/d2947510ba1c451cba3657e8699c7b94` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:07.986951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550421c7-9ca3-4ee8-9de6-7bb1b2d74a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2947510ba1c451cba3657e8699c7b94)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:07.997403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550421c7-9ca3-4ee8-9de6-7bb1b2d74a0e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:08.136735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-550421c7-9ca3-4ee8-9de6-7bb1b2d74a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2947510ba1c451cba3657e8699c7b94'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:08.161589 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-550421c7-9ca3-4ee8-9de6-7bb1b2d74a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2947510ba1c451cba3657e8699c7b94'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:08.162690 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-550421c7-9ca3-4ee8-9de6-7bb1b2d74a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2947510ba1c451cba3657e8699c7b94'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:08.212069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-550421c7-9ca3-4ee8-9de6-7bb1b2d74a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2947510ba1c451cba3657e8699c7b94'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:08.223290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:08.234722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-550421c7-9ca3-4ee8-9de6-7bb1b2d74a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2947510ba1c451cba3657e8699c7b94'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:08.244074 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1091/2215] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:31:07 2022] DELETE /identity/v3/users/d2947510ba1c451cba3657e8699c7b94 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:08.249974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2567e1-998b-46c5-a76c-f38435f38a54 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:08.250470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2567e1-998b-46c5-a76c-f38435f38a54 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:08.250848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2567e1-998b-46c5-a76c-f38435f38a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:08.273570 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:08.298963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ff2567e1-998b-46c5-a76c-f38435f38a54 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:08.300602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ff2567e1-998b-46c5-a76c-f38435f38a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:08.380113 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1125/2216] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:08.392477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550421c7-9ca3-4ee8-9de6-7bb1b2d74a0e admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:08.394303 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-550421c7-9ca3-4ee8-9de6-7bb1b2d74a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:08.512538 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550421c7-9ca3-4ee8-9de6-7bb1b2d74a0e admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:08.516544 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c92b0a-2726-4d4d-bb82-907f5e311c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:08.517869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c92b0a-2726-4d4d-bb82-907f5e311c0d service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:08.518159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c92b0a-2726-4d4d-bb82-907f5e311c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:08.518440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c92b0a-2726-4d4d-bb82-907f5e311c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:08.533333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c92b0a-2726-4d4d-bb82-907f5e311c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:08.534928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c92b0a-2726-4d4d-bb82-907f5e311c0d service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:08.547368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1092/2217] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:09.792965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2567e1-998b-46c5-a76c-f38435f38a54 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:09.794994 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ff2567e1-998b-46c5-a76c-f38435f38a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:09.822606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2567e1-998b-46c5-a76c-f38435f38a54 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:09.846925 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64854d-f260-4ab7-bdc5-2c850ce2af47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:09.847852 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64854d-f260-4ab7-bdc5-2c850ce2af47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:09.848869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64854d-f260-4ab7-bdc5-2c850ce2af47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:09.849274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64854d-f260-4ab7-bdc5-2c850ce2af47 admin admin] PATH_INFO: `/v3/projects/57834c1db62941edb859f0258e2a1c8b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:09.852532 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64854d-f260-4ab7-bdc5-2c850ce2af47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57834c1db62941edb859f0258e2a1c8b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:09.856857 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64854d-f260-4ab7-bdc5-2c850ce2af47 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:10.073658 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-af64854d-f260-4ab7-bdc5-2c850ce2af47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57834c1db62941edb859f0258e2a1c8b', 'request_id': 'req-af64854d-f260-4ab7-bdc5-2c850ce2af47'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:10.088802 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-af64854d-f260-4ab7-bdc5-2c850ce2af47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57834c1db62941edb859f0258e2a1c8b', 'request_id': 'req-af64854d-f260-4ab7-bdc5-2c850ce2af47'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:10.100012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-af64854d-f260-4ab7-bdc5-2c850ce2af47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57834c1db62941edb859f0258e2a1c8b', 'request_id': 'req-af64854d-f260-4ab7-bdc5-2c850ce2af47'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:10.125676 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-af64854d-f260-4ab7-bdc5-2c850ce2af47 admin admin] The token cache is being invalidate because project 57834c1db62941edb859f0258e2a1c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:31:10.125890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-af64854d-f260-4ab7-bdc5-2c850ce2af47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:10.128417 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-af64854d-f260-4ab7-bdc5-2c850ce2af47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:10.130357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1126/2218] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:31:09 2022] DELETE /identity/v3/projects/57834c1db62941edb859f0258e2a1c8b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:10.134477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c92b0a-2726-4d4d-bb82-907f5e311c0d service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:10.149195 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c92b0a-2726-4d4d-bb82-907f5e311c0d service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:10.295557 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3694d-ccb8-4486-a0c4-4e0781a000f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:10.296654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3694d-ccb8-4486-a0c4-4e0781a000f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:10.297138 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3694d-ccb8-4486-a0c4-4e0781a000f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:10.297556 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3694d-ccb8-4486-a0c4-4e0781a000f5 admin admin] PATH_INFO: `/v3/users/b3bf3e7ac9b44979bc176801cda5e26b` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:10.302733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3694d-ccb8-4486-a0c4-4e0781a000f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3bf3e7ac9b44979bc176801cda5e26b)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:10.304914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3694d-ccb8-4486-a0c4-4e0781a000f5 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:10.418738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-05a3694d-ccb8-4486-a0c4-4e0781a000f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3bf3e7ac9b44979bc176801cda5e26b'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:10.433650 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-05a3694d-ccb8-4486-a0c4-4e0781a000f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3bf3e7ac9b44979bc176801cda5e26b'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:10.434402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-05a3694d-ccb8-4486-a0c4-4e0781a000f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3bf3e7ac9b44979bc176801cda5e26b'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:10.465236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-05a3694d-ccb8-4486-a0c4-4e0781a000f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3bf3e7ac9b44979bc176801cda5e26b'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:10.488732 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-05a3694d-ccb8-4486-a0c4-4e0781a000f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3bf3e7ac9b44979bc176801cda5e26b'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:10.496512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1093/2219] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:31:10 2022] DELETE /identity/v3/users/b3bf3e7ac9b44979bc176801cda5e26b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:11.738878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64854d-f260-4ab7-bdc5-2c850ce2af47 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:11.741627 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-af64854d-f260-4ab7-bdc5-2c850ce2af47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:11.760338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64854d-f260-4ab7-bdc5-2c850ce2af47 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:11.826589 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b322b2-5158-4f8e-ad80-d68a46a7caa3 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:11.827559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b322b2-5158-4f8e-ad80-d68a46a7caa3 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:11.828129 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b322b2-5158-4f8e-ad80-d68a46a7caa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:11.896231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:11.903277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-49b322b2-5158-4f8e-ad80-d68a46a7caa3 None None] MFA Rules not processed for user `291bbfd399314cb6b9d7af01fcc0d31b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:11.912971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-49b322b2-5158-4f8e-ad80-d68a46a7caa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:11.920067 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce866dd-7e49-41bb-bfed-c25787c74c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:11.921425 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce866dd-7e49-41bb-bfed-c25787c74c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:11.921818 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce866dd-7e49-41bb-bfed-c25787c74c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:11.922143 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce866dd-7e49-41bb-bfed-c25787c74c96 admin admin] PATH_INFO: `/v3/projects/d998c81cc2854dd9bbdecb3d0d4ad46e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:11.924149 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce866dd-7e49-41bb-bfed-c25787c74c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d998c81cc2854dd9bbdecb3d0d4ad46e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:11.927578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce866dd-7e49-41bb-bfed-c25787c74c96 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:12.000832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:12.050923 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ce866dd-7e49-41bb-bfed-c25787c74c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd998c81cc2854dd9bbdecb3d0d4ad46e', 'request_id': 'req-6ce866dd-7e49-41bb-bfed-c25787c74c96'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:12.061763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1094/2220] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:12.061763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b32c53-3d35-4a2c-901f-dadcb389dc5a None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:12.061763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b32c53-3d35-4a2c-901f-dadcb389dc5a None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:12.062115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b32c53-3d35-4a2c-901f-dadcb389dc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:12.070088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ce866dd-7e49-41bb-bfed-c25787c74c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd998c81cc2854dd9bbdecb3d0d4ad46e', 'request_id': 'req-6ce866dd-7e49-41bb-bfed-c25787c74c96'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:12.088149 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ce866dd-7e49-41bb-bfed-c25787c74c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd998c81cc2854dd9bbdecb3d0d4ad46e', 'request_id': 'req-6ce866dd-7e49-41bb-bfed-c25787c74c96'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:12.108342 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-f8b32c53-3d35-4a2c-901f-dadcb389dc5a None None] MFA Rules not processed for user `9d3040d82a814912a3dfeef27739b573`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:12.109281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ce866dd-7e49-41bb-bfed-c25787c74c96 admin admin] The token cache is being invalidate because project d998c81cc2854dd9bbdecb3d0d4ad46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:31:12.109671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f8b32c53-3d35-4a2c-901f-dadcb389dc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:12.109789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ce866dd-7e49-41bb-bfed-c25787c74c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:12.112380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6ce866dd-7e49-41bb-bfed-c25787c74c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:12.116036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1127/2221] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:31:11 2022] DELETE /identity/v3/projects/d998c81cc2854dd9bbdecb3d0d4ad46e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:12.121067 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce866dd-7e49-41bb-bfed-c25787c74c96 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:12.128021 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6ce866dd-7e49-41bb-bfed-c25787c74c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:12.227975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1095/2222] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:12.236865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b87f83-718f-484b-bbf8-0eb87dc06dcd None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:12.237443 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b87f83-718f-484b-bbf8-0eb87dc06dcd None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:12.237932 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b87f83-718f-484b-bbf8-0eb87dc06dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:12.266195 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-c4b87f83-718f-484b-bbf8-0eb87dc06dcd None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:12.268138 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c4b87f83-718f-484b-bbf8-0eb87dc06dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:12.273167 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce866dd-7e49-41bb-bfed-c25787c74c96 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:12.284056 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1096/2223] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:12.285949 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b87f83-718f-484b-bbf8-0eb87dc06dcd None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:12.286954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09c307-9016-4171-a363-e27c4d344f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:12.287785 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09c307-9016-4171-a363-e27c4d344f29 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:12.288247 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09c307-9016-4171-a363-e27c4d344f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:12.288473 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c4b87f83-718f-484b-bbf8-0eb87dc06dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:12.288577 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09c307-9016-4171-a363-e27c4d344f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:12.289476 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09c307-9016-4171-a363-e27c4d344f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:12.297257 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09c307-9016-4171-a363-e27c4d344f29 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:12.310708 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b87f83-718f-484b-bbf8-0eb87dc06dcd None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:12.321821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6c1a5-9b51-4bfc-9eeb-2f9f2462d57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:12.322781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6c1a5-9b51-4bfc-9eeb-2f9f2462d57c admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:12.323090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6c1a5-9b51-4bfc-9eeb-2f9f2462d57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:12.323373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6c1a5-9b51-4bfc-9eeb-2f9f2462d57c admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:12.324231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6c1a5-9b51-4bfc-9eeb-2f9f2462d57c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:12.328245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6c1a5-9b51-4bfc-9eeb-2f9f2462d57c admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:12.366033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1128/2224] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:31:12 2022] POST /identity/v3/projects => generated 383 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:12.367729 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026f2fd-cd3e-407a-adf9-832ceee38a1f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:12.368054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026f2fd-cd3e-407a-adf9-832ceee38a1f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:12.371044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026f2fd-cd3e-407a-adf9-832ceee38a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:12.390620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1097/2225] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:31:12 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:12.394788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6c1a5-9b51-4bfc-9eeb-2f9f2462d57c admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:12.400292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9026f2fd-cd3e-407a-adf9-832ceee38a1f None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:12.402661 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9026f2fd-cd3e-407a-adf9-832ceee38a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:12.555955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1129/2226] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:12.560017 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026f2fd-cd3e-407a-adf9-832ceee38a1f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:12.571139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026f2fd-cd3e-407a-adf9-832ceee38a1f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:12.574049 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6c1a5-9b51-4bfc-9eeb-2f9f2462d57c admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:12.580206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574f324-6d63-452b-8a1c-c8554248ce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:12.581130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574f324-6d63-452b-8a1c-c8554248ce31 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:12.581422 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574f324-6d63-452b-8a1c-c8554248ce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:12.581773 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574f324-6d63-452b-8a1c-c8554248ce31 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:12.582886 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574f324-6d63-452b-8a1c-c8554248ce31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:12.584313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c149a58-dc60-4279-afcd-5242ca279d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:12.584907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574f324-6d63-452b-8a1c-c8554248ce31 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:12.585073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c149a58-dc60-4279-afcd-5242ca279d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:12.585303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c149a58-dc60-4279-afcd-5242ca279d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:12.585582 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c149a58-dc60-4279-afcd-5242ca279d3f admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:12.586949 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c149a58-dc60-4279-afcd-5242ca279d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:12.588309 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c149a58-dc60-4279-afcd-5242ca279d3f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:12.596630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:12.614607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1098/2227] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:31:12 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:12.615539 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574f324-6d63-452b-8a1c-c8554248ce31 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:12.620587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1130/2228] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:31:12 2022] POST /identity/v3/users => generated 293 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:12.620587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c149a58-dc60-4279-afcd-5242ca279d3f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:12.630775 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574f324-6d63-452b-8a1c-c8554248ce31 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:12.635213 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c149a58-dc60-4279-afcd-5242ca279d3f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:12.635801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c443921-66c6-4ca4-b718-be978b9f6b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:12.636482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c443921-66c6-4ca4-b718-be978b9f6b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:12.636769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c443921-66c6-4ca4-b718-be978b9f6b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:12.637111 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c443921-66c6-4ca4-b718-be978b9f6b19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:12.637914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c443921-66c6-4ca4-b718-be978b9f6b19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:31:12.638776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c443921-66c6-4ca4-b718-be978b9f6b19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:12.640634 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c443921-66c6-4ca4-b718-be978b9f6b19 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:12.641207 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28328581-34c4-4a88-84c6-af55a370f1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:12.641959 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28328581-34c4-4a88-84c6-af55a370f1cf admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:12.642318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28328581-34c4-4a88-84c6-af55a370f1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:12.642841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28328581-34c4-4a88-84c6-af55a370f1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:12.643863 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28328581-34c4-4a88-84c6-af55a370f1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:12.645357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28328581-34c4-4a88-84c6-af55a370f1cf admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:12.665372 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1131/2229] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:12.665567 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1099/2230] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:31:12.666370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c443921-66c6-4ca4-b718-be978b9f6b19 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:12.666887 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28328581-34c4-4a88-84c6-af55a370f1cf admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:12.677384 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28328581-34c4-4a88-84c6-af55a370f1cf admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:12.678593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c443921-66c6-4ca4-b718-be978b9f6b19 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:12.682153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be733df9-7724-4125-a629-512467e9009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:12.682831 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be733df9-7724-4125-a629-512467e9009b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:12.683120 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be733df9-7724-4125-a629-512467e9009b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:12.683402 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be733df9-7724-4125-a629-512467e9009b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:12.683702 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54957063-12ad-490a-ba40-74f6bd447f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:12.684280 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be733df9-7724-4125-a629-512467e9009b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:12.684739 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54957063-12ad-490a-ba40-74f6bd447f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:12.685156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54957063-12ad-490a-ba40-74f6bd447f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:12.685514 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54957063-12ad-490a-ba40-74f6bd447f3f admin admin] PATH_INFO: `/v3/projects/c1bed41218cc470a9bcad442ae29863e/users/66ca7ed9b65d4d8280ad87b9f3936672/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:12.685976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be733df9-7724-4125-a629-512467e9009b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:12.698107 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1132/2231] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:12.699109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be733df9-7724-4125-a629-512467e9009b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:12.704872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54957063-12ad-490a-ba40-74f6bd447f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1bed41218cc470a9bcad442ae29863e, user_id=66ca7ed9b65d4d8280ad87b9f3936672, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:12.705541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:12.708106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54957063-12ad-490a-ba40-74f6bd447f3f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:12.712400 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be733df9-7724-4125-a629-512467e9009b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:12.725644 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ce6f5-b459-4874-ad1b-94abbace5e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:12.726895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ce6f5-b459-4874-ad1b-94abbace5e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:12.727184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ce6f5-b459-4874-ad1b-94abbace5e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:12.727861 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ce6f5-b459-4874-ad1b-94abbace5e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:12.728581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ce6f5-b459-4874-ad1b-94abbace5e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:12.730997 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ce6f5-b459-4874-ad1b-94abbace5e38 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:12.739758 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1100/2232] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:12 2022] PUT /identity/v3/projects/c1bed41218cc470a9bcad442ae29863e/users/66ca7ed9b65d4d8280ad87b9f3936672/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:31:12.739758 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54957063-12ad-490a-ba40-74f6bd447f3f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:12.762989 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1133/2233] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:31:12 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:12.764662 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ce6f5-b459-4874-ad1b-94abbace5e38 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:12.849653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54957063-12ad-490a-ba40-74f6bd447f3f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:12.854897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173742f-2484-4663-a82b-bba000e20d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:12.855877 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173742f-2484-4663-a82b-bba000e20d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:12.856296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173742f-2484-4663-a82b-bba000e20d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:12.856574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173742f-2484-4663-a82b-bba000e20d4c admin admin] PATH_INFO: `/v3/projects/7a16c67c0b9148d282e562f1a66f23b5/users/5dacdcd8e2b047ed91c906ef86428925/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:12.862044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ce6f5-b459-4874-ad1b-94abbace5e38 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:12.874066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc4d33-540c-4486-8701-1eaf41f49845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:12.874708 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc4d33-540c-4486-8701-1eaf41f49845 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:12.874997 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc4d33-540c-4486-8701-1eaf41f49845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:12.875265 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc4d33-540c-4486-8701-1eaf41f49845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:12.876023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc4d33-540c-4486-8701-1eaf41f49845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:12.879283 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc4d33-540c-4486-8701-1eaf41f49845 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:12.884408 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173742f-2484-4663-a82b-bba000e20d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a16c67c0b9148d282e562f1a66f23b5, user_id=5dacdcd8e2b047ed91c906ef86428925, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:12.887388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173742f-2484-4663-a82b-bba000e20d4c admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:12.900189 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1134/2234] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:12.901254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc4d33-540c-4486-8701-1eaf41f49845 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:12.908181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1101/2235] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:12 2022] PUT /identity/v3/projects/7a16c67c0b9148d282e562f1a66f23b5/users/5dacdcd8e2b047ed91c906ef86428925/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:12.909549 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173742f-2484-4663-a82b-bba000e20d4c admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:12.915279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc4d33-540c-4486-8701-1eaf41f49845 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:12.992530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810e14b-8a8c-4ddb-999a-c12bb87dc433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:12.994396 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810e14b-8a8c-4ddb-999a-c12bb87dc433 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:12.994690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810e14b-8a8c-4ddb-999a-c12bb87dc433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:12.995101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810e14b-8a8c-4ddb-999a-c12bb87dc433 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:12.995941 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810e14b-8a8c-4ddb-999a-c12bb87dc433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:12.997770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173742f-2484-4663-a82b-bba000e20d4c admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:12.999041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810e14b-8a8c-4ddb-999a-c12bb87dc433 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:13.004492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d872cb-fb16-4394-9839-00c35e5dc846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:13.005609 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d872cb-fb16-4394-9839-00c35e5dc846 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:13.005994 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d872cb-fb16-4394-9839-00c35e5dc846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:13.006663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d872cb-fb16-4394-9839-00c35e5dc846 admin admin] PATH_INFO: `/v3/projects/c1bed41218cc470a9bcad442ae29863e/users/66ca7ed9b65d4d8280ad87b9f3936672/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:13.019354 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d872cb-fb16-4394-9839-00c35e5dc846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1bed41218cc470a9bcad442ae29863e, user_id=66ca7ed9b65d4d8280ad87b9f3936672, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:13.026935 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d872cb-fb16-4394-9839-00c35e5dc846 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:13.042821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1102/2236] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:12 2022] PUT /identity/v3/projects/c1bed41218cc470a9bcad442ae29863e/users/66ca7ed9b65d4d8280ad87b9f3936672/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:13.051005 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d872cb-fb16-4394-9839-00c35e5dc846 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:13.055723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1135/2237] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:31:12 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:13.056790 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810e14b-8a8c-4ddb-999a-c12bb87dc433 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:13.075285 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810e14b-8a8c-4ddb-999a-c12bb87dc433 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:13.162356 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:13.218863 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92097e79-d9aa-415a-beb5-23a3527ff65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:13.220811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92097e79-d9aa-415a-beb5-23a3527ff65b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:13.221163 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92097e79-d9aa-415a-beb5-23a3527ff65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:13.221504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92097e79-d9aa-415a-beb5-23a3527ff65b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:13.224056 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92097e79-d9aa-415a-beb5-23a3527ff65b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:13.226363 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92097e79-d9aa-415a-beb5-23a3527ff65b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:13.230405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d872cb-fb16-4394-9839-00c35e5dc846 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:13.238307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919ed35-4457-4892-9ac7-2796bb441c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:13.239285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919ed35-4457-4892-9ac7-2796bb441c86 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:13.240299 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919ed35-4457-4892-9ac7-2796bb441c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:13.240790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919ed35-4457-4892-9ac7-2796bb441c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:13.241959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919ed35-4457-4892-9ac7-2796bb441c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:13.244963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1136/2238] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:13.246412 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919ed35-4457-4892-9ac7-2796bb441c86 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:13.248125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92097e79-d9aa-415a-beb5-23a3527ff65b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:13.261056 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1103/2239] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:13.265083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:13.266975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919ed35-4457-4892-9ac7-2796bb441c86 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:13.276114 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92097e79-d9aa-415a-beb5-23a3527ff65b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:13.283067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919ed35-4457-4892-9ac7-2796bb441c86 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:13.291809 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ded54-c3dd-404b-b02b-1762d9335d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:13.292587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ded54-c3dd-404b-b02b-1762d9335d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:13.292875 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ded54-c3dd-404b-b02b-1762d9335d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:13.293209 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ded54-c3dd-404b-b02b-1762d9335d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:13.293952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ded54-c3dd-404b-b02b-1762d9335d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:13.296586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ded54-c3dd-404b-b02b-1762d9335d2e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:13.298386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922cbc7-dc98-4d3d-8f7a-2ec98bee2a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:13.301484 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922cbc7-dc98-4d3d-8f7a-2ec98bee2a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:13.302108 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922cbc7-dc98-4d3d-8f7a-2ec98bee2a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:13.302824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922cbc7-dc98-4d3d-8f7a-2ec98bee2a85 admin admin] PATH_INFO: `/v3/projects/7a16c67c0b9148d282e562f1a66f23b5/users/5dacdcd8e2b047ed91c906ef86428925/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:13.306256 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922cbc7-dc98-4d3d-8f7a-2ec98bee2a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a16c67c0b9148d282e562f1a66f23b5, user_id=5dacdcd8e2b047ed91c906ef86428925, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:13.312986 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1137/2240] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:31:13.316219 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ded54-c3dd-404b-b02b-1762d9335d2e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:13.317585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922cbc7-dc98-4d3d-8f7a-2ec98bee2a85 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:13.334181 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ded54-c3dd-404b-b02b-1762d9335d2e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:13.343592 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1104/2241] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:13 2022] PUT /identity/v3/projects/7a16c67c0b9148d282e562f1a66f23b5/users/5dacdcd8e2b047ed91c906ef86428925/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:13.438234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc58b75-48e0-46b6-a901-4f5cf591b8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:13.439214 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc58b75-48e0-46b6-a901-4f5cf591b8be admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:13.439494 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc58b75-48e0-46b6-a901-4f5cf591b8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:13.439767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc58b75-48e0-46b6-a901-4f5cf591b8be admin admin] PATH_INFO: `/v3/projects/25d10c542f0e4ebe8720dd9d9d10deca/users/6e66fc997aff49fd8a107e3f451bc73d/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:13.470867 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc58b75-48e0-46b6-a901-4f5cf591b8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d10c542f0e4ebe8720dd9d9d10deca, user_id=6e66fc997aff49fd8a107e3f451bc73d, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:13.474347 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc58b75-48e0-46b6-a901-4f5cf591b8be admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:13.515691 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1138/2242] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:13 2022] PUT /identity/v3/projects/25d10c542f0e4ebe8720dd9d9d10deca/users/6e66fc997aff49fd8a107e3f451bc73d/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:13.527383 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421c56e-5bf9-4eed-9107-2da035a831ea None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:13.527719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421c56e-5bf9-4eed-9107-2da035a831ea None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:13.528336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421c56e-5bf9-4eed-9107-2da035a831ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:13.637770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-3421c56e-5bf9-4eed-9107-2da035a831ea None None] MFA Rules not processed for user `6e66fc997aff49fd8a107e3f451bc73d`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:13.643834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-3421c56e-5bf9-4eed-9107-2da035a831ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:13.750282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1105/2243] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:13.755283 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc58b75-48e0-46b6-a901-4f5cf591b8be admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:13.864800 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc58b75-48e0-46b6-a901-4f5cf591b8be admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:13.870441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d10a5f-e53c-4a67-8417-53e8c1840731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:13.871495 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d10a5f-e53c-4a67-8417-53e8c1840731 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:13.871845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d10a5f-e53c-4a67-8417-53e8c1840731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:13.872277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d10a5f-e53c-4a67-8417-53e8c1840731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:13.873889 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d10a5f-e53c-4a67-8417-53e8c1840731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:13.877009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d10a5f-e53c-4a67-8417-53e8c1840731 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:13.913971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1139/2244] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:31:13 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:13.919020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421c56e-5bf9-4eed-9107-2da035a831ea None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:13.946074 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421c56e-5bf9-4eed-9107-2da035a831ea None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:14.030241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419838ea-d2d7-4c8e-a4ee-f04de8a1b508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:14.031592 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419838ea-d2d7-4c8e-a4ee-f04de8a1b508 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:14.032103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419838ea-d2d7-4c8e-a4ee-f04de8a1b508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:14.032588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419838ea-d2d7-4c8e-a4ee-f04de8a1b508 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:14.033555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419838ea-d2d7-4c8e-a4ee-f04de8a1b508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:14.036889 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419838ea-d2d7-4c8e-a4ee-f04de8a1b508 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:14.088653 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1106/2245] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:31:13 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:14.094146 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d10a5f-e53c-4a67-8417-53e8c1840731 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:14.107149 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d10a5f-e53c-4a67-8417-53e8c1840731 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:14.113224 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa90cfe-0c47-4967-a8ce-054d2124195b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:14.114201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa90cfe-0c47-4967-a8ce-054d2124195b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:14.114697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa90cfe-0c47-4967-a8ce-054d2124195b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:14.115394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa90cfe-0c47-4967-a8ce-054d2124195b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:14.116479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa90cfe-0c47-4967-a8ce-054d2124195b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:14.119092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa90cfe-0c47-4967-a8ce-054d2124195b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:14.135111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1140/2246] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:14.141500 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419838ea-d2d7-4c8e-a4ee-f04de8a1b508 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:14.158515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419838ea-d2d7-4c8e-a4ee-f04de8a1b508 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:14.190205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc96e73-d454-4767-a09b-c6a07a387c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:14.192821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc96e73-d454-4767-a09b-c6a07a387c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:14.193382 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc96e73-d454-4767-a09b-c6a07a387c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:14.196742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc96e73-d454-4767-a09b-c6a07a387c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:14.197418 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc96e73-d454-4767-a09b-c6a07a387c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:14.200185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc96e73-d454-4767-a09b-c6a07a387c45 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:14.222672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1107/2247] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:14.226977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa90cfe-0c47-4967-a8ce-054d2124195b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:14.241019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa90cfe-0c47-4967-a8ce-054d2124195b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:14.256705 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b37010-f34f-4548-b743-01d9e413fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:14.258878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b37010-f34f-4548-b743-01d9e413fbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:14.261207 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b37010-f34f-4548-b743-01d9e413fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:14.261815 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b37010-f34f-4548-b743-01d9e413fbeb admin admin] PATH_INFO: `/v3/projects/54854d1a5b7e480f8cafcec79d42ffb3/users/714675ccc1d245578c0a9637214137b5/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:14.299055 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b37010-f34f-4548-b743-01d9e413fbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=54854d1a5b7e480f8cafcec79d42ffb3, user_id=714675ccc1d245578c0a9637214137b5, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:14.303636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b37010-f34f-4548-b743-01d9e413fbeb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:14.347518 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0169d4-a6dc-442a-95d2-fc05f2d60b13 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:14.347945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0169d4-a6dc-442a-95d2-fc05f2d60b13 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:14.348332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0169d4-a6dc-442a-95d2-fc05f2d60b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:14.350021 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1141/2248] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:14 2022] PUT /identity/v3/projects/54854d1a5b7e480f8cafcec79d42ffb3/users/714675ccc1d245578c0a9637214137b5/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:14.356348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b37010-f34f-4548-b743-01d9e413fbeb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:14.363009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-24b37010-f34f-4548-b743-01d9e413fbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:14.405277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-3d0169d4-a6dc-442a-95d2-fc05f2d60b13 None None] MFA Rules not processed for user `714675ccc1d245578c0a9637214137b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:14.406957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-3d0169d4-a6dc-442a-95d2-fc05f2d60b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:14.447669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:14.458071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:14.522787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b37010-f34f-4548-b743-01d9e413fbeb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:14.531226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c391a1-1103-469c-8429-12b088610137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:14.532305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c391a1-1103-469c-8429-12b088610137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:14.533433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c391a1-1103-469c-8429-12b088610137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:14.534181 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c391a1-1103-469c-8429-12b088610137 admin admin] PATH_INFO: `/v3/users/c0e5c150001c4e60b5562467ce28af88` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:14.536782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c391a1-1103-469c-8429-12b088610137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e5c150001c4e60b5562467ce28af88)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:14.541274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c391a1-1103-469c-8429-12b088610137 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:14.588395 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1108/2249] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:14.595535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0169d4-a6dc-442a-95d2-fc05f2d60b13 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:14.636183 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0169d4-a6dc-442a-95d2-fc05f2d60b13 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:14.647646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-91c391a1-1103-469c-8429-12b088610137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e5c150001c4e60b5562467ce28af88'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:14.649565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1a90a-f2a7-4373-a764-68f4b3d82269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:14.650253 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1a90a-f2a7-4373-a764-68f4b3d82269 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:14.650538 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1a90a-f2a7-4373-a764-68f4b3d82269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:14.650820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1a90a-f2a7-4373-a764-68f4b3d82269 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:14.651537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1a90a-f2a7-4373-a764-68f4b3d82269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:14.658808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1a90a-f2a7-4373-a764-68f4b3d82269 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:14.679931 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-91c391a1-1103-469c-8429-12b088610137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e5c150001c4e60b5562467ce28af88'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:14.697680 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-91c391a1-1103-469c-8429-12b088610137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e5c150001c4e60b5562467ce28af88'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:14.698887 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-91c391a1-1103-469c-8429-12b088610137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e5c150001c4e60b5562467ce28af88'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:14.721905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-91c391a1-1103-469c-8429-12b088610137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e5c150001c4e60b5562467ce28af88'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:14.724788 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1109/2250] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:31:14 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:14.735728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1a90a-f2a7-4373-a764-68f4b3d82269 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:14.739309 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1142/2251] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:31:14 2022] DELETE /identity/v3/users/c0e5c150001c4e60b5562467ce28af88 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:31:14.743669 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c9a1a90a-f2a7-4373-a764-68f4b3d82269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:14.744165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36748e-7404-48ea-8d22-7b868e98fb23 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:14.745955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36748e-7404-48ea-8d22-7b868e98fb23 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:14.746302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36748e-7404-48ea-8d22-7b868e98fb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:14.788256 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ba36748e-7404-48ea-8d22-7b868e98fb23 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:14.789651 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ba36748e-7404-48ea-8d22-7b868e98fb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:14.883422 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1a90a-f2a7-4373-a764-68f4b3d82269 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:14.914376 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1143/2252] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:31:14.929835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36748e-7404-48ea-8d22-7b868e98fb23 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:14.931608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ba36748e-7404-48ea-8d22-7b868e98fb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:15.074862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00442b-592f-40af-8f8c-8a7c4cba7fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:15.079708 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00442b-592f-40af-8f8c-8a7c4cba7fdf admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:15.080333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00442b-592f-40af-8f8c-8a7c4cba7fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:15.082745 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00442b-592f-40af-8f8c-8a7c4cba7fdf admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:15.084914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00442b-592f-40af-8f8c-8a7c4cba7fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:15.089652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00442b-592f-40af-8f8c-8a7c4cba7fdf admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:15.118745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:15.149564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36748e-7404-48ea-8d22-7b868e98fb23 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:15.163151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1110/2253] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:31:14 2022] POST /identity/v3/users => generated 300 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:15.163364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51193da7-529f-4882-8538-6bbd83983501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:15.163364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51193da7-529f-4882-8538-6bbd83983501 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:15.163364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51193da7-529f-4882-8538-6bbd83983501 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:15.163364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51193da7-529f-4882-8538-6bbd83983501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:15.165422 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00442b-592f-40af-8f8c-8a7c4cba7fdf admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:15.186862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00442b-592f-40af-8f8c-8a7c4cba7fdf admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:15.196240 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51193da7-529f-4882-8538-6bbd83983501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:15.199367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51193da7-529f-4882-8538-6bbd83983501 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:15.206998 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5a75e-3bca-4bb7-9a3a-31b6743f3eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:15.208739 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5a75e-3bca-4bb7-9a3a-31b6743f3eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:15.209055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5a75e-3bca-4bb7-9a3a-31b6743f3eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:15.209385 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5a75e-3bca-4bb7-9a3a-31b6743f3eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:15.211848 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5a75e-3bca-4bb7-9a3a-31b6743f3eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:15.214388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5a75e-3bca-4bb7-9a3a-31b6743f3eb4 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:15.224325 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1144/2254] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:15.248730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1111/2255] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:15.249999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51193da7-529f-4882-8538-6bbd83983501 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:15.278523 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51193da7-529f-4882-8538-6bbd83983501 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:15.296823 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7cc22-4c58-4da6-94b2-eeb438c2a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:15.302095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7cc22-4c58-4da6-94b2-eeb438c2a600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:15.302352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7cc22-4c58-4da6-94b2-eeb438c2a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:15.302569 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7cc22-4c58-4da6-94b2-eeb438c2a600 admin admin] PATH_INFO: `/v3/projects/9f13725462cf46b398328c3c241ca2ed/users/33db721b776246edad90cfee39c0c855/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:15.363709 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7cc22-4c58-4da6-94b2-eeb438c2a600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f13725462cf46b398328c3c241ca2ed, user_id=33db721b776246edad90cfee39c0c855, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:15.370371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7cc22-4c58-4da6-94b2-eeb438c2a600 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:15.393566 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1145/2256] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:15 2022] PUT /identity/v3/projects/9f13725462cf46b398328c3c241ca2ed/users/33db721b776246edad90cfee39c0c855/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:15.397225 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5a75e-3bca-4bb7-9a3a-31b6743f3eb4 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:15.411267 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5a75e-3bca-4bb7-9a3a-31b6743f3eb4 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:15.441910 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:15.540497 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987a5c-e66f-46c9-a0cb-40db87cbd6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:15.541697 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987a5c-e66f-46c9-a0cb-40db87cbd6fb admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:15.542228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987a5c-e66f-46c9-a0cb-40db87cbd6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:15.542749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987a5c-e66f-46c9-a0cb-40db87cbd6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:15.543722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4987a5c-e66f-46c9-a0cb-40db87cbd6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:15.546350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4987a5c-e66f-46c9-a0cb-40db87cbd6fb admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:15.565313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1112/2257] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:15.567236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7cc22-4c58-4da6-94b2-eeb438c2a600 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:15.581220 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7cc22-4c58-4da6-94b2-eeb438c2a600 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:15.595434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09777a-6305-411e-9630-551359fdf9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:15.596357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09777a-6305-411e-9630-551359fdf9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:15.596643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09777a-6305-411e-9630-551359fdf9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:15.596918 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09777a-6305-411e-9630-551359fdf9e1 admin admin] PATH_INFO: `/v3/projects/9f13725462cf46b398328c3c241ca2ed/users/33db721b776246edad90cfee39c0c855/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:15.605200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09777a-6305-411e-9630-551359fdf9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f13725462cf46b398328c3c241ca2ed, user_id=33db721b776246edad90cfee39c0c855, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:15.608083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09777a-6305-411e-9630-551359fdf9e1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:15.650173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1146/2258] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:15 2022] PUT /identity/v3/projects/9f13725462cf46b398328c3c241ca2ed/users/33db721b776246edad90cfee39c0c855/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:15.652009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250456a-7f9a-4972-b746-dca537020abd None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:15.652300 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250456a-7f9a-4972-b746-dca537020abd None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:15.652580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250456a-7f9a-4972-b746-dca537020abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:15.714995 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-9250456a-7f9a-4972-b746-dca537020abd None None] MFA Rules not processed for user `33db721b776246edad90cfee39c0c855`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:15.718524 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9250456a-7f9a-4972-b746-dca537020abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:15.765468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09777a-6305-411e-9630-551359fdf9e1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:15.767656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2c09777a-6305-411e-9630-551359fdf9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:15.865066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1113/2259] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:15.873652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250456a-7f9a-4972-b746-dca537020abd None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:15.875220 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9250456a-7f9a-4972-b746-dca537020abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:15.934655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09777a-6305-411e-9630-551359fdf9e1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:15.944987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89558e1-0566-457c-943c-94567b0d679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:15.946892 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89558e1-0566-457c-943c-94567b0d679e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:15.947432 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89558e1-0566-457c-943c-94567b0d679e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:15.947944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89558e1-0566-457c-943c-94567b0d679e admin admin] PATH_INFO: `/v3/projects/418fafe7540846f09b6a899029b2b346` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:15.950305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89558e1-0566-457c-943c-94567b0d679e admin admin] RBAC: Authorizing `identity:delete_project(project_id=418fafe7540846f09b6a899029b2b346)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:15.954365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89558e1-0566-457c-943c-94567b0d679e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:15.969106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250456a-7f9a-4972-b746-dca537020abd None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:15.973459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6793548-6ed3-4566-9f65-60e740ac32da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:15.974336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6793548-6ed3-4566-9f65-60e740ac32da service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:15.974523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6793548-6ed3-4566-9f65-60e740ac32da service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:15.974799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6793548-6ed3-4566-9f65-60e740ac32da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:15.985401 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6793548-6ed3-4566-9f65-60e740ac32da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:15.987402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6793548-6ed3-4566-9f65-60e740ac32da service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:15.999921 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1114/2260] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:16.066803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d89558e1-0566-457c-943c-94567b0d679e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418fafe7540846f09b6a899029b2b346', 'request_id': 'req-d89558e1-0566-457c-943c-94567b0d679e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:16.085578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d89558e1-0566-457c-943c-94567b0d679e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418fafe7540846f09b6a899029b2b346', 'request_id': 'req-d89558e1-0566-457c-943c-94567b0d679e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:16.112165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d89558e1-0566-457c-943c-94567b0d679e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418fafe7540846f09b6a899029b2b346', 'request_id': 'req-d89558e1-0566-457c-943c-94567b0d679e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:16.148581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d89558e1-0566-457c-943c-94567b0d679e admin admin] The token cache is being invalidate because project 418fafe7540846f09b6a899029b2b346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:31:16.148581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d89558e1-0566-457c-943c-94567b0d679e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:16.149579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d89558e1-0566-457c-943c-94567b0d679e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:16.151492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1147/2261] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:31:15 2022] DELETE /identity/v3/projects/418fafe7540846f09b6a899029b2b346 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:16.956789 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6793548-6ed3-4566-9f65-60e740ac32da service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:16.958930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e6793548-6ed3-4566-9f65-60e740ac32da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:16.974911 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6793548-6ed3-4566-9f65-60e740ac32da service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:17.067241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:17.082951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f40412-6432-47c0-9e1f-3cf39a804b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:17.083627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f40412-6432-47c0-9e1f-3cf39a804b56 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:17.083908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f40412-6432-47c0-9e1f-3cf39a804b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:17.084188 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f40412-6432-47c0-9e1f-3cf39a804b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:17.087809 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-35f40412-6432-47c0-9e1f-3cf39a804b56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:17.253563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f40412-6432-47c0-9e1f-3cf39a804b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:17.258169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f40412-6432-47c0-9e1f-3cf39a804b56 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:17.271694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1115/2262] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:18.724402 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89558e1-0566-457c-943c-94567b0d679e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:18.725932 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d89558e1-0566-457c-943c-94567b0d679e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:18.805057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:18.852453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89558e1-0566-457c-943c-94567b0d679e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:18.858045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e99c8-387d-443b-b9e4-d80b036e2cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:18.858820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e99c8-387d-443b-b9e4-d80b036e2cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:18.859082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e99c8-387d-443b-b9e4-d80b036e2cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:18.859358 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e99c8-387d-443b-b9e4-d80b036e2cca admin admin] PATH_INFO: `/v3/users/09c0a7a61e4445a982cd2ba2bbe043e3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:18.860567 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e99c8-387d-443b-b9e4-d80b036e2cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c0a7a61e4445a982cd2ba2bbe043e3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:18.862950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e99c8-387d-443b-b9e4-d80b036e2cca admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:18.955408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-174e99c8-387d-443b-b9e4-d80b036e2cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c0a7a61e4445a982cd2ba2bbe043e3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:18.990924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-174e99c8-387d-443b-b9e4-d80b036e2cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c0a7a61e4445a982cd2ba2bbe043e3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:18.998673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-174e99c8-387d-443b-b9e4-d80b036e2cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c0a7a61e4445a982cd2ba2bbe043e3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:18.999377 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-174e99c8-387d-443b-b9e4-d80b036e2cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c0a7a61e4445a982cd2ba2bbe043e3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:19.012112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-174e99c8-387d-443b-b9e4-d80b036e2cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c0a7a61e4445a982cd2ba2bbe043e3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:19.032673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1148/2263] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:31:18 2022] DELETE /identity/v3/users/09c0a7a61e4445a982cd2ba2bbe043e3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:19.037872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbe3e8-d316-4038-a2cf-0666c625b51f None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:19.037872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbe3e8-d316-4038-a2cf-0666c625b51f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:19.038442 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbe3e8-d316-4038-a2cf-0666c625b51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:19.068440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-6ebbe3e8-d316-4038-a2cf-0666c625b51f None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:19.071210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6ebbe3e8-d316-4038-a2cf-0666c625b51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:19.236699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1116/2264] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:19.252305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e99c8-387d-443b-b9e4-d80b036e2cca admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:19.253893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-174e99c8-387d-443b-b9e4-d80b036e2cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:19.403596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e99c8-387d-443b-b9e4-d80b036e2cca admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:19.410984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a3b74-38bd-4059-b028-378107c0fa3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:19.411498 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a3b74-38bd-4059-b028-378107c0fa3a service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:19.411849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a3b74-38bd-4059-b028-378107c0fa3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:19.412227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a3b74-38bd-4059-b028-378107c0fa3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:19.430885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a3b74-38bd-4059-b028-378107c0fa3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:19.432482 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a3b74-38bd-4059-b028-378107c0fa3a service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:19.444282 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1149/2265] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:19.932318 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbe3e8-d316-4038-a2cf-0666c625b51f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:19.933816 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6ebbe3e8-d316-4038-a2cf-0666c625b51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:19.955198 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbe3e8-d316-4038-a2cf-0666c625b51f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:19.963690 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ef10f-6cd6-49d2-be8a-10e9bb5bf1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:19.964593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ef10f-6cd6-49d2-be8a-10e9bb5bf1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:19.964879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ef10f-6cd6-49d2-be8a-10e9bb5bf1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:19.983601 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ef10f-6cd6-49d2-be8a-10e9bb5bf1c5 admin admin] PATH_INFO: `/v3/projects/7c19ff6748484183b85f10135db27197` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:19.985554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ef10f-6cd6-49d2-be8a-10e9bb5bf1c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c19ff6748484183b85f10135db27197)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:19.991230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ef10f-6cd6-49d2-be8a-10e9bb5bf1c5 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:20.098246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c04ef10f-6cd6-49d2-be8a-10e9bb5bf1c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c19ff6748484183b85f10135db27197', 'request_id': 'req-c04ef10f-6cd6-49d2-be8a-10e9bb5bf1c5'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:20.127773 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c04ef10f-6cd6-49d2-be8a-10e9bb5bf1c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c19ff6748484183b85f10135db27197', 'request_id': 'req-c04ef10f-6cd6-49d2-be8a-10e9bb5bf1c5'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:20.152315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c04ef10f-6cd6-49d2-be8a-10e9bb5bf1c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c19ff6748484183b85f10135db27197', 'request_id': 'req-c04ef10f-6cd6-49d2-be8a-10e9bb5bf1c5'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:20.179214 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c04ef10f-6cd6-49d2-be8a-10e9bb5bf1c5 admin admin] The token cache is being invalidate because project 7c19ff6748484183b85f10135db27197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:31:20.179846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c04ef10f-6cd6-49d2-be8a-10e9bb5bf1c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:20.182071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c04ef10f-6cd6-49d2-be8a-10e9bb5bf1c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:20.184968 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1117/2266] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:31:19 2022] DELETE /identity/v3/projects/7c19ff6748484183b85f10135db27197 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:20.189540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a855f-5d44-4e86-ae03-a53c85dd13e7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:20.190006 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a855f-5d44-4e86-ae03-a53c85dd13e7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:20.190084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a855f-5d44-4e86-ae03-a53c85dd13e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:20.235493 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b62a855f-5d44-4e86-ae03-a53c85dd13e7 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:20.236733 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b62a855f-5d44-4e86-ae03-a53c85dd13e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:20.415618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1150/2267] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:20.424050 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e1115-6d9d-494d-9603-585953389e61 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:20.424368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e1115-6d9d-494d-9603-585953389e61 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:20.424674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e1115-6d9d-494d-9603-585953389e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:20.459757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-d49e1115-6d9d-494d-9603-585953389e61 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:20.461674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-d49e1115-6d9d-494d-9603-585953389e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:20.474677 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1118/2268] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:20.478930 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a855f-5d44-4e86-ae03-a53c85dd13e7 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:20.486380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:20.499987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a855f-5d44-4e86-ae03-a53c85dd13e7 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:20.515974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb76e3-01c2-40fa-bb8e-d6d206c97418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:20.516704 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb76e3-01c2-40fa-bb8e-d6d206c97418 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:20.517023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb76e3-01c2-40fa-bb8e-d6d206c97418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:20.517302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb76e3-01c2-40fa-bb8e-d6d206c97418 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:20.518036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb76e3-01c2-40fa-bb8e-d6d206c97418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:31:20.518343 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb76e3-01c2-40fa-bb8e-d6d206c97418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:20.520917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb76e3-01c2-40fa-bb8e-d6d206c97418 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:20.545253 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e1115-6d9d-494d-9603-585953389e61 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:20.551089 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1151/2269] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:31:20.557789 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e1115-6d9d-494d-9603-585953389e61 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:20.573683 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd9bd1-ad2e-4a49-b19e-3dc2cb922b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:20.574515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd9bd1-ad2e-4a49-b19e-3dc2cb922b52 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:20.574907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd9bd1-ad2e-4a49-b19e-3dc2cb922b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:20.575316 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd9bd1-ad2e-4a49-b19e-3dc2cb922b52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:20.576152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd9bd1-ad2e-4a49-b19e-3dc2cb922b52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:20.592285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd9bd1-ad2e-4a49-b19e-3dc2cb922b52 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:20.623563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:20.664811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1119/2270] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:31:20 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:20.670057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb76e3-01c2-40fa-bb8e-d6d206c97418 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:20.689074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb76e3-01c2-40fa-bb8e-d6d206c97418 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:20.845480 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f0a22-3abe-466b-a6a2-7184aa490285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:20.846440 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f0a22-3abe-466b-a6a2-7184aa490285 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:20.846766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f0a22-3abe-466b-a6a2-7184aa490285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:20.847196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f0a22-3abe-466b-a6a2-7184aa490285 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:20.848619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f0a22-3abe-466b-a6a2-7184aa490285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:20.862438 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f0a22-3abe-466b-a6a2-7184aa490285 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:20.920025 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1152/2271] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:31:20 2022] POST /identity/v3/users => generated 285 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:20.920702 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd9bd1-ad2e-4a49-b19e-3dc2cb922b52 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:20.938966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd9bd1-ad2e-4a49-b19e-3dc2cb922b52 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:20.953103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999773a1-44f8-41d0-beca-694896edd495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:20.955580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999773a1-44f8-41d0-beca-694896edd495 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:20.957924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999773a1-44f8-41d0-beca-694896edd495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:20.959545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999773a1-44f8-41d0-beca-694896edd495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:20.962419 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999773a1-44f8-41d0-beca-694896edd495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:20.967254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999773a1-44f8-41d0-beca-694896edd495 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:21.004330 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f0a22-3abe-466b-a6a2-7184aa490285 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:21.005785 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1120/2272] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:21.027211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f0a22-3abe-466b-a6a2-7184aa490285 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:21.040657 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff256772-e7d6-4a00-85e3-faefa196cafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:21.041890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff256772-e7d6-4a00-85e3-faefa196cafa admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:21.042655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff256772-e7d6-4a00-85e3-faefa196cafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:21.043096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff256772-e7d6-4a00-85e3-faefa196cafa admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:21.044014 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff256772-e7d6-4a00-85e3-faefa196cafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:21.047194 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff256772-e7d6-4a00-85e3-faefa196cafa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:21.081977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1153/2273] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:21.085930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999773a1-44f8-41d0-beca-694896edd495 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:21.100944 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999773a1-44f8-41d0-beca-694896edd495 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:21.111848 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab6989-c152-49de-8714-da6aa33efabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:21.112818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab6989-c152-49de-8714-da6aa33efabc admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:21.113158 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab6989-c152-49de-8714-da6aa33efabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:21.113674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab6989-c152-49de-8714-da6aa33efabc admin admin] PATH_INFO: `/v3/projects/672509130fb142e8b65b6884f75fdb2e/users/92a06088b243452fb0e25569ba58a5dd/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:21.147671 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab6989-c152-49de-8714-da6aa33efabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=672509130fb142e8b65b6884f75fdb2e, user_id=92a06088b243452fb0e25569ba58a5dd, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:21.170025 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab6989-c152-49de-8714-da6aa33efabc admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:21.200909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1121/2274] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:21 2022] PUT /identity/v3/projects/672509130fb142e8b65b6884f75fdb2e/users/92a06088b243452fb0e25569ba58a5dd/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:21.211560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db61f2c-7430-4c49-ad78-74496bdac069 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:21.212055 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db61f2c-7430-4c49-ad78-74496bdac069 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:21.212148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db61f2c-7430-4c49-ad78-74496bdac069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:21.280364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8db61f2c-7430-4c49-ad78-74496bdac069 None None] MFA Rules not processed for user `92a06088b243452fb0e25569ba58a5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:21.282417 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8db61f2c-7430-4c49-ad78-74496bdac069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:21.427675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1154/2275] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:21.436118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab6989-c152-49de-8714-da6aa33efabc admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:21.437980 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-57ab6989-c152-49de-8714-da6aa33efabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:21.528251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab6989-c152-49de-8714-da6aa33efabc admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:21.534908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b28a3-3737-4a93-a56b-c9d86f03f05f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefb0fe4d09b451a861510508bb9cf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:21.536432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b28a3-3737-4a93-a56b-c9d86f03f05f service glance] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:21.537342 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b28a3-3737-4a93-a56b-c9d86f03f05f service glance] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:21.538145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b28a3-3737-4a93-a56b-c9d86f03f05f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:21.559381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b28a3-3737-4a93-a56b-c9d86f03f05f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:21.562736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b28a3-3737-4a93-a56b-c9d86f03f05f service glance] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:21.583028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1122/2276] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:22.273384 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db61f2c-7430-4c49-ad78-74496bdac069 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:22.278208 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8db61f2c-7430-4c49-ad78-74496bdac069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:22.457476 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db61f2c-7430-4c49-ad78-74496bdac069 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:22.465146 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95833f3d-4d4f-42d1-a688-df433de53c45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:22.465833 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95833f3d-4d4f-42d1-a688-df433de53c45 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:22.466238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95833f3d-4d4f-42d1-a688-df433de53c45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:22.466522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95833f3d-4d4f-42d1-a688-df433de53c45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:22.468430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-95833f3d-4d4f-42d1-a688-df433de53c45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:22.503011 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:22.584912 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95833f3d-4d4f-42d1-a688-df433de53c45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:22.601976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95833f3d-4d4f-42d1-a688-df433de53c45 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:22.616975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1155/2277] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:23.884857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bf6be-4823-4e10-ad69-4d926e6ba25b None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:23.885920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bf6be-4823-4e10-ad69-4d926e6ba25b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:23.886353 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bf6be-4823-4e10-ad69-4d926e6ba25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:23.971417 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-ef1bf6be-4823-4e10-ad69-4d926e6ba25b None None] MFA Rules not processed for user `66ca7ed9b65d4d8280ad87b9f3936672`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:23.972660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ef1bf6be-4823-4e10-ad69-4d926e6ba25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:24.166135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1123/2278] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:24.178767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95833f3d-4d4f-42d1-a688-df433de53c45 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:24.202133 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95833f3d-4d4f-42d1-a688-df433de53c45 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:24.234905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e1a13-75f5-442a-be3a-d868f6b8bfa0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefb0fe4d09b451a861510508bb9cf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:24.236392 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e1a13-75f5-442a-be3a-d868f6b8bfa0 service glance] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:24.236954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e1a13-75f5-442a-be3a-d868f6b8bfa0 service glance] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:24.237258 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e1a13-75f5-442a-be3a-d868f6b8bfa0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:24.244477 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e20e1a13-75f5-442a-be3a-d868f6b8bfa0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:24.345505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e1a13-75f5-442a-be3a-d868f6b8bfa0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:24.357886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e1a13-75f5-442a-be3a-d868f6b8bfa0 service glance] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:24.373770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1156/2279] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:24.599852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5ae4c-0423-4285-b88b-05a63c4fdff6 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:24.600479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5ae4c-0423-4285-b88b-05a63c4fdff6 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:24.601059 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5ae4c-0423-4285-b88b-05a63c4fdff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:24.628546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-38e5ae4c-0423-4285-b88b-05a63c4fdff6 None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:24.630716 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-38e5ae4c-0423-4285-b88b-05a63c4fdff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:24.721492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:24.765065 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1124/2280] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jul 21 22:31:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:24.858326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e1a13-75f5-442a-be3a-d868f6b8bfa0 service glance] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:24.860126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e20e1a13-75f5-442a-be3a-d868f6b8bfa0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:25.031668 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e1a13-75f5-442a-be3a-d868f6b8bfa0 service glance] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:25.049795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb9a1d-0f28-42fd-b38f-1a9f0458511a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:25.050635 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb9a1d-0f28-42fd-b38f-1a9f0458511a service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:25.051041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb9a1d-0f28-42fd-b38f-1a9f0458511a service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:25.051422 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb9a1d-0f28-42fd-b38f-1a9f0458511a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:25.074633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb9a1d-0f28-42fd-b38f-1a9f0458511a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:25.076580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb9a1d-0f28-42fd-b38f-1a9f0458511a service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:25.105897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1157/2281] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:31:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:31:25.310896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a0ea4-22f3-4aee-8cf0-39530956a068 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:25.312003 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a0ea4-22f3-4aee-8cf0-39530956a068 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:25.312493 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a0ea4-22f3-4aee-8cf0-39530956a068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:25.368193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-3c7a0ea4-22f3-4aee-8cf0-39530956a068 None None] MFA Rules not processed for user `5dacdcd8e2b047ed91c906ef86428925`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:25.369802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-3c7a0ea4-22f3-4aee-8cf0-39530956a068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:25.541565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1125/2282] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:25.547827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb9a1d-0f28-42fd-b38f-1a9f0458511a service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:25.549365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-72cb9a1d-0f28-42fd-b38f-1a9f0458511a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:25.677723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:25.760316 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb9a1d-0f28-42fd-b38f-1a9f0458511a service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:25.768061 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323600c-7764-472b-8d1d-283602611d67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:25.769233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323600c-7764-472b-8d1d-283602611d67 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:25.769613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323600c-7764-472b-8d1d-283602611d67 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:25.770553 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323600c-7764-472b-8d1d-283602611d67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:25.772622 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6323600c-7764-472b-8d1d-283602611d67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:25.898585 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323600c-7764-472b-8d1d-283602611d67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:25.900847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323600c-7764-472b-8d1d-283602611d67 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:25.915835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1158/2283] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:26.220988 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a0ea4-22f3-4aee-8cf0-39530956a068 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:26.222615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-3c7a0ea4-22f3-4aee-8cf0-39530956a068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:26.350266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a0ea4-22f3-4aee-8cf0-39530956a068 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:26.357283 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e286fb-9aa9-4312-8dbe-c069f9a46377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:26.360060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e286fb-9aa9-4312-8dbe-c069f9a46377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:26.360362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e286fb-9aa9-4312-8dbe-c069f9a46377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:26.360637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e286fb-9aa9-4312-8dbe-c069f9a46377 admin admin] PATH_INFO: `/v3/users/6e66fc997aff49fd8a107e3f451bc73d` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:26.362619 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e286fb-9aa9-4312-8dbe-c069f9a46377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e66fc997aff49fd8a107e3f451bc73d)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:26.364157 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e286fb-9aa9-4312-8dbe-c069f9a46377 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:26.440860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e6e286fb-9aa9-4312-8dbe-c069f9a46377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e66fc997aff49fd8a107e3f451bc73d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:26.456001 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e6e286fb-9aa9-4312-8dbe-c069f9a46377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e66fc997aff49fd8a107e3f451bc73d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:26.457413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e6e286fb-9aa9-4312-8dbe-c069f9a46377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e66fc997aff49fd8a107e3f451bc73d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:26.472097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e6e286fb-9aa9-4312-8dbe-c069f9a46377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e66fc997aff49fd8a107e3f451bc73d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:26.475167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:26.485277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e6e286fb-9aa9-4312-8dbe-c069f9a46377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e66fc997aff49fd8a107e3f451bc73d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:26.499971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1126/2284] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:31:26 2022] DELETE /identity/v3/users/6e66fc997aff49fd8a107e3f451bc73d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:26.500616 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2f8bf-0f40-46b5-9894-ce3e24958d8a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:26.501199 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2f8bf-0f40-46b5-9894-ce3e24958d8a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:26.501813 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2f8bf-0f40-46b5-9894-ce3e24958d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:26.581871 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6be2f8bf-0f40-46b5-9894-ce3e24958d8a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:26.583815 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6be2f8bf-0f40-46b5-9894-ce3e24958d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:26.829566 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1159/2285] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:31:26.852070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e286fb-9aa9-4312-8dbe-c069f9a46377 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:26.853376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e6e286fb-9aa9-4312-8dbe-c069f9a46377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:27.007387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e286fb-9aa9-4312-8dbe-c069f9a46377 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:27.019739 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebd199-4412-47b0-8ffd-e016241e6361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:27.020429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebd199-4412-47b0-8ffd-e016241e6361 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:27.020716 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebd199-4412-47b0-8ffd-e016241e6361 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:27.021018 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebd199-4412-47b0-8ffd-e016241e6361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:27.034810 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebd199-4412-47b0-8ffd-e016241e6361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:27.039355 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebd199-4412-47b0-8ffd-e016241e6361 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:27.078861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1127/2286] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:27.623480 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2f8bf-0f40-46b5-9894-ce3e24958d8a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:27.627027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6be2f8bf-0f40-46b5-9894-ce3e24958d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:27.663884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2f8bf-0f40-46b5-9894-ce3e24958d8a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:27.680551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b21f6d-2a22-490d-8d6e-f9be02ee2597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:27.681386 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b21f6d-2a22-490d-8d6e-f9be02ee2597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:27.681658 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b21f6d-2a22-490d-8d6e-f9be02ee2597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:27.682013 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b21f6d-2a22-490d-8d6e-f9be02ee2597 admin admin] PATH_INFO: `/v3/projects/25d10c542f0e4ebe8720dd9d9d10deca` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:27.684623 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b21f6d-2a22-490d-8d6e-f9be02ee2597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d10c542f0e4ebe8720dd9d9d10deca)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:27.689103 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b21f6d-2a22-490d-8d6e-f9be02ee2597 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:27.773515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-31b21f6d-2a22-490d-8d6e-f9be02ee2597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d10c542f0e4ebe8720dd9d9d10deca', 'request_id': 'req-31b21f6d-2a22-490d-8d6e-f9be02ee2597'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:27.782955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-31b21f6d-2a22-490d-8d6e-f9be02ee2597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d10c542f0e4ebe8720dd9d9d10deca', 'request_id': 'req-31b21f6d-2a22-490d-8d6e-f9be02ee2597'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:27.804319 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-31b21f6d-2a22-490d-8d6e-f9be02ee2597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d10c542f0e4ebe8720dd9d9d10deca', 'request_id': 'req-31b21f6d-2a22-490d-8d6e-f9be02ee2597'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:27.821477 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:27.822073 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82830831-3b8f-44c4-91ba-8e84a96d7664 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:27.823081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82830831-3b8f-44c4-91ba-8e84a96d7664 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:27.823636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82830831-3b8f-44c4-91ba-8e84a96d7664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:27.828868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-31b21f6d-2a22-490d-8d6e-f9be02ee2597 admin admin] The token cache is being invalidate because project 25d10c542f0e4ebe8720dd9d9d10deca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:31:27.829896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-31b21f6d-2a22-490d-8d6e-f9be02ee2597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:27.833802 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-31b21f6d-2a22-490d-8d6e-f9be02ee2597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:27.839925 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1160/2287] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:31:27 2022] DELETE /identity/v3/projects/25d10c542f0e4ebe8720dd9d9d10deca => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:31:27.843772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b21f6d-2a22-490d-8d6e-f9be02ee2597 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:27.847524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-31b21f6d-2a22-490d-8d6e-f9be02ee2597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:27.896332 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-82830831-3b8f-44c4-91ba-8e84a96d7664 None None] MFA Rules not processed for user `9d3040d82a814912a3dfeef27739b573`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:27.898372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-82830831-3b8f-44c4-91ba-8e84a96d7664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:28.012468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b21f6d-2a22-490d-8d6e-f9be02ee2597 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:28.018722 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96abf8-4a8e-4e92-8ad5-d8e359c205f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:28.019621 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96abf8-4a8e-4e92-8ad5-d8e359c205f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:28.019909 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96abf8-4a8e-4e92-8ad5-d8e359c205f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:28.020189 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96abf8-4a8e-4e92-8ad5-d8e359c205f9 admin admin] PATH_INFO: `/v3/users/714675ccc1d245578c0a9637214137b5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:28.021465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96abf8-4a8e-4e92-8ad5-d8e359c205f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=714675ccc1d245578c0a9637214137b5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:28.023565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96abf8-4a8e-4e92-8ad5-d8e359c205f9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:28.066739 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1128/2288] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:31:28.135533 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8f96abf8-4a8e-4e92-8ad5-d8e359c205f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714675ccc1d245578c0a9637214137b5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:28.162076 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8f96abf8-4a8e-4e92-8ad5-d8e359c205f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714675ccc1d245578c0a9637214137b5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:28.177462 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8f96abf8-4a8e-4e92-8ad5-d8e359c205f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714675ccc1d245578c0a9637214137b5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:28.178790 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8f96abf8-4a8e-4e92-8ad5-d8e359c205f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714675ccc1d245578c0a9637214137b5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:28.212050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8f96abf8-4a8e-4e92-8ad5-d8e359c205f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714675ccc1d245578c0a9637214137b5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:28.220904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1161/2289] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:31:27 2022] DELETE /identity/v3/users/714675ccc1d245578c0a9637214137b5 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:28.793115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82830831-3b8f-44c4-91ba-8e84a96d7664 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:28.807232 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82830831-3b8f-44c4-91ba-8e84a96d7664 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:28.921566 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:28.923697 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:28.924350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:28.925070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3 admin admin] PATH_INFO: `/v3/projects/54854d1a5b7e480f8cafcec79d42ffb3` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:28.926919 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54854d1a5b7e480f8cafcec79d42ffb3)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:28.931348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:28.996058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:29.021595 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54854d1a5b7e480f8cafcec79d42ffb3', 'request_id': 'req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:29.036250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54854d1a5b7e480f8cafcec79d42ffb3', 'request_id': 'req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:29.050652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54854d1a5b7e480f8cafcec79d42ffb3', 'request_id': 'req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:29.082406 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3 admin admin] The token cache is being invalidate because project 54854d1a5b7e480f8cafcec79d42ffb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:31:29.082706 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:29.083565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:29.087464 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1129/2290] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:31:28 2022] DELETE /identity/v3/projects/54854d1a5b7e480f8cafcec79d42ffb3 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:31:29.092075 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96abf8-4a8e-4e92-8ad5-d8e359c205f9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:29.098346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8f96abf8-4a8e-4e92-8ad5-d8e359c205f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:29.133103 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96abf8-4a8e-4e92-8ad5-d8e359c205f9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:29.256295 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61102c7a-7a14-40a1-96db-8b318fd42805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:29.258504 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61102c7a-7a14-40a1-96db-8b318fd42805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:29.259174 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61102c7a-7a14-40a1-96db-8b318fd42805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:29.259796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61102c7a-7a14-40a1-96db-8b318fd42805 admin admin] PATH_INFO: `/v3/users/33db721b776246edad90cfee39c0c855` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:29.261293 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61102c7a-7a14-40a1-96db-8b318fd42805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33db721b776246edad90cfee39c0c855)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:29.263811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61102c7a-7a14-40a1-96db-8b318fd42805 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:29.300413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:29.373748 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-61102c7a-7a14-40a1-96db-8b318fd42805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33db721b776246edad90cfee39c0c855'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:29.391866 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-61102c7a-7a14-40a1-96db-8b318fd42805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33db721b776246edad90cfee39c0c855'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:29.406479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-61102c7a-7a14-40a1-96db-8b318fd42805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33db721b776246edad90cfee39c0c855'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:29.407304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-61102c7a-7a14-40a1-96db-8b318fd42805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33db721b776246edad90cfee39c0c855'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:29.425392 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-61102c7a-7a14-40a1-96db-8b318fd42805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33db721b776246edad90cfee39c0c855'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:29.456772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1162/2291] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:31:29 2022] DELETE /identity/v3/users/33db721b776246edad90cfee39c0c855 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:30.124124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:30.125688 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:30.141723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f6d45-0ede-4e9d-b051-ae45ba1a56a3 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:30.221928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f8f94-e881-46af-9ca3-e8a6f3bea05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:30.223174 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f8f94-e881-46af-9ca3-e8a6f3bea05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:30.223679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f8f94-e881-46af-9ca3-e8a6f3bea05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:30.224627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f8f94-e881-46af-9ca3-e8a6f3bea05d admin admin] PATH_INFO: `/v3/projects/9f13725462cf46b398328c3c241ca2ed` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:30.226126 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f8f94-e881-46af-9ca3-e8a6f3bea05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f13725462cf46b398328c3c241ca2ed)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:30.228299 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f8f94-e881-46af-9ca3-e8a6f3bea05d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:30.315579 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0c8f8f94-e881-46af-9ca3-e8a6f3bea05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f13725462cf46b398328c3c241ca2ed', 'request_id': 'req-0c8f8f94-e881-46af-9ca3-e8a6f3bea05d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:30.326230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0c8f8f94-e881-46af-9ca3-e8a6f3bea05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f13725462cf46b398328c3c241ca2ed', 'request_id': 'req-0c8f8f94-e881-46af-9ca3-e8a6f3bea05d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:30.334518 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0c8f8f94-e881-46af-9ca3-e8a6f3bea05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f13725462cf46b398328c3c241ca2ed', 'request_id': 'req-0c8f8f94-e881-46af-9ca3-e8a6f3bea05d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:30.353398 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0c8f8f94-e881-46af-9ca3-e8a6f3bea05d admin admin] The token cache is being invalidate because project 9f13725462cf46b398328c3c241ca2ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:31:30.354232 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0c8f8f94-e881-46af-9ca3-e8a6f3bea05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:30.355118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0c8f8f94-e881-46af-9ca3-e8a6f3bea05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:30.357217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1130/2292] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:31:30 2022] DELETE /identity/v3/projects/9f13725462cf46b398328c3c241ca2ed => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:30.363757 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0022b-efcd-4f03-a302-4452619a1dea None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:30.364759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0022b-efcd-4f03-a302-4452619a1dea None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:30.365386 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0022b-efcd-4f03-a302-4452619a1dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:30.452512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7fc0022b-efcd-4f03-a302-4452619a1dea None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:30.452512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7fc0022b-efcd-4f03-a302-4452619a1dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:30.652782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1163/2293] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:31:30.653130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f891e6-61d6-42dc-ad50-80891f4888b1 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:30.653432 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f891e6-61d6-42dc-ad50-80891f4888b1 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:30.653723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f891e6-61d6-42dc-ad50-80891f4888b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:30.694731 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-04f891e6-61d6-42dc-ad50-80891f4888b1 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:30.696074 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-04f891e6-61d6-42dc-ad50-80891f4888b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:30.706915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1131/2294] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:30.710242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0022b-efcd-4f03-a302-4452619a1dea None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:30.723773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0022b-efcd-4f03-a302-4452619a1dea None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:30.730314 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b68fb8-d8ec-492d-bd51-e005ce1e47d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:30.731844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b68fb8-d8ec-492d-bd51-e005ce1e47d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:30.732490 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b68fb8-d8ec-492d-bd51-e005ce1e47d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:30.732873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b68fb8-d8ec-492d-bd51-e005ce1e47d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:30.734136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b68fb8-d8ec-492d-bd51-e005ce1e47d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:31:30.734517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b68fb8-d8ec-492d-bd51-e005ce1e47d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:30.737525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b68fb8-d8ec-492d-bd51-e005ce1e47d5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:30.759201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1164/2295] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:31:30.760448 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f891e6-61d6-42dc-ad50-80891f4888b1 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:30.772118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f891e6-61d6-42dc-ad50-80891f4888b1 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:30.793023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f6ce3-8f51-4197-9b08-ac8ab46f6f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:30.794372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f6ce3-8f51-4197-9b08-ac8ab46f6f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:30.797637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f6ce3-8f51-4197-9b08-ac8ab46f6f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:30.798041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f6ce3-8f51-4197-9b08-ac8ab46f6f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:30.798890 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f6ce3-8f51-4197-9b08-ac8ab46f6f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:30.800951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f6ce3-8f51-4197-9b08-ac8ab46f6f51 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:30.877012 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1132/2296] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:31:30 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:30.882038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b68fb8-d8ec-492d-bd51-e005ce1e47d5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:30.899098 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b68fb8-d8ec-492d-bd51-e005ce1e47d5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:31.001460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b550eb-51aa-4495-92af-5bf8a4600e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:31.002539 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b550eb-51aa-4495-92af-5bf8a4600e62 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:31.005203 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b550eb-51aa-4495-92af-5bf8a4600e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:31.005723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b550eb-51aa-4495-92af-5bf8a4600e62 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:31.008136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b550eb-51aa-4495-92af-5bf8a4600e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:31.015757 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b550eb-51aa-4495-92af-5bf8a4600e62 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:31.138526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f6ce3-8f51-4197-9b08-ac8ab46f6f51 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:31.164210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1165/2297] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:31:30 2022] POST /identity/v3/users => generated 286 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:31.171120 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f6ce3-8f51-4197-9b08-ac8ab46f6f51 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:31.196500 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d649df-6d61-4f75-a53e-91e5087e3ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:31.197426 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d649df-6d61-4f75-a53e-91e5087e3ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:31.198808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d649df-6d61-4f75-a53e-91e5087e3ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:31.200470 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d649df-6d61-4f75-a53e-91e5087e3ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:31.202548 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d649df-6d61-4f75-a53e-91e5087e3ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:31.206134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d649df-6d61-4f75-a53e-91e5087e3ef8 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:31.227968 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b550eb-51aa-4495-92af-5bf8a4600e62 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:31.230266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1133/2298] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:31.253254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b550eb-51aa-4495-92af-5bf8a4600e62 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:31.264274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcadb5-f896-4dd3-881b-67901ec27734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:31.265302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcadb5-f896-4dd3-881b-67901ec27734 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:31.265988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcadb5-f896-4dd3-881b-67901ec27734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:31.266425 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcadb5-f896-4dd3-881b-67901ec27734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:31.267629 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dcadb5-f896-4dd3-881b-67901ec27734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:31.269707 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dcadb5-f896-4dd3-881b-67901ec27734 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:31.314489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1166/2299] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:31.315149 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d649df-6d61-4f75-a53e-91e5087e3ef8 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:31.335707 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d649df-6d61-4f75-a53e-91e5087e3ef8 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:31.351172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae00946-a518-44dc-856e-bd2b485888fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:31.352087 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae00946-a518-44dc-856e-bd2b485888fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:31.352377 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae00946-a518-44dc-856e-bd2b485888fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:31.352658 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae00946-a518-44dc-856e-bd2b485888fe admin admin] PATH_INFO: `/v3/projects/4fcb718080dc4669966dc77ae432a5ca/users/889167bb87464e98904270152b60ad0e/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:31.417243 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae00946-a518-44dc-856e-bd2b485888fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fcb718080dc4669966dc77ae432a5ca, user_id=889167bb87464e98904270152b60ad0e, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:31.420846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae00946-a518-44dc-856e-bd2b485888fe admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:31.451820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:31.463615 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1134/2300] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:31 2022] PUT /identity/v3/projects/4fcb718080dc4669966dc77ae432a5ca/users/889167bb87464e98904270152b60ad0e/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:31:31.469205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dd96f-b597-4168-aa38-8278b680dd55 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:31.469205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dd96f-b597-4168-aa38-8278b680dd55 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:31.470709 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dd96f-b597-4168-aa38-8278b680dd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:31.482188 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:31.504578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1b1dd96f-b597-4168-aa38-8278b680dd55 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:31.505944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1b1dd96f-b597-4168-aa38-8278b680dd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:31.600099 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1167/2301] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:31.610607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae00946-a518-44dc-856e-bd2b485888fe admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:31.612878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-dae00946-a518-44dc-856e-bd2b485888fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:31.732960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae00946-a518-44dc-856e-bd2b485888fe admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:31.739835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d6ceb-5e20-4825-86ba-aa375810458d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:31.742709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d6ceb-5e20-4825-86ba-aa375810458d service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:31.742963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d6ceb-5e20-4825-86ba-aa375810458d service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:31.743251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d6ceb-5e20-4825-86ba-aa375810458d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:31.767225 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d6ceb-5e20-4825-86ba-aa375810458d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:31.769258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d6ceb-5e20-4825-86ba-aa375810458d service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:31.812326 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1135/2302] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:33.796832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd616181-bd1a-403b-8137-808f2388767c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:33.797335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd616181-bd1a-403b-8137-808f2388767c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:33.797508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd616181-bd1a-403b-8137-808f2388767c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:33.898437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cd616181-bd1a-403b-8137-808f2388767c None None] MFA Rules not processed for user `889167bb87464e98904270152b60ad0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:33.907611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cd616181-bd1a-403b-8137-808f2388767c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:34.080832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1168/2303] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:34.085142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d6ceb-5e20-4825-86ba-aa375810458d service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:34.099474 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d6ceb-5e20-4825-86ba-aa375810458d service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:34.108361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0db0f-4104-40a9-9087-24245c9b283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:34.109708 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0db0f-4104-40a9-9087-24245c9b283d admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:34.110534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0db0f-4104-40a9-9087-24245c9b283d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:34.110964 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0db0f-4104-40a9-9087-24245c9b283d admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:34.111910 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0db0f-4104-40a9-9087-24245c9b283d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:34.117414 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0db0f-4104-40a9-9087-24245c9b283d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:34.162090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1136/2304] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:31:34 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:34.165988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd616181-bd1a-403b-8137-808f2388767c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:34.186331 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd616181-bd1a-403b-8137-808f2388767c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:34.338452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972bb24-c0b1-4b22-8107-405f8e33be70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:34.339152 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972bb24-c0b1-4b22-8107-405f8e33be70 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:34.339436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972bb24-c0b1-4b22-8107-405f8e33be70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:34.339714 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972bb24-c0b1-4b22-8107-405f8e33be70 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:34.345097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972bb24-c0b1-4b22-8107-405f8e33be70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:34.351930 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972bb24-c0b1-4b22-8107-405f8e33be70 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:34.386489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1169/2305] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:31:34 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:34.387302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0db0f-4104-40a9-9087-24245c9b283d admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:34.405320 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0db0f-4104-40a9-9087-24245c9b283d admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:34.413740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3479e-8b67-4177-bdd2-4490eeafd040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:34.414434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3479e-8b67-4177-bdd2-4490eeafd040 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:34.414725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3479e-8b67-4177-bdd2-4490eeafd040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:34.415061 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3479e-8b67-4177-bdd2-4490eeafd040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:34.415866 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3479e-8b67-4177-bdd2-4490eeafd040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:34.417991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3479e-8b67-4177-bdd2-4490eeafd040 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:34.434196 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1137/2306] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:34.437842 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972bb24-c0b1-4b22-8107-405f8e33be70 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:34.451911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972bb24-c0b1-4b22-8107-405f8e33be70 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:34.461869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d95a3-a1d4-4c4c-8b25-c5c229b93668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:34.463961 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d95a3-a1d4-4c4c-8b25-c5c229b93668 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:34.465303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d95a3-a1d4-4c4c-8b25-c5c229b93668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:34.465667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d95a3-a1d4-4c4c-8b25-c5c229b93668 admin admin] PATH_INFO: `/v3/projects/a9b9637b69c84e05acfe26da89f9df6b/users/aa6163fe336a416dab89c0f3e230b3e2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:34.499943 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d95a3-a1d4-4c4c-8b25-c5c229b93668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b9637b69c84e05acfe26da89f9df6b, user_id=aa6163fe336a416dab89c0f3e230b3e2, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:34.505522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d95a3-a1d4-4c4c-8b25-c5c229b93668 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:34.532235 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:34.547737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1170/2307] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:34 2022] PUT /identity/v3/projects/a9b9637b69c84e05acfe26da89f9df6b/users/aa6163fe336a416dab89c0f3e230b3e2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:34.551948 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3479e-8b67-4177-bdd2-4490eeafd040 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:34.572619 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3479e-8b67-4177-bdd2-4490eeafd040 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:34.738129 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e974a2b-ffb7-4fda-aa58-b8b018c371fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:34.739824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974a2b-ffb7-4fda-aa58-b8b018c371fb admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:34.740161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974a2b-ffb7-4fda-aa58-b8b018c371fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:34.740453 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974a2b-ffb7-4fda-aa58-b8b018c371fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:34.745470 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e974a2b-ffb7-4fda-aa58-b8b018c371fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:34.753821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e974a2b-ffb7-4fda-aa58-b8b018c371fb admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:34.803204 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1138/2308] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:34.804817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d95a3-a1d4-4c4c-8b25-c5c229b93668 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:34.838349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d95a3-a1d4-4c4c-8b25-c5c229b93668 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:34.865552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d4ce1-bc42-40aa-8ce1-c0677925f3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:34.866606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d4ce1-bc42-40aa-8ce1-c0677925f3c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:34.869873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d4ce1-bc42-40aa-8ce1-c0677925f3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:34.870475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d4ce1-bc42-40aa-8ce1-c0677925f3c7 admin admin] PATH_INFO: `/v3/projects/a9b9637b69c84e05acfe26da89f9df6b/users/aa6163fe336a416dab89c0f3e230b3e2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:34.886976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d4ce1-bc42-40aa-8ce1-c0677925f3c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b9637b69c84e05acfe26da89f9df6b, user_id=aa6163fe336a416dab89c0f3e230b3e2, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:34.900590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d4ce1-bc42-40aa-8ce1-c0677925f3c7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:34.946175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1171/2309] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:34 2022] PUT /identity/v3/projects/a9b9637b69c84e05acfe26da89f9df6b/users/aa6163fe336a416dab89c0f3e230b3e2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:36.030259 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcb6e9-612a-46ec-85ec-37b2790b7ef8 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:36.030969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcb6e9-612a-46ec-85ec-37b2790b7ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:36.031071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcb6e9-612a-46ec-85ec-37b2790b7ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:36.102457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-eedcb6e9-612a-46ec-85ec-37b2790b7ef8 None None] MFA Rules not processed for user `0ab0db1bbc72471a90bbfc2e47561a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:36.106721 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-eedcb6e9-612a-46ec-85ec-37b2790b7ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:36.231945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1139/2310] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:36.370432 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b01b6e-0a3d-4218-bb58-27a3adb31aa5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:36.370960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b01b6e-0a3d-4218-bb58-27a3adb31aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:36.370960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b01b6e-0a3d-4218-bb58-27a3adb31aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:36.456284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a5b01b6e-0a3d-4218-bb58-27a3adb31aa5 None None] MFA Rules not processed for user `aa6163fe336a416dab89c0f3e230b3e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:36.457257 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a5b01b6e-0a3d-4218-bb58-27a3adb31aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:36.590352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1172/2311] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:36.603108 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f276354-3de8-4cae-b3ed-69efef5d77fe None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:36.603597 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f276354-3de8-4cae-b3ed-69efef5d77fe None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:36.603989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f276354-3de8-4cae-b3ed-69efef5d77fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:36.624946 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-3f276354-3de8-4cae-b3ed-69efef5d77fe None None] MFA Rules not processed for user `889167bb87464e98904270152b60ad0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:36.626210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-3f276354-3de8-4cae-b3ed-69efef5d77fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:36.630417 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:36.714444 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1140/2312] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:36.729433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b01b6e-0a3d-4218-bb58-27a3adb31aa5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:36.732744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a5b01b6e-0a3d-4218-bb58-27a3adb31aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:36.936730 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b01b6e-0a3d-4218-bb58-27a3adb31aa5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:36.944270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43552d7b-a34c-481f-a306-44cb17a9a075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:36.945052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43552d7b-a34c-481f-a306-44cb17a9a075 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:36.945582 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43552d7b-a34c-481f-a306-44cb17a9a075 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:36.945869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43552d7b-a34c-481f-a306-44cb17a9a075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:36.966132 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43552d7b-a34c-481f-a306-44cb17a9a075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:36.967683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43552d7b-a34c-481f-a306-44cb17a9a075 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:36.999807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1173/2313] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:41.492920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdb318-205f-45d9-9a07-05f9f6664928 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:41.493527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdb318-205f-45d9-9a07-05f9f6664928 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:41.493754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdb318-205f-45d9-9a07-05f9f6664928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:41.533794 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-0cfdb318-205f-45d9-9a07-05f9f6664928 None None] MFA Rules not processed for user `291bbfd399314cb6b9d7af01fcc0d31b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:41.535792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0cfdb318-205f-45d9-9a07-05f9f6664928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:41.643407 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1141/2314] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:46.556478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a6738-5e33-4e7c-a5e1-e40b32d3ddd2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:46.557429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a6738-5e33-4e7c-a5e1-e40b32d3ddd2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:46.557711 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a6738-5e33-4e7c-a5e1-e40b32d3ddd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:46.586846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-191a6738-5e33-4e7c-a5e1-e40b32d3ddd2 None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:46.588255 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-191a6738-5e33-4e7c-a5e1-e40b32d3ddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:46.673591 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1174/2315] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jul 21 22:31:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:46.690282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdb318-205f-45d9-9a07-05f9f6664928 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:46.692917 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0cfdb318-205f-45d9-9a07-05f9f6664928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:46.828218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdb318-205f-45d9-9a07-05f9f6664928 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:46.835951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17248db3-292d-469a-a16e-b84ea9dc024b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:46.836748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17248db3-292d-469a-a16e-b84ea9dc024b service swift] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:46.837896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17248db3-292d-469a-a16e-b84ea9dc024b service swift] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:46.838510 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17248db3-292d-469a-a16e-b84ea9dc024b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:46.851646 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17248db3-292d-469a-a16e-b84ea9dc024b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:46.854509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17248db3-292d-469a-a16e-b84ea9dc024b service swift] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:46.868118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1142/2316] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:31:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:31:47.025920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a6738-5e33-4e7c-a5e1-e40b32d3ddd2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:47.028579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-191a6738-5e33-4e7c-a5e1-e40b32d3ddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:47.037804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:47.196388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a6738-5e33-4e7c-a5e1-e40b32d3ddd2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:47.210112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0476b-5111-4baf-9627-fe45415b5cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:47.211086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0476b-5111-4baf-9627-fe45415b5cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:47.211431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0476b-5111-4baf-9627-fe45415b5cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:47.211697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0476b-5111-4baf-9627-fe45415b5cce admin admin] PATH_INFO: `/v3/users/92a06088b243452fb0e25569ba58a5dd` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:47.216420 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0476b-5111-4baf-9627-fe45415b5cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=92a06088b243452fb0e25569ba58a5dd)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:47.218488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0476b-5111-4baf-9627-fe45415b5cce admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:47.363405 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2af0476b-5111-4baf-9627-fe45415b5cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92a06088b243452fb0e25569ba58a5dd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:47.417854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2af0476b-5111-4baf-9627-fe45415b5cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92a06088b243452fb0e25569ba58a5dd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:47.434566 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2af0476b-5111-4baf-9627-fe45415b5cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92a06088b243452fb0e25569ba58a5dd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:47.435317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2af0476b-5111-4baf-9627-fe45415b5cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92a06088b243452fb0e25569ba58a5dd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:47.455255 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2af0476b-5111-4baf-9627-fe45415b5cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92a06088b243452fb0e25569ba58a5dd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:47.464616 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1175/2317] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:31:47 2022] DELETE /identity/v3/users/92a06088b243452fb0e25569ba58a5dd => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:47.469564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c17c58-fcdb-4b24-8862-7367a013d611 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:47.470225 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c17c58-fcdb-4b24-8862-7367a013d611 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:47.470771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c17c58-fcdb-4b24-8862-7367a013d611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:47.522928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-84c17c58-fcdb-4b24-8862-7367a013d611 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:47.528018 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-84c17c58-fcdb-4b24-8862-7367a013d611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:47.640686 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:47.686253 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1143/2318] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:47.710210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0476b-5111-4baf-9627-fe45415b5cce admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:47.712274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2af0476b-5111-4baf-9627-fe45415b5cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:47.824743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0476b-5111-4baf-9627-fe45415b5cce admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:47.845914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1d209-ad23-42ff-b2b2-1133ee8d5614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:47.850067 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1d209-ad23-42ff-b2b2-1133ee8d5614 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:47.851158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1d209-ad23-42ff-b2b2-1133ee8d5614 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:47.852212 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1d209-ad23-42ff-b2b2-1133ee8d5614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:47.875484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1d209-ad23-42ff-b2b2-1133ee8d5614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:47.876989 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1d209-ad23-42ff-b2b2-1133ee8d5614 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:47.907479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1176/2319] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:48.917568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c17c58-fcdb-4b24-8862-7367a013d611 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:48.920420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-84c17c58-fcdb-4b24-8862-7367a013d611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:48.962508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c17c58-fcdb-4b24-8862-7367a013d611 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:48.973894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63127e0e-961e-4ff7-a574-ed99b23edb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:48.976073 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63127e0e-961e-4ff7-a574-ed99b23edb26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:48.976368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63127e0e-961e-4ff7-a574-ed99b23edb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:48.976646 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63127e0e-961e-4ff7-a574-ed99b23edb26 admin admin] PATH_INFO: `/v3/projects/672509130fb142e8b65b6884f75fdb2e` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:48.981204 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63127e0e-961e-4ff7-a574-ed99b23edb26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=672509130fb142e8b65b6884f75fdb2e)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:48.986981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63127e0e-961e-4ff7-a574-ed99b23edb26 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:49.088304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-63127e0e-961e-4ff7-a574-ed99b23edb26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672509130fb142e8b65b6884f75fdb2e', 'request_id': 'req-63127e0e-961e-4ff7-a574-ed99b23edb26'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:49.099646 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-63127e0e-961e-4ff7-a574-ed99b23edb26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672509130fb142e8b65b6884f75fdb2e', 'request_id': 'req-63127e0e-961e-4ff7-a574-ed99b23edb26'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:49.108495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-63127e0e-961e-4ff7-a574-ed99b23edb26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672509130fb142e8b65b6884f75fdb2e', 'request_id': 'req-63127e0e-961e-4ff7-a574-ed99b23edb26'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:49.136682 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-63127e0e-961e-4ff7-a574-ed99b23edb26 admin admin] The token cache is being invalidate because project 672509130fb142e8b65b6884f75fdb2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:31:49.137792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-63127e0e-961e-4ff7-a574-ed99b23edb26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:49.141629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-63127e0e-961e-4ff7-a574-ed99b23edb26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:31:49.144086 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1144/2320] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:31:48 2022] DELETE /identity/v3/projects/672509130fb142e8b65b6884f75fdb2e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:49.148976 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da51b60-0628-41e3-8b01-0305792e34af None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:49.149512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da51b60-0628-41e3-8b01-0305792e34af None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:49.149512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da51b60-0628-41e3-8b01-0305792e34af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:49.198145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0da51b60-0628-41e3-8b01-0305792e34af None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:49.199452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0da51b60-0628-41e3-8b01-0305792e34af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:49.251180 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:49.337792 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1177/2321] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:49.339748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da52518-9336-4476-b95c-a8dac60dc356 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:49.340504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da52518-9336-4476-b95c-a8dac60dc356 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:49.341221 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da52518-9336-4476-b95c-a8dac60dc356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:49.362444 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-9da52518-9336-4476-b95c-a8dac60dc356 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:49.364127 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9da52518-9336-4476-b95c-a8dac60dc356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:49.373819 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1145/2322] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:31:49.378379 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da51b60-0628-41e3-8b01-0305792e34af None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:49.391770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da51b60-0628-41e3-8b01-0305792e34af None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:49.398125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f65fe-ccc8-4f63-91cb-118349760fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:49.406904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f65fe-ccc8-4f63-91cb-118349760fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:49.407374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f65fe-ccc8-4f63-91cb-118349760fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:49.407656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f65fe-ccc8-4f63-91cb-118349760fc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:49.408480 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f65fe-ccc8-4f63-91cb-118349760fc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:31:49.408789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f65fe-ccc8-4f63-91cb-118349760fc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:49.410613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f65fe-ccc8-4f63-91cb-118349760fc1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:49.425127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1178/2323] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:31:49.428058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da52518-9336-4476-b95c-a8dac60dc356 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:49.438779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da52518-9336-4476-b95c-a8dac60dc356 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:49.443404 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eb31a-fa23-4b36-9e2e-ed794e77ca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:49.444058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eb31a-fa23-4b36-9e2e-ed794e77ca32 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:49.444340 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eb31a-fa23-4b36-9e2e-ed794e77ca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:49.444616 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eb31a-fa23-4b36-9e2e-ed794e77ca32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:49.445352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055eb31a-fa23-4b36-9e2e-ed794e77ca32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:49.447254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055eb31a-fa23-4b36-9e2e-ed794e77ca32 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:49.478870 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1146/2324] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:31:49 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:49.479969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f65fe-ccc8-4f63-91cb-118349760fc1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:49.490901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f65fe-ccc8-4f63-91cb-118349760fc1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:49.549765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b56508-23a4-4db8-9f76-50bbb7702afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:49.550440 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b56508-23a4-4db8-9f76-50bbb7702afb admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:49.550717 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b56508-23a4-4db8-9f76-50bbb7702afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:49.550990 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b56508-23a4-4db8-9f76-50bbb7702afb admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:49.551678 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b56508-23a4-4db8-9f76-50bbb7702afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:49.553638 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b56508-23a4-4db8-9f76-50bbb7702afb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:49.577195 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1179/2325] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:31:49 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:31:49.581617 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eb31a-fa23-4b36-9e2e-ed794e77ca32 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:49.605066 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eb31a-fa23-4b36-9e2e-ed794e77ca32 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:49.610313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475408b-9375-4086-92bc-94ac18392f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:49.611109 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475408b-9375-4086-92bc-94ac18392f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:49.611458 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475408b-9375-4086-92bc-94ac18392f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:49.621783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475408b-9375-4086-92bc-94ac18392f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:49.621783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475408b-9375-4086-92bc-94ac18392f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:49.621783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475408b-9375-4086-92bc-94ac18392f96 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:49.636971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1147/2326] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:49.639348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b56508-23a4-4db8-9f76-50bbb7702afb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:49.650654 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b56508-23a4-4db8-9f76-50bbb7702afb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:49.672763 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274e035-be01-49fd-9e13-b03ed1a2ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:49.673491 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274e035-be01-49fd-9e13-b03ed1a2ee6e admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:49.674122 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274e035-be01-49fd-9e13-b03ed1a2ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:49.674417 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274e035-be01-49fd-9e13-b03ed1a2ee6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:49.675277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274e035-be01-49fd-9e13-b03ed1a2ee6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:49.677004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274e035-be01-49fd-9e13-b03ed1a2ee6e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:49.706747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1180/2327] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:31:49.710565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475408b-9375-4086-92bc-94ac18392f96 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:49.721963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475408b-9375-4086-92bc-94ac18392f96 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:49.729510 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1bc8b-9295-417e-8cf0-89c7fc577a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:49.729510 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1bc8b-9295-417e-8cf0-89c7fc577a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:49.729510 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1bc8b-9295-417e-8cf0-89c7fc577a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:49.737398 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1bc8b-9295-417e-8cf0-89c7fc577a47 admin admin] PATH_INFO: `/v3/projects/7f38841c41e948af97ffed9f21fea88e/users/ccad0b5db04a43b8801065979545c479/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:49.754952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1bc8b-9295-417e-8cf0-89c7fc577a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f38841c41e948af97ffed9f21fea88e, user_id=ccad0b5db04a43b8801065979545c479, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:49.758736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1bc8b-9295-417e-8cf0-89c7fc577a47 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:49.784238 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1148/2328] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:31:49 2022] PUT /identity/v3/projects/7f38841c41e948af97ffed9f21fea88e/users/ccad0b5db04a43b8801065979545c479/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:31:49.793685 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b4b43-3d82-4c64-a33f-4a621e834e2c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:49.794022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b4b43-3d82-4c64-a33f-4a621e834e2c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:49.794247 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b4b43-3d82-4c64-a33f-4a621e834e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:49.832547 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-162b4b43-3d82-4c64-a33f-4a621e834e2c None None] MFA Rules not processed for user `ccad0b5db04a43b8801065979545c479`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:31:49.833780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-162b4b43-3d82-4c64-a33f-4a621e834e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:49.954367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1181/2329] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:31:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:31:49.966241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1bc8b-9295-417e-8cf0-89c7fc577a47 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:31:49.968340 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-13b1bc8b-9295-417e-8cf0-89c7fc577a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:31:50.086009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1bc8b-9295-417e-8cf0-89c7fc577a47 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:31:50.098797 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dec58-65f9-4825-9cf8-fd1df6709f26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:31:50.099730 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dec58-65f9-4825-9cf8-fd1df6709f26 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:31:50.100163 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dec58-65f9-4825-9cf8-fd1df6709f26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:31:50.100588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dec58-65f9-4825-9cf8-fd1df6709f26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:31:50.111305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3dec58-65f9-4825-9cf8-fd1df6709f26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:31:50.113179 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3dec58-65f9-4825-9cf8-fd1df6709f26 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:31:50.139020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1149/2330] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:31:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:31:59.950588 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:00.124198 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:01.161101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b4b43-3d82-4c64-a33f-4a621e834e2c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:01.243575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b4b43-3d82-4c64-a33f-4a621e834e2c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:01.250510 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe657864-a5a6-46d5-b363-8f675b0ed304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:01.251706 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe657864-a5a6-46d5-b363-8f675b0ed304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:01.252197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe657864-a5a6-46d5-b363-8f675b0ed304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:01.252639 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe657864-a5a6-46d5-b363-8f675b0ed304 admin admin] PATH_INFO: `/v3/users/ccad0b5db04a43b8801065979545c479` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:01.254868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe657864-a5a6-46d5-b363-8f675b0ed304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccad0b5db04a43b8801065979545c479)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:01.257008 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe657864-a5a6-46d5-b363-8f675b0ed304 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:01.314602 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe657864-a5a6-46d5-b363-8f675b0ed304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccad0b5db04a43b8801065979545c479'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:01.329074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe657864-a5a6-46d5-b363-8f675b0ed304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccad0b5db04a43b8801065979545c479'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:01.337675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe657864-a5a6-46d5-b363-8f675b0ed304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccad0b5db04a43b8801065979545c479'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:01.338487 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe657864-a5a6-46d5-b363-8f675b0ed304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccad0b5db04a43b8801065979545c479'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:01.348733 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fe657864-a5a6-46d5-b363-8f675b0ed304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccad0b5db04a43b8801065979545c479'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:01.360998 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1182/2331] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:32:01 2022] DELETE /identity/v3/users/ccad0b5db04a43b8801065979545c479 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:01.365578 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060ee58-b6ff-4974-a321-ae51d9caf0ec None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:01.366071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060ee58-b6ff-4974-a321-ae51d9caf0ec None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:01.366164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060ee58-b6ff-4974-a321-ae51d9caf0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:01.386069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-9060ee58-b6ff-4974-a321-ae51d9caf0ec None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:01.387854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9060ee58-b6ff-4974-a321-ae51d9caf0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:01.469885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1150/2332] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:01.482640 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe657864-a5a6-46d5-b363-8f675b0ed304 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:01.484313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fe657864-a5a6-46d5-b363-8f675b0ed304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:01.567374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe657864-a5a6-46d5-b363-8f675b0ed304 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:01.572270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945d211-328b-4a47-95ae-30be03d51bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:01.573096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945d211-328b-4a47-95ae-30be03d51bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:01.573475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945d211-328b-4a47-95ae-30be03d51bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:01.574054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945d211-328b-4a47-95ae-30be03d51bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:01.584787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945d211-328b-4a47-95ae-30be03d51bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:01.587715 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945d211-328b-4a47-95ae-30be03d51bf1 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:01.601216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1183/2333] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:02.428111 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b95b2-0fbd-4d2c-8693-004e16f7e62c None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:02.428652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b95b2-0fbd-4d2c-8693-004e16f7e62c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:02.428865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b95b2-0fbd-4d2c-8693-004e16f7e62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:02.460607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-650b95b2-0fbd-4d2c-8693-004e16f7e62c None None] MFA Rules not processed for user `1e24364e59144eae846d5a5efa260dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:02.462996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945d211-328b-4a47-95ae-30be03d51bf1 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:02.465449 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d945d211-328b-4a47-95ae-30be03d51bf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:02.473202 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-650b95b2-0fbd-4d2c-8693-004e16f7e62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:02.489618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945d211-328b-4a47-95ae-30be03d51bf1 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:02.495136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f648f2-9e80-4aad-a807-7cf38be4ce53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:02.496470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f648f2-9e80-4aad-a807-7cf38be4ce53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:02.497880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f648f2-9e80-4aad-a807-7cf38be4ce53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:02.498545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f648f2-9e80-4aad-a807-7cf38be4ce53 admin admin] PATH_INFO: `/v3/projects/7f38841c41e948af97ffed9f21fea88e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:02.500047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f648f2-9e80-4aad-a807-7cf38be4ce53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f38841c41e948af97ffed9f21fea88e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:02.502155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f648f2-9e80-4aad-a807-7cf38be4ce53 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:02.529358 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:02.583517 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1151/2334] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:02.600676 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-18f648f2-9e80-4aad-a807-7cf38be4ce53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f38841c41e948af97ffed9f21fea88e', 'request_id': 'req-18f648f2-9e80-4aad-a807-7cf38be4ce53'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:02.608556 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-18f648f2-9e80-4aad-a807-7cf38be4ce53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f38841c41e948af97ffed9f21fea88e', 'request_id': 'req-18f648f2-9e80-4aad-a807-7cf38be4ce53'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:02.616091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-18f648f2-9e80-4aad-a807-7cf38be4ce53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f38841c41e948af97ffed9f21fea88e', 'request_id': 'req-18f648f2-9e80-4aad-a807-7cf38be4ce53'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:02.631151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-18f648f2-9e80-4aad-a807-7cf38be4ce53 admin admin] The token cache is being invalidate because project 7f38841c41e948af97ffed9f21fea88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:32:02.631573 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-18f648f2-9e80-4aad-a807-7cf38be4ce53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:02.632335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-18f648f2-9e80-4aad-a807-7cf38be4ce53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:02.637606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1184/2335] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:32:02 2022] DELETE /identity/v3/projects/7f38841c41e948af97ffed9f21fea88e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:32:02.639809 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2171d2b-6256-458f-bcd9-565f127e395d None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:02.640477 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2171d2b-6256-458f-bcd9-565f127e395d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:02.640580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2171d2b-6256-458f-bcd9-565f127e395d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:02.661726 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-c2171d2b-6256-458f-bcd9-565f127e395d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:02.662819 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c2171d2b-6256-458f-bcd9-565f127e395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:02.732279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1152/2336] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:02.742105 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8e871-e006-4bed-8d97-1182dba032cd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:02.742397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8e871-e006-4bed-8d97-1182dba032cd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:02.742696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8e871-e006-4bed-8d97-1182dba032cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:02.770560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-90f8e871-e006-4bed-8d97-1182dba032cd None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:02.771800 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-90f8e871-e006-4bed-8d97-1182dba032cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:02.784963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1185/2337] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:02.790857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2171d2b-6256-458f-bcd9-565f127e395d None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:02.810937 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2171d2b-6256-458f-bcd9-565f127e395d None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:02.816225 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482eca78-2d48-483b-8f1c-38092bfb5ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:02.817961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eca78-2d48-483b-8f1c-38092bfb5ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:02.818553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eca78-2d48-483b-8f1c-38092bfb5ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:02.819219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eca78-2d48-483b-8f1c-38092bfb5ddb admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:02.820284 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482eca78-2d48-483b-8f1c-38092bfb5ddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:32:02.821017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482eca78-2d48-483b-8f1c-38092bfb5ddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:02.824193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482eca78-2d48-483b-8f1c-38092bfb5ddb admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:02.841403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1153/2338] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:32:02.845754 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8e871-e006-4bed-8d97-1182dba032cd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:02.856107 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8e871-e006-4bed-8d97-1182dba032cd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:02.863987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1408e0-827b-45b6-8d1b-d460d08ec72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:02.864894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1408e0-827b-45b6-8d1b-d460d08ec72e admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:02.865314 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1408e0-827b-45b6-8d1b-d460d08ec72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:02.865683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1408e0-827b-45b6-8d1b-d460d08ec72e admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:02.866453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1408e0-827b-45b6-8d1b-d460d08ec72e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:02.868537 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1408e0-827b-45b6-8d1b-d460d08ec72e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:02.903118 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1186/2339] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:32:02 2022] POST /identity/v3/projects => generated 397 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:32:02.907445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482eca78-2d48-483b-8f1c-38092bfb5ddb admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:02.919503 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482eca78-2d48-483b-8f1c-38092bfb5ddb admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:02.951836 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:02.979604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c19d1f-1111-4b66-a15f-d1cf6e2dee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:02.981229 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c19d1f-1111-4b66-a15f-d1cf6e2dee67 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:02.981229 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c19d1f-1111-4b66-a15f-d1cf6e2dee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:02.981463 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c19d1f-1111-4b66-a15f-d1cf6e2dee67 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:02.982083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c19d1f-1111-4b66-a15f-d1cf6e2dee67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:02.984053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c19d1f-1111-4b66-a15f-d1cf6e2dee67 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:03.009026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1154/2340] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:32:02 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:32:03.010261 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1408e0-827b-45b6-8d1b-d460d08ec72e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:03.022126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1408e0-827b-45b6-8d1b-d460d08ec72e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:03.027717 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b96f-598e-45c5-9eb8-2b1ac5b659d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:03.028397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b96f-598e-45c5-9eb8-2b1ac5b659d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:03.028681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b96f-598e-45c5-9eb8-2b1ac5b659d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:03.028998 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b96f-598e-45c5-9eb8-2b1ac5b659d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:03.029738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0b96f-598e-45c5-9eb8-2b1ac5b659d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:03.031596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0b96f-598e-45c5-9eb8-2b1ac5b659d5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:03.046361 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1187/2341] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:32:03.047524 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c19d1f-1111-4b66-a15f-d1cf6e2dee67 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:03.064600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c19d1f-1111-4b66-a15f-d1cf6e2dee67 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:03.073817 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843a8db-ec9c-4fac-b92d-76f22acfaeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:03.074458 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843a8db-ec9c-4fac-b92d-76f22acfaeed admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:03.074746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843a8db-ec9c-4fac-b92d-76f22acfaeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:03.075026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843a8db-ec9c-4fac-b92d-76f22acfaeed admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:03.075777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843a8db-ec9c-4fac-b92d-76f22acfaeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:03.077412 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843a8db-ec9c-4fac-b92d-76f22acfaeed admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:03.088047 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1155/2342] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:32:03.092750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b96f-598e-45c5-9eb8-2b1ac5b659d5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:03.102689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b96f-598e-45c5-9eb8-2b1ac5b659d5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:03.107962 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c878494-0299-4360-8827-22fe64ed594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:03.108903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c878494-0299-4360-8827-22fe64ed594f admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:03.109267 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c878494-0299-4360-8827-22fe64ed594f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:03.109612 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c878494-0299-4360-8827-22fe64ed594f admin admin] PATH_INFO: `/v3/projects/06f6cd0802c546718251373edb3c8879/users/3a538a2f16b3484f903ce74ee2f9e12d/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:03.124121 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c878494-0299-4360-8827-22fe64ed594f admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f6cd0802c546718251373edb3c8879, user_id=3a538a2f16b3484f903ce74ee2f9e12d, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:03.126908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c878494-0299-4360-8827-22fe64ed594f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:03.143599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1188/2343] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:32:03 2022] PUT /identity/v3/projects/06f6cd0802c546718251373edb3c8879/users/3a538a2f16b3484f903ce74ee2f9e12d/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:03.154757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462814b9-581f-4988-b1a8-f90a083de431 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:03.155054 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462814b9-581f-4988-b1a8-f90a083de431 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:03.155596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462814b9-581f-4988-b1a8-f90a083de431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:03.202899 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-462814b9-581f-4988-b1a8-f90a083de431 None None] MFA Rules not processed for user `3a538a2f16b3484f903ce74ee2f9e12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:03.205313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-462814b9-581f-4988-b1a8-f90a083de431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:03.294094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1156/2344] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:03.306914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c878494-0299-4360-8827-22fe64ed594f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:03.310059 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8c878494-0299-4360-8827-22fe64ed594f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:03.373613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c878494-0299-4360-8827-22fe64ed594f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:03.377681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755fa29-d59d-409b-b0e8-38b09a0bec4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:03.378332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755fa29-d59d-409b-b0e8-38b09a0bec4d service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:03.378613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755fa29-d59d-409b-b0e8-38b09a0bec4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:03.378887 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755fa29-d59d-409b-b0e8-38b09a0bec4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:03.389682 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755fa29-d59d-409b-b0e8-38b09a0bec4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:03.391130 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755fa29-d59d-409b-b0e8-38b09a0bec4d service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:03.400419 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1189/2345] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:08.682723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462814b9-581f-4988-b1a8-f90a083de431 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:08.747670 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462814b9-581f-4988-b1a8-f90a083de431 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:08.754930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01871fb5-cbba-4fa9-a293-06e6324d58c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:08.756484 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01871fb5-cbba-4fa9-a293-06e6324d58c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:08.756841 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01871fb5-cbba-4fa9-a293-06e6324d58c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:08.757189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01871fb5-cbba-4fa9-a293-06e6324d58c6 admin admin] PATH_INFO: `/v3/users/3a538a2f16b3484f903ce74ee2f9e12d` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:08.758396 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01871fb5-cbba-4fa9-a293-06e6324d58c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a538a2f16b3484f903ce74ee2f9e12d)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:08.760342 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01871fb5-cbba-4fa9-a293-06e6324d58c6 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:08.809724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:08.822451 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-01871fb5-cbba-4fa9-a293-06e6324d58c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a538a2f16b3484f903ce74ee2f9e12d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:08.830798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-01871fb5-cbba-4fa9-a293-06e6324d58c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a538a2f16b3484f903ce74ee2f9e12d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:08.831717 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-01871fb5-cbba-4fa9-a293-06e6324d58c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a538a2f16b3484f903ce74ee2f9e12d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:08.845052 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-01871fb5-cbba-4fa9-a293-06e6324d58c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a538a2f16b3484f903ce74ee2f9e12d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:08.853341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-01871fb5-cbba-4fa9-a293-06e6324d58c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a538a2f16b3484f903ce74ee2f9e12d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:08.859850 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1157/2346] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:32:08 2022] DELETE /identity/v3/users/3a538a2f16b3484f903ce74ee2f9e12d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:08.864478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973876de-002b-450e-b324-e2d956e2c5ad None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:08.864955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973876de-002b-450e-b324-e2d956e2c5ad None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:08.865051 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973876de-002b-450e-b324-e2d956e2c5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:08.882710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-973876de-002b-450e-b324-e2d956e2c5ad None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:08.883924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-973876de-002b-450e-b324-e2d956e2c5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:08.945572 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:08.978471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1190/2347] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:08.988272 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01871fb5-cbba-4fa9-a293-06e6324d58c6 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:08.989832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-01871fb5-cbba-4fa9-a293-06e6324d58c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:09.085365 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01871fb5-cbba-4fa9-a293-06e6324d58c6 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:09.089906 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487b2f9-fb4d-43d3-a861-9a3d2200503e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:09.090651 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487b2f9-fb4d-43d3-a861-9a3d2200503e service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:09.090993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487b2f9-fb4d-43d3-a861-9a3d2200503e service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:09.091343 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487b2f9-fb4d-43d3-a861-9a3d2200503e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:09.102879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487b2f9-fb4d-43d3-a861-9a3d2200503e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:09.104525 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487b2f9-fb4d-43d3-a861-9a3d2200503e service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:09.117663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1158/2348] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:09.121922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973876de-002b-450e-b324-e2d956e2c5ad None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:09.123470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-973876de-002b-450e-b324-e2d956e2c5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:09.200741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973876de-002b-450e-b324-e2d956e2c5ad None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:09.206790 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929320c-c79d-4f02-b6ea-6d2677fa6b81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:09.208508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929320c-c79d-4f02-b6ea-6d2677fa6b81 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:09.209171 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929320c-c79d-4f02-b6ea-6d2677fa6b81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:09.210507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929320c-c79d-4f02-b6ea-6d2677fa6b81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:09.213394 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5929320c-c79d-4f02-b6ea-6d2677fa6b81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:09.294084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929320c-c79d-4f02-b6ea-6d2677fa6b81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:09.295563 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929320c-c79d-4f02-b6ea-6d2677fa6b81 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:09.305871 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1191/2349] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:09 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:32:09.742761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487b2f9-fb4d-43d3-a861-9a3d2200503e service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:09.744218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4487b2f9-fb4d-43d3-a861-9a3d2200503e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:09.765208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487b2f9-fb4d-43d3-a861-9a3d2200503e service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:09.780025 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3cb32-c389-490e-b58a-648be827f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:09.781601 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3cb32-c389-490e-b58a-648be827f039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:09.781601 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3cb32-c389-490e-b58a-648be827f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:09.781766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3cb32-c389-490e-b58a-648be827f039 admin admin] PATH_INFO: `/v3/projects/06f6cd0802c546718251373edb3c8879` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:09.784109 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3cb32-c389-490e-b58a-648be827f039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06f6cd0802c546718251373edb3c8879)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:09.786135 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3cb32-c389-490e-b58a-648be827f039 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:09.871201 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78b3cb32-c389-490e-b58a-648be827f039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06f6cd0802c546718251373edb3c8879', 'request_id': 'req-78b3cb32-c389-490e-b58a-648be827f039'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:09.890189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78b3cb32-c389-490e-b58a-648be827f039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06f6cd0802c546718251373edb3c8879', 'request_id': 'req-78b3cb32-c389-490e-b58a-648be827f039'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:09.902333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78b3cb32-c389-490e-b58a-648be827f039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06f6cd0802c546718251373edb3c8879', 'request_id': 'req-78b3cb32-c389-490e-b58a-648be827f039'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:09.921388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78b3cb32-c389-490e-b58a-648be827f039 admin admin] The token cache is being invalidate because project 06f6cd0802c546718251373edb3c8879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:32:09.921688 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78b3cb32-c389-490e-b58a-648be827f039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:09.922550 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78b3cb32-c389-490e-b58a-648be827f039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:09.937027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1159/2350] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:32:09 2022] DELETE /identity/v3/projects/06f6cd0802c546718251373edb3c8879 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:16.487934 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929320c-c79d-4f02-b6ea-6d2677fa6b81 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:16.489409 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5929320c-c79d-4f02-b6ea-6d2677fa6b81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:16.508510 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929320c-c79d-4f02-b6ea-6d2677fa6b81 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:16.588310 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5bf24-8b6c-4a98-ba5b-e3f9f779d8dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:16.589217 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5bf24-8b6c-4a98-ba5b-e3f9f779d8dc service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:16.590231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5bf24-8b6c-4a98-ba5b-e3f9f779d8dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:16.590830 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5bf24-8b6c-4a98-ba5b-e3f9f779d8dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:16.592904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d8d5bf24-8b6c-4a98-ba5b-e3f9f779d8dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:16.660003 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:16.678895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5bf24-8b6c-4a98-ba5b-e3f9f779d8dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:16.680867 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5bf24-8b6c-4a98-ba5b-e3f9f779d8dc service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:16.692973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1192/2351] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:16.881847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3cb32-c389-490e-b58a-648be827f039 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:16.884043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-78b3cb32-c389-490e-b58a-648be827f039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:16.901109 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3cb32-c389-490e-b58a-648be827f039 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:16.906139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde97032-80e4-4ca0-9618-a7a5d3bed8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:16.906884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde97032-80e4-4ca0-9618-a7a5d3bed8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:16.907075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde97032-80e4-4ca0-9618-a7a5d3bed8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:16.907352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde97032-80e4-4ca0-9618-a7a5d3bed8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:16.909167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-dde97032-80e4-4ca0-9618-a7a5d3bed8e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:16.958201 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:16.979795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde97032-80e4-4ca0-9618-a7a5d3bed8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:16.981289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde97032-80e4-4ca0-9618-a7a5d3bed8e6 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:16.991081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1160/2352] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:26.687521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:26.986496 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=9 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:32.941992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766eccd3-e68c-479e-8ee4-f3562a1ffbad None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:32.942462 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766eccd3-e68c-479e-8ee4-f3562a1ffbad None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:32.942554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766eccd3-e68c-479e-8ee4-f3562a1ffbad None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:32.943993 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1193/2353] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jul 21 22:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:32:32.952846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1adf05-0b66-46dd-83d4-466c7954fdc9 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:32.953305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1adf05-0b66-46dd-83d4-466c7954fdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:32.953423 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1adf05-0b66-46dd-83d4-466c7954fdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:32.971395 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-9d1adf05-0b66-46dd-83d4-466c7954fdc9 None None] MFA Rules not processed for user `5ba75bf6ef954eb59d8db1efa6c73d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:32.972603 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9d1adf05-0b66-46dd-83d4-466c7954fdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:33.047263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1161/2354] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jul 21 22:32:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:33.063042 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766eccd3-e68c-479e-8ee4-f3562a1ffbad None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:33.063042 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-766eccd3-e68c-479e-8ee4-f3562a1ffbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:33.077284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766eccd3-e68c-479e-8ee4-f3562a1ffbad None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:33.082551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0da9ab-42d2-49e2-b8b6-3babc5c2d98f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba75bf6ef954eb59d8db1efa6c73d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:33.083203 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0da9ab-42d2-49e2-b8b6-3babc5c2d98f service placement] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:33.083488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0da9ab-42d2-49e2-b8b6-3babc5c2d98f service placement] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:33.083767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0da9ab-42d2-49e2-b8b6-3babc5c2d98f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:33.093270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0da9ab-42d2-49e2-b8b6-3babc5c2d98f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:33.094883 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0da9ab-42d2-49e2-b8b6-3babc5c2d98f service placement] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:33.106323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1194/2355] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:33.543718 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1adf05-0b66-46dd-83d4-466c7954fdc9 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:33.545419 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9d1adf05-0b66-46dd-83d4-466c7954fdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:33.611089 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1adf05-0b66-46dd-83d4-466c7954fdc9 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:33.615627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc0cad-b9b1-4c11-8346-92777997749f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:33.616499 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc0cad-b9b1-4c11-8346-92777997749f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:33.616784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc0cad-b9b1-4c11-8346-92777997749f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:33.617093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc0cad-b9b1-4c11-8346-92777997749f admin admin] PATH_INFO: `/v3/users/889167bb87464e98904270152b60ad0e` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:33.618285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc0cad-b9b1-4c11-8346-92777997749f admin admin] RBAC: Authorizing `identity:delete_user(user_id=889167bb87464e98904270152b60ad0e)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:33.620257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc0cad-b9b1-4c11-8346-92777997749f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:33.665694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7bfc0cad-b9b1-4c11-8346-92777997749f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889167bb87464e98904270152b60ad0e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:33.672313 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7bfc0cad-b9b1-4c11-8346-92777997749f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889167bb87464e98904270152b60ad0e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:33.673013 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7bfc0cad-b9b1-4c11-8346-92777997749f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889167bb87464e98904270152b60ad0e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:33.684438 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7bfc0cad-b9b1-4c11-8346-92777997749f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889167bb87464e98904270152b60ad0e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:33.691542 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7bfc0cad-b9b1-4c11-8346-92777997749f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889167bb87464e98904270152b60ad0e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:33.698239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1162/2356] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:32:33 2022] DELETE /identity/v3/users/889167bb87464e98904270152b60ad0e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:33.870415 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0da9ab-42d2-49e2-b8b6-3babc5c2d98f service placement] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:33.881073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0da9ab-42d2-49e2-b8b6-3babc5c2d98f service placement] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:33.940867 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582be217-6a0c-4526-a39b-f703689c6bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:33.941767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be217-6a0c-4526-a39b-f703689c6bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:33.942051 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be217-6a0c-4526-a39b-f703689c6bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:33.942587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be217-6a0c-4526-a39b-f703689c6bfb admin admin] PATH_INFO: `/v3/projects/4fcb718080dc4669966dc77ae432a5ca` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:33.943482 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582be217-6a0c-4526-a39b-f703689c6bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fcb718080dc4669966dc77ae432a5ca)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:33.945425 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582be217-6a0c-4526-a39b-f703689c6bfb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:33.990546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-582be217-6a0c-4526-a39b-f703689c6bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fcb718080dc4669966dc77ae432a5ca', 'request_id': 'req-582be217-6a0c-4526-a39b-f703689c6bfb'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:33.996667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-582be217-6a0c-4526-a39b-f703689c6bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fcb718080dc4669966dc77ae432a5ca', 'request_id': 'req-582be217-6a0c-4526-a39b-f703689c6bfb'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:34.002066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-582be217-6a0c-4526-a39b-f703689c6bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fcb718080dc4669966dc77ae432a5ca', 'request_id': 'req-582be217-6a0c-4526-a39b-f703689c6bfb'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:34.014027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-582be217-6a0c-4526-a39b-f703689c6bfb admin admin] The token cache is being invalidate because project 4fcb718080dc4669966dc77ae432a5ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:32:34.014316 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-582be217-6a0c-4526-a39b-f703689c6bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:34.014927 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-582be217-6a0c-4526-a39b-f703689c6bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:34.016678 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1195/2357] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:32:33 2022] DELETE /identity/v3/projects/4fcb718080dc4669966dc77ae432a5ca => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:34.020782 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc0cad-b9b1-4c11-8346-92777997749f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:34.022240 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-7bfc0cad-b9b1-4c11-8346-92777997749f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:34.036101 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc0cad-b9b1-4c11-8346-92777997749f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:34.048107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:34.094789 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7de7a-508f-47dc-b449-7a64f5e2c490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:34.095664 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7de7a-508f-47dc-b449-7a64f5e2c490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:34.095941 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7de7a-508f-47dc-b449-7a64f5e2c490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:34.096214 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7de7a-508f-47dc-b449-7a64f5e2c490 admin admin] PATH_INFO: `/v3/users/aa6163fe336a416dab89c0f3e230b3e2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:34.097413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7de7a-508f-47dc-b449-7a64f5e2c490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa6163fe336a416dab89c0f3e230b3e2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:34.099325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7de7a-508f-47dc-b449-7a64f5e2c490 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:34.144588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-88a7de7a-508f-47dc-b449-7a64f5e2c490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6163fe336a416dab89c0f3e230b3e2'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:34.151909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-88a7de7a-508f-47dc-b449-7a64f5e2c490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6163fe336a416dab89c0f3e230b3e2'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:34.152565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-88a7de7a-508f-47dc-b449-7a64f5e2c490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6163fe336a416dab89c0f3e230b3e2'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:34.164761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-88a7de7a-508f-47dc-b449-7a64f5e2c490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6163fe336a416dab89c0f3e230b3e2'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:34.171982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-88a7de7a-508f-47dc-b449-7a64f5e2c490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6163fe336a416dab89c0f3e230b3e2'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:34.177838 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1163/2358] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:32:34 2022] DELETE /identity/v3/users/aa6163fe336a416dab89c0f3e230b3e2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:34.347348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582be217-6a0c-4526-a39b-f703689c6bfb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:34.348778 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-582be217-6a0c-4526-a39b-f703689c6bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:34.362148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582be217-6a0c-4526-a39b-f703689c6bfb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:34.418255 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f975fa-fbfa-439a-8541-608b2e6d7e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:34.419107 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f975fa-fbfa-439a-8541-608b2e6d7e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:34.419429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f975fa-fbfa-439a-8541-608b2e6d7e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:34.419683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f975fa-fbfa-439a-8541-608b2e6d7e51 admin admin] PATH_INFO: `/v3/projects/a9b9637b69c84e05acfe26da89f9df6b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:34.420858 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f975fa-fbfa-439a-8541-608b2e6d7e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b9637b69c84e05acfe26da89f9df6b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:34.422799 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f975fa-fbfa-439a-8541-608b2e6d7e51 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:34.443002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:34.467945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-02f975fa-fbfa-439a-8541-608b2e6d7e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b9637b69c84e05acfe26da89f9df6b', 'request_id': 'req-02f975fa-fbfa-439a-8541-608b2e6d7e51'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:34.474090 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-02f975fa-fbfa-439a-8541-608b2e6d7e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b9637b69c84e05acfe26da89f9df6b', 'request_id': 'req-02f975fa-fbfa-439a-8541-608b2e6d7e51'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:34.480065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-02f975fa-fbfa-439a-8541-608b2e6d7e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b9637b69c84e05acfe26da89f9df6b', 'request_id': 'req-02f975fa-fbfa-439a-8541-608b2e6d7e51'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:34.491971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-02f975fa-fbfa-439a-8541-608b2e6d7e51 admin admin] The token cache is being invalidate because project a9b9637b69c84e05acfe26da89f9df6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:32:34.492261 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-02f975fa-fbfa-439a-8541-608b2e6d7e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:34.492870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-02f975fa-fbfa-439a-8541-608b2e6d7e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:34.494441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1196/2359] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:32:34 2022] DELETE /identity/v3/projects/a9b9637b69c84e05acfe26da89f9df6b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:34.500772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc7451-0771-4167-9b56-99b9d0077e54 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:34.501094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc7451-0771-4167-9b56-99b9d0077e54 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:34.501372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc7451-0771-4167-9b56-99b9d0077e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:34.518770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-2acc7451-0771-4167-9b56-99b9d0077e54 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:34.519951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2acc7451-0771-4167-9b56-99b9d0077e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:34.576558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1164/2360] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:34.584595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332b612-48a2-4576-a8f1-d1422f1b53bb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:34.584886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332b612-48a2-4576-a8f1-d1422f1b53bb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:34.585201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332b612-48a2-4576-a8f1-d1422f1b53bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:34.603444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b332b612-48a2-4576-a8f1-d1422f1b53bb None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:34.605280 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b332b612-48a2-4576-a8f1-d1422f1b53bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:34.613040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1197/2361] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:34.616971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc7451-0771-4167-9b56-99b9d0077e54 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:34.626465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc7451-0771-4167-9b56-99b9d0077e54 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:34.630892 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f08a6-9d34-468c-a103-3fba061e9018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:34.631540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f08a6-9d34-468c-a103-3fba061e9018 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:34.631820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f08a6-9d34-468c-a103-3fba061e9018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:34.632091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f08a6-9d34-468c-a103-3fba061e9018 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:34.632805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f08a6-9d34-468c-a103-3fba061e9018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:32:34.633147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f08a6-9d34-468c-a103-3fba061e9018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:34.634714 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f08a6-9d34-468c-a103-3fba061e9018 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:34.645888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1165/2362] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:32:34.649850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332b612-48a2-4576-a8f1-d1422f1b53bb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:34.659735 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332b612-48a2-4576-a8f1-d1422f1b53bb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:34.664357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169333a7-d83b-4fd7-8c9a-e951dd86ce26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:34.665034 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169333a7-d83b-4fd7-8c9a-e951dd86ce26 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:34.665322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169333a7-d83b-4fd7-8c9a-e951dd86ce26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:34.665605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169333a7-d83b-4fd7-8c9a-e951dd86ce26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:34.666303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169333a7-d83b-4fd7-8c9a-e951dd86ce26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:34.668301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169333a7-d83b-4fd7-8c9a-e951dd86ce26 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:34.693528 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1198/2363] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:32:34 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:32:34.697350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f08a6-9d34-468c-a103-3fba061e9018 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:34.707872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f08a6-9d34-468c-a103-3fba061e9018 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:34.726003 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:34.764941 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9aca9-26c1-4ff5-9b07-f8a8a6743a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:34.765614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9aca9-26c1-4ff5-9b07-f8a8a6743a50 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:34.765896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9aca9-26c1-4ff5-9b07-f8a8a6743a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:34.766172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9aca9-26c1-4ff5-9b07-f8a8a6743a50 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:34.766851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9aca9-26c1-4ff5-9b07-f8a8a6743a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:34.768738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9aca9-26c1-4ff5-9b07-f8a8a6743a50 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:34.788538 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1166/2364] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:32:34 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:32:34.792719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169333a7-d83b-4fd7-8c9a-e951dd86ce26 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:34.802984 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169333a7-d83b-4fd7-8c9a-e951dd86ce26 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:34.808204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de592f-cf3e-4f63-8d19-5b9a836a85dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:34.808857 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de592f-cf3e-4f63-8d19-5b9a836a85dd admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:34.809171 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de592f-cf3e-4f63-8d19-5b9a836a85dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:34.809452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de592f-cf3e-4f63-8d19-5b9a836a85dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:34.810184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de592f-cf3e-4f63-8d19-5b9a836a85dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:34.811777 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de592f-cf3e-4f63-8d19-5b9a836a85dd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:34.823814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1199/2365] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:32:34.827565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9aca9-26c1-4ff5-9b07-f8a8a6743a50 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:34.837357 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9aca9-26c1-4ff5-9b07-f8a8a6743a50 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:34.841903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e405bfc-ca5a-41d5-b4ea-6a7936e211de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:34.842548 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e405bfc-ca5a-41d5-b4ea-6a7936e211de admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:34.842830 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e405bfc-ca5a-41d5-b4ea-6a7936e211de admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:34.843103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e405bfc-ca5a-41d5-b4ea-6a7936e211de admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:34.843819 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e405bfc-ca5a-41d5-b4ea-6a7936e211de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:34.845412 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e405bfc-ca5a-41d5-b4ea-6a7936e211de admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:34.855085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1167/2366] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:32:34.858883 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de592f-cf3e-4f63-8d19-5b9a836a85dd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:34.868628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de592f-cf3e-4f63-8d19-5b9a836a85dd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:34.873900 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ca934-15d1-43e8-b8af-408380b9972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:34.874764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ca934-15d1-43e8-b8af-408380b9972e admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:34.875635 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ca934-15d1-43e8-b8af-408380b9972e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:34.875924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ca934-15d1-43e8-b8af-408380b9972e admin admin] PATH_INFO: `/v3/projects/492abaf5800d49189c2133215f4ea5d6/users/39c83002e12445fcbe54b3db3bd01919/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:34.890085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ca934-15d1-43e8-b8af-408380b9972e admin admin] RBAC: Authorizing `identity:create_grant(project_id=492abaf5800d49189c2133215f4ea5d6, user_id=39c83002e12445fcbe54b3db3bd01919, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:34.892719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ca934-15d1-43e8-b8af-408380b9972e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:34.906303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1200/2367] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:32:34 2022] PUT /identity/v3/projects/492abaf5800d49189c2133215f4ea5d6/users/39c83002e12445fcbe54b3db3bd01919/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:32:34.916235 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee570bc-8bda-4e8b-848c-71578f6739a2 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:34.916600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee570bc-8bda-4e8b-848c-71578f6739a2 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:34.916883 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee570bc-8bda-4e8b-848c-71578f6739a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:34.943209 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-2ee570bc-8bda-4e8b-848c-71578f6739a2 None None] MFA Rules not processed for user `39c83002e12445fcbe54b3db3bd01919`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:34.944415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2ee570bc-8bda-4e8b-848c-71578f6739a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:35.007019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1168/2368] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:32:35.011427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ca934-15d1-43e8-b8af-408380b9972e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:35.075335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ca934-15d1-43e8-b8af-408380b9972e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:35.079905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3d8cb-e61f-4345-a90b-ae3318a20b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:35.080565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3d8cb-e61f-4345-a90b-ae3318a20b8b admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:35.080847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3d8cb-e61f-4345-a90b-ae3318a20b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:35.081156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3d8cb-e61f-4345-a90b-ae3318a20b8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:35.081854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3d8cb-e61f-4345-a90b-ae3318a20b8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:35.083747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3d8cb-e61f-4345-a90b-ae3318a20b8b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:35.108862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1201/2369] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:32:35 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:32:35.112912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee570bc-8bda-4e8b-848c-71578f6739a2 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:35.123996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee570bc-8bda-4e8b-848c-71578f6739a2 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:35.178027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbec84-4f58-4c18-9ca6-17ef9fe97e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:35.178696 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbec84-4f58-4c18-9ca6-17ef9fe97e40 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:35.178983 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbec84-4f58-4c18-9ca6-17ef9fe97e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:35.179268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbec84-4f58-4c18-9ca6-17ef9fe97e40 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:35.179954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbec84-4f58-4c18-9ca6-17ef9fe97e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:35.181900 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbec84-4f58-4c18-9ca6-17ef9fe97e40 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:35.201379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1169/2370] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:32:35 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:32:35.205305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3d8cb-e61f-4345-a90b-ae3318a20b8b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:35.215313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3d8cb-e61f-4345-a90b-ae3318a20b8b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:35.219850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe8b22-b069-48dc-95f7-9be6b975854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:35.220491 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe8b22-b069-48dc-95f7-9be6b975854d admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:35.220772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe8b22-b069-48dc-95f7-9be6b975854d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:35.221069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe8b22-b069-48dc-95f7-9be6b975854d admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:35.221780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe8b22-b069-48dc-95f7-9be6b975854d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:35.223383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe8b22-b069-48dc-95f7-9be6b975854d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:35.234496 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1202/2371] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:32:35.238360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbec84-4f58-4c18-9ca6-17ef9fe97e40 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:35.248114 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbec84-4f58-4c18-9ca6-17ef9fe97e40 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:35.252799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b01120-09b1-4e29-8f63-f7ecc32233f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:35.253693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b01120-09b1-4e29-8f63-f7ecc32233f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:35.253979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b01120-09b1-4e29-8f63-f7ecc32233f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:35.254258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b01120-09b1-4e29-8f63-f7ecc32233f8 admin admin] PATH_INFO: `/v3/projects/fa1511cb091148f085ef0bf13961423a/users/5627a95185204e7ebaeeada4560daace/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:35.268907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b01120-09b1-4e29-8f63-f7ecc32233f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1511cb091148f085ef0bf13961423a, user_id=5627a95185204e7ebaeeada4560daace, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:35.271584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b01120-09b1-4e29-8f63-f7ecc32233f8 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:35.274572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:35.286935 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1170/2372] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:32:35 2022] PUT /identity/v3/projects/fa1511cb091148f085ef0bf13961423a/users/5627a95185204e7ebaeeada4560daace/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:32:35.290826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe8b22-b069-48dc-95f7-9be6b975854d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:35.300555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe8b22-b069-48dc-95f7-9be6b975854d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:35.312811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:35.356788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74c357-a38e-49ce-a19a-a9a867fb8348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:35.357431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74c357-a38e-49ce-a19a-a9a867fb8348 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:35.357712 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74c357-a38e-49ce-a19a-a9a867fb8348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:35.357987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74c357-a38e-49ce-a19a-a9a867fb8348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:35.358699 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74c357-a38e-49ce-a19a-a9a867fb8348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:35.360272 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74c357-a38e-49ce-a19a-a9a867fb8348 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:35.370182 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1203/2373] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:32:35.374173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b01120-09b1-4e29-8f63-f7ecc32233f8 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:35.384253 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b01120-09b1-4e29-8f63-f7ecc32233f8 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:35.389521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e652b-5acb-40cc-9186-c45b2b6de46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:35.390394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e652b-5acb-40cc-9186-c45b2b6de46c admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:35.390674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e652b-5acb-40cc-9186-c45b2b6de46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:35.390945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e652b-5acb-40cc-9186-c45b2b6de46c admin admin] PATH_INFO: `/v3/projects/fa1511cb091148f085ef0bf13961423a/users/5627a95185204e7ebaeeada4560daace/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:35.392902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e652b-5acb-40cc-9186-c45b2b6de46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1511cb091148f085ef0bf13961423a, user_id=5627a95185204e7ebaeeada4560daace, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:35.395541 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e652b-5acb-40cc-9186-c45b2b6de46c admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:35.406534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1171/2374] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:32:35 2022] PUT /identity/v3/projects/fa1511cb091148f085ef0bf13961423a/users/5627a95185204e7ebaeeada4560daace/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:32:35.416696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e8aa4-6b20-4c1f-af2c-340dbf4ecdee None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:35.417125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e8aa4-6b20-4c1f-af2c-340dbf4ecdee None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:35.417428 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e8aa4-6b20-4c1f-af2c-340dbf4ecdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:35.443134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a32e8aa4-6b20-4c1f-af2c-340dbf4ecdee None None] MFA Rules not processed for user `5627a95185204e7ebaeeada4560daace`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:35.444347 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a32e8aa4-6b20-4c1f-af2c-340dbf4ecdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:35.517040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1204/2375] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:35.527696 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e652b-5acb-40cc-9186-c45b2b6de46c admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:35.529454 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-383e652b-5acb-40cc-9186-c45b2b6de46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:35.586628 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e652b-5acb-40cc-9186-c45b2b6de46c admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:35.590340 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fdde5-57ec-4e78-8ec7-416971fb2602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:35.590972 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fdde5-57ec-4e78-8ec7-416971fb2602 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:35.591252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fdde5-57ec-4e78-8ec7-416971fb2602 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:35.591526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fdde5-57ec-4e78-8ec7-416971fb2602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:35.646276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fdde5-57ec-4e78-8ec7-416971fb2602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:35.647624 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fdde5-57ec-4e78-8ec7-416971fb2602 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:35.656887 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1172/2376] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:38.167179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e8aa4-6b20-4c1f-af2c-340dbf4ecdee None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:38.226601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e8aa4-6b20-4c1f-af2c-340dbf4ecdee None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:38.231041 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b3a4b-579e-4ee8-897f-d50d8572e77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:38.231895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b3a4b-579e-4ee8-897f-d50d8572e77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:38.232175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b3a4b-579e-4ee8-897f-d50d8572e77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:38.232450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b3a4b-579e-4ee8-897f-d50d8572e77c admin admin] PATH_INFO: `/v3/users/39c83002e12445fcbe54b3db3bd01919` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:38.233654 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b3a4b-579e-4ee8-897f-d50d8572e77c admin admin] RBAC: Authorizing `identity:delete_user(user_id=39c83002e12445fcbe54b3db3bd01919)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:38.235560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b3a4b-579e-4ee8-897f-d50d8572e77c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:38.274558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:38.280974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4f8b3a4b-579e-4ee8-897f-d50d8572e77c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39c83002e12445fcbe54b3db3bd01919'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:38.293008 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4f8b3a4b-579e-4ee8-897f-d50d8572e77c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39c83002e12445fcbe54b3db3bd01919'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:38.299816 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4f8b3a4b-579e-4ee8-897f-d50d8572e77c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39c83002e12445fcbe54b3db3bd01919'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:38.300581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4f8b3a4b-579e-4ee8-897f-d50d8572e77c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39c83002e12445fcbe54b3db3bd01919'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:38.308281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4f8b3a4b-579e-4ee8-897f-d50d8572e77c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39c83002e12445fcbe54b3db3bd01919'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:38.314086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1205/2377] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:32:38 2022] DELETE /identity/v3/users/39c83002e12445fcbe54b3db3bd01919 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:38.318675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e173e-05a5-4f2d-a9fa-9481862d5e90 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:38.319145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e173e-05a5-4f2d-a9fa-9481862d5e90 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:38.319236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e173e-05a5-4f2d-a9fa-9481862d5e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:38.337041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-992e173e-05a5-4f2d-a9fa-9481862d5e90 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:38.338739 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-992e173e-05a5-4f2d-a9fa-9481862d5e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:38.393981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1173/2378] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:38.403847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b3a4b-579e-4ee8-897f-d50d8572e77c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:38.405507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4f8b3a4b-579e-4ee8-897f-d50d8572e77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:38.460414 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b3a4b-579e-4ee8-897f-d50d8572e77c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:38.464581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e9125-3a61-4aa4-8841-0ced061b8c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:38.465259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e9125-3a61-4aa4-8841-0ced061b8c34 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:38.465536 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e9125-3a61-4aa4-8841-0ced061b8c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:38.465807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e9125-3a61-4aa4-8841-0ced061b8c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:38.474782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e9125-3a61-4aa4-8841-0ced061b8c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:38.476189 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e9125-3a61-4aa4-8841-0ced061b8c34 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:38.486075 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1206/2379] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:38.752271 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e173e-05a5-4f2d-a9fa-9481862d5e90 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:38.753864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-992e173e-05a5-4f2d-a9fa-9481862d5e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:38.768195 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e173e-05a5-4f2d-a9fa-9481862d5e90 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:38.772871 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ce172-b7f1-4bef-963e-d628cae321c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:38.773896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ce172-b7f1-4bef-963e-d628cae321c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:38.774323 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ce172-b7f1-4bef-963e-d628cae321c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:38.774606 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ce172-b7f1-4bef-963e-d628cae321c6 admin admin] PATH_INFO: `/v3/projects/492abaf5800d49189c2133215f4ea5d6` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:38.775969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ce172-b7f1-4bef-963e-d628cae321c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=492abaf5800d49189c2133215f4ea5d6)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:38.777963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ce172-b7f1-4bef-963e-d628cae321c6 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:38.813422 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:38.826727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b02ce172-b7f1-4bef-963e-d628cae321c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492abaf5800d49189c2133215f4ea5d6', 'request_id': 'req-b02ce172-b7f1-4bef-963e-d628cae321c6'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:38.834072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b02ce172-b7f1-4bef-963e-d628cae321c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492abaf5800d49189c2133215f4ea5d6', 'request_id': 'req-b02ce172-b7f1-4bef-963e-d628cae321c6'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:38.839533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b02ce172-b7f1-4bef-963e-d628cae321c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492abaf5800d49189c2133215f4ea5d6', 'request_id': 'req-b02ce172-b7f1-4bef-963e-d628cae321c6'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:38.850451 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b02ce172-b7f1-4bef-963e-d628cae321c6 admin admin] The token cache is being invalidate because project 492abaf5800d49189c2133215f4ea5d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:32:38.850741 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b02ce172-b7f1-4bef-963e-d628cae321c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:38.851372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b02ce172-b7f1-4bef-963e-d628cae321c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:38.852916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1174/2380] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:32:38 2022] DELETE /identity/v3/projects/492abaf5800d49189c2133215f4ea5d6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:38.857523 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e9125-3a61-4aa4-8841-0ced061b8c34 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:38.867224 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e9125-3a61-4aa4-8841-0ced061b8c34 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:38.922966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421bf48-d735-4f03-b4b8-763b0ed40e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:38.923889 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421bf48-d735-4f03-b4b8-763b0ed40e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:38.924171 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421bf48-d735-4f03-b4b8-763b0ed40e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:38.924443 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421bf48-d735-4f03-b4b8-763b0ed40e16 admin admin] PATH_INFO: `/v3/users/5627a95185204e7ebaeeada4560daace` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:38.925629 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421bf48-d735-4f03-b4b8-763b0ed40e16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5627a95185204e7ebaeeada4560daace)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:38.927546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421bf48-d735-4f03-b4b8-763b0ed40e16 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:38.971134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3421bf48-d735-4f03-b4b8-763b0ed40e16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5627a95185204e7ebaeeada4560daace'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:38.982207 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:38.983363 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3421bf48-d735-4f03-b4b8-763b0ed40e16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5627a95185204e7ebaeeada4560daace'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:38.991899 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3421bf48-d735-4f03-b4b8-763b0ed40e16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5627a95185204e7ebaeeada4560daace'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:38.992601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3421bf48-d735-4f03-b4b8-763b0ed40e16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5627a95185204e7ebaeeada4560daace'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:39.000730 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3421bf48-d735-4f03-b4b8-763b0ed40e16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5627a95185204e7ebaeeada4560daace'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:39.006637 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1207/2381] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:32:38 2022] DELETE /identity/v3/users/5627a95185204e7ebaeeada4560daace => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:39.280616 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ce172-b7f1-4bef-963e-d628cae321c6 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:39.282097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b02ce172-b7f1-4bef-963e-d628cae321c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:39.296518 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ce172-b7f1-4bef-963e-d628cae321c6 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:39.355983 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca7246-f868-487d-b760-9a00a03e66ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:39.356843 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca7246-f868-487d-b760-9a00a03e66ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:39.357160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca7246-f868-487d-b760-9a00a03e66ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:39.357439 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca7246-f868-487d-b760-9a00a03e66ce admin admin] PATH_INFO: `/v3/projects/fa1511cb091148f085ef0bf13961423a` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:39.358607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca7246-f868-487d-b760-9a00a03e66ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa1511cb091148f085ef0bf13961423a)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:39.360500 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca7246-f868-487d-b760-9a00a03e66ce admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:39.406374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-3fca7246-f868-487d-b760-9a00a03e66ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa1511cb091148f085ef0bf13961423a', 'request_id': 'req-3fca7246-f868-487d-b760-9a00a03e66ce'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:39.413354 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-3fca7246-f868-487d-b760-9a00a03e66ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa1511cb091148f085ef0bf13961423a', 'request_id': 'req-3fca7246-f868-487d-b760-9a00a03e66ce'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:39.419406 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-3fca7246-f868-487d-b760-9a00a03e66ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa1511cb091148f085ef0bf13961423a', 'request_id': 'req-3fca7246-f868-487d-b760-9a00a03e66ce'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:39.429976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-3fca7246-f868-487d-b760-9a00a03e66ce admin admin] The token cache is being invalidate because project fa1511cb091148f085ef0bf13961423a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:32:39.430261 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-3fca7246-f868-487d-b760-9a00a03e66ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:39.430896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-3fca7246-f868-487d-b760-9a00a03e66ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:39.433279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1175/2382] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:32:39 2022] DELETE /identity/v3/projects/fa1511cb091148f085ef0bf13961423a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:39.438274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4138-6e67-4ace-8ea7-fd3911d0bd36 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:39.438732 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4138-6e67-4ace-8ea7-fd3911d0bd36 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:39.438877 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4138-6e67-4ace-8ea7-fd3911d0bd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:39.457561 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ce8b4138-6e67-4ace-8ea7-fd3911d0bd36 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:39.458741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ce8b4138-6e67-4ace-8ea7-fd3911d0bd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:39.516753 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1208/2383] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:39.524321 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a9cd2-e07b-4217-9efe-defd9400482c None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:39.524607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a9cd2-e07b-4217-9efe-defd9400482c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:39.524885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a9cd2-e07b-4217-9efe-defd9400482c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:39.543435 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-0c2a9cd2-e07b-4217-9efe-defd9400482c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:39.544625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0c2a9cd2-e07b-4217-9efe-defd9400482c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:39.552379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1176/2384] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:39.556289 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b4138-6e67-4ace-8ea7-fd3911d0bd36 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:39.566354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b4138-6e67-4ace-8ea7-fd3911d0bd36 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:39.570859 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056a722-e63d-4c2b-b269-130ff0874d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:39.571505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056a722-e63d-4c2b-b269-130ff0874d65 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:39.571785 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056a722-e63d-4c2b-b269-130ff0874d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:39.572065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056a722-e63d-4c2b-b269-130ff0874d65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:39.572781 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056a722-e63d-4c2b-b269-130ff0874d65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:32:39.573116 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056a722-e63d-4c2b-b269-130ff0874d65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:39.574686 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056a722-e63d-4c2b-b269-130ff0874d65 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:39.585861 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1209/2385] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:32:39.589929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a9cd2-e07b-4217-9efe-defd9400482c None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:39.599170 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a9cd2-e07b-4217-9efe-defd9400482c None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:39.604271 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca106b1-5d14-4df0-b2e0-07e0ca000e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:39.604919 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca106b1-5d14-4df0-b2e0-07e0ca000e66 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:39.605233 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca106b1-5d14-4df0-b2e0-07e0ca000e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:39.605508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca106b1-5d14-4df0-b2e0-07e0ca000e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:39.606189 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca106b1-5d14-4df0-b2e0-07e0ca000e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:39.608070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca106b1-5d14-4df0-b2e0-07e0ca000e66 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:39.633289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1177/2386] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:32:39 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:32:39.637834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056a722-e63d-4c2b-b269-130ff0874d65 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:39.648745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056a722-e63d-4c2b-b269-130ff0874d65 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:39.704718 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120aacd1-0e32-4f4f-8bb6-c8eab9e01a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:39.705414 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120aacd1-0e32-4f4f-8bb6-c8eab9e01a18 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:39.705696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120aacd1-0e32-4f4f-8bb6-c8eab9e01a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:39.705972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120aacd1-0e32-4f4f-8bb6-c8eab9e01a18 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:39.706660 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120aacd1-0e32-4f4f-8bb6-c8eab9e01a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:39.708589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120aacd1-0e32-4f4f-8bb6-c8eab9e01a18 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:39.727037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1210/2387] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:32:39 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:32:39.731857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca106b1-5d14-4df0-b2e0-07e0ca000e66 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:39.741913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca106b1-5d14-4df0-b2e0-07e0ca000e66 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:39.747076 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b4283-735e-4002-99a1-a31d8cc2313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:39.747732 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b4283-735e-4002-99a1-a31d8cc2313b admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:39.748015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b4283-735e-4002-99a1-a31d8cc2313b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:39.748291 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b4283-735e-4002-99a1-a31d8cc2313b admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:39.749049 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b4283-735e-4002-99a1-a31d8cc2313b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:39.750630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b4283-735e-4002-99a1-a31d8cc2313b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:39.761539 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1178/2388] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:32:39.765317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120aacd1-0e32-4f4f-8bb6-c8eab9e01a18 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:39.775231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120aacd1-0e32-4f4f-8bb6-c8eab9e01a18 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:39.780677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d530f-aa45-4ec0-a115-b8e191aac61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:39.781354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d530f-aa45-4ec0-a115-b8e191aac61b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:39.781643 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d530f-aa45-4ec0-a115-b8e191aac61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:39.781920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d530f-aa45-4ec0-a115-b8e191aac61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:39.782635 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d530f-aa45-4ec0-a115-b8e191aac61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:39.784213 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d530f-aa45-4ec0-a115-b8e191aac61b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:39.794050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1211/2389] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:32:39.798373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b4283-735e-4002-99a1-a31d8cc2313b admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:39.809311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b4283-735e-4002-99a1-a31d8cc2313b admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:39.813887 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e9e4b-2aae-4fb7-8424-b661f0a7c3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:39.814770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e9e4b-2aae-4fb7-8424-b661f0a7c3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:39.815056 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e9e4b-2aae-4fb7-8424-b661f0a7c3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:39.815333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e9e4b-2aae-4fb7-8424-b661f0a7c3fe admin admin] PATH_INFO: `/v3/projects/d23701f280f644b8909defef3939af64/users/7ba8e97ae98e4638b2be8c8b98a79650/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:39.823790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:39.832050 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e9e4b-2aae-4fb7-8424-b661f0a7c3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23701f280f644b8909defef3939af64, user_id=7ba8e97ae98e4638b2be8c8b98a79650, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:39.835277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e9e4b-2aae-4fb7-8424-b661f0a7c3fe admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:39.847587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1179/2390] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:32:39 2022] PUT /identity/v3/projects/d23701f280f644b8909defef3939af64/users/7ba8e97ae98e4638b2be8c8b98a79650/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:32:39.857946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d9eac-1bf5-4955-adfa-8490dada072f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:39.858239 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d9eac-1bf5-4955-adfa-8490dada072f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:39.858523 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d9eac-1bf5-4955-adfa-8490dada072f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:39.884473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d96d9eac-1bf5-4955-adfa-8490dada072f None None] MFA Rules not processed for user `7ba8e97ae98e4638b2be8c8b98a79650`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:39.886377 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d96d9eac-1bf5-4955-adfa-8490dada072f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:39.919668 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:39.955246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1212/2391] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:39.959833 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e9e4b-2aae-4fb7-8424-b661f0a7c3fe admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:40.019690 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e9e4b-2aae-4fb7-8424-b661f0a7c3fe admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:40.024350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3849e5-06e0-4e58-bcfd-b6719ebc3b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:40.025036 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3849e5-06e0-4e58-bcfd-b6719ebc3b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:40.025328 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3849e5-06e0-4e58-bcfd-b6719ebc3b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:40.025605 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3849e5-06e0-4e58-bcfd-b6719ebc3b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:40.026306 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3849e5-06e0-4e58-bcfd-b6719ebc3b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:40.028187 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3849e5-06e0-4e58-bcfd-b6719ebc3b56 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:40.062421 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1180/2392] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:32:39 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:32:40.063774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d9eac-1bf5-4955-adfa-8490dada072f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:40.075359 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d9eac-1bf5-4955-adfa-8490dada072f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:40.131492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b09d9-be20-4246-9535-9de57f79ab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:40.132151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b09d9-be20-4246-9535-9de57f79ab47 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:40.132431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b09d9-be20-4246-9535-9de57f79ab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:40.132702 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b09d9-be20-4246-9535-9de57f79ab47 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:40.133428 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b09d9-be20-4246-9535-9de57f79ab47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:40.135950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b09d9-be20-4246-9535-9de57f79ab47 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:40.154871 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1213/2393] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:32:40 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:32:40.159166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3849e5-06e0-4e58-bcfd-b6719ebc3b56 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:40.170086 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3849e5-06e0-4e58-bcfd-b6719ebc3b56 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:40.174596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3503891-4f52-4463-87b6-6a688a0ba86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:40.175245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3503891-4f52-4463-87b6-6a688a0ba86e admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:40.175532 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3503891-4f52-4463-87b6-6a688a0ba86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:40.175808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3503891-4f52-4463-87b6-6a688a0ba86e admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:40.176645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3503891-4f52-4463-87b6-6a688a0ba86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:40.178255 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3503891-4f52-4463-87b6-6a688a0ba86e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:40.189402 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1181/2394] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:32:40.193363 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b09d9-be20-4246-9535-9de57f79ab47 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:40.203372 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b09d9-be20-4246-9535-9de57f79ab47 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:40.207995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b762b43-e4f3-4113-b5ec-36eec32f460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:40.208646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b762b43-e4f3-4113-b5ec-36eec32f460c admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:40.208951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b762b43-e4f3-4113-b5ec-36eec32f460c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:40.209250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b762b43-e4f3-4113-b5ec-36eec32f460c admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:40.209975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b762b43-e4f3-4113-b5ec-36eec32f460c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:40.211556 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b762b43-e4f3-4113-b5ec-36eec32f460c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:40.221623 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1214/2395] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:32:40.225978 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3503891-4f52-4463-87b6-6a688a0ba86e admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:40.236544 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3503891-4f52-4463-87b6-6a688a0ba86e admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:40.241371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd81748-316e-4e72-ab50-815296d516bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:40.242409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd81748-316e-4e72-ab50-815296d516bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:40.242861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd81748-316e-4e72-ab50-815296d516bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:40.243436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd81748-316e-4e72-ab50-815296d516bb admin admin] PATH_INFO: `/v3/projects/aa51a575c113444d9c2f7d7716d92866/users/f300d15ac4d149a9be546c6777e45618/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:40.259906 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd81748-316e-4e72-ab50-815296d516bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa51a575c113444d9c2f7d7716d92866, user_id=f300d15ac4d149a9be546c6777e45618, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:40.262598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd81748-316e-4e72-ab50-815296d516bb admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:40.276097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1182/2396] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:32:40 2022] PUT /identity/v3/projects/aa51a575c113444d9c2f7d7716d92866/users/f300d15ac4d149a9be546c6777e45618/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:40.342293 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cfd81-96cc-4b8f-9765-faff65179cf6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:40.342582 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cfd81-96cc-4b8f-9765-faff65179cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:40.342864 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cfd81-96cc-4b8f-9765-faff65179cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:40.370074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8d4cfd81-96cc-4b8f-9765-faff65179cf6 None None] MFA Rules not processed for user `f300d15ac4d149a9be546c6777e45618`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:40.371311 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8d4cfd81-96cc-4b8f-9765-faff65179cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:40.433614 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1215/2397] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:40.437913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd81748-316e-4e72-ab50-815296d516bb admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:40.496904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd81748-316e-4e72-ab50-815296d516bb admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:40.501650 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7c7db-b906-4232-be50-62357b798096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:40.502295 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7c7db-b906-4232-be50-62357b798096 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:40.502576 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7c7db-b906-4232-be50-62357b798096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:40.502848 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7c7db-b906-4232-be50-62357b798096 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:40.503552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7c7db-b906-4232-be50-62357b798096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:40.505460 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7c7db-b906-4232-be50-62357b798096 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:40.529010 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1183/2398] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:32:40 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:32:40.533372 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cfd81-96cc-4b8f-9765-faff65179cf6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:40.544429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cfd81-96cc-4b8f-9765-faff65179cf6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:40.584492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:40.600766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed45b7-7bb4-42a4-887f-e77c769f82e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:40.601465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed45b7-7bb4-42a4-887f-e77c769f82e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:40.601753 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed45b7-7bb4-42a4-887f-e77c769f82e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:40.602035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed45b7-7bb4-42a4-887f-e77c769f82e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:40.602727 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed45b7-7bb4-42a4-887f-e77c769f82e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:40.605316 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed45b7-7bb4-42a4-887f-e77c769f82e4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:40.623658 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1216/2399] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:32:40 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:32:40.627774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7c7db-b906-4232-be50-62357b798096 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:40.637947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7c7db-b906-4232-be50-62357b798096 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:40.642874 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fd87b-21d1-4bc3-b5fa-513f5b92ac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:40.643538 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fd87b-21d1-4bc3-b5fa-513f5b92ac96 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:40.643825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fd87b-21d1-4bc3-b5fa-513f5b92ac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:40.644107 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fd87b-21d1-4bc3-b5fa-513f5b92ac96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:40.644845 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fd87b-21d1-4bc3-b5fa-513f5b92ac96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:40.646507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fd87b-21d1-4bc3-b5fa-513f5b92ac96 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:40.657753 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1184/2400] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:32:40.661659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed45b7-7bb4-42a4-887f-e77c769f82e4 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:40.671532 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed45b7-7bb4-42a4-887f-e77c769f82e4 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:40.676077 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65067a2d-2404-47ea-b8bd-04bd75ccb888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:40.677024 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65067a2d-2404-47ea-b8bd-04bd75ccb888 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:40.677302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65067a2d-2404-47ea-b8bd-04bd75ccb888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:40.677574 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65067a2d-2404-47ea-b8bd-04bd75ccb888 admin admin] PATH_INFO: `/v3/projects/5e012babd7594bbba677001a88b31d5b/users/2b7ccf354b7a45cead1a22f9fc3215a2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:40.692389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65067a2d-2404-47ea-b8bd-04bd75ccb888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e012babd7594bbba677001a88b31d5b, user_id=2b7ccf354b7a45cead1a22f9fc3215a2, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:40.695246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65067a2d-2404-47ea-b8bd-04bd75ccb888 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:40.708114 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1217/2401] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:32:40 2022] PUT /identity/v3/projects/5e012babd7594bbba677001a88b31d5b/users/2b7ccf354b7a45cead1a22f9fc3215a2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:40.712046 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fd87b-21d1-4bc3-b5fa-513f5b92ac96 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:40.721738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fd87b-21d1-4bc3-b5fa-513f5b92ac96 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:40.729355 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:40.777722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22628e-c275-4f2c-845e-4582897b89f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:40.778387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22628e-c275-4f2c-845e-4582897b89f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:40.778675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22628e-c275-4f2c-845e-4582897b89f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:40.778943 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22628e-c275-4f2c-845e-4582897b89f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:40.779657 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22628e-c275-4f2c-845e-4582897b89f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:40.781524 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22628e-c275-4f2c-845e-4582897b89f3 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:40.791074 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1185/2402] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:32:40.795339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65067a2d-2404-47ea-b8bd-04bd75ccb888 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:40.805711 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65067a2d-2404-47ea-b8bd-04bd75ccb888 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:40.810834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe38344-191b-4aa8-975b-311b87201e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:40.811710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe38344-191b-4aa8-975b-311b87201e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:40.812007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe38344-191b-4aa8-975b-311b87201e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:40.812273 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe38344-191b-4aa8-975b-311b87201e75 admin admin] PATH_INFO: `/v3/projects/5e012babd7594bbba677001a88b31d5b/users/2b7ccf354b7a45cead1a22f9fc3215a2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:40.814239 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe38344-191b-4aa8-975b-311b87201e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e012babd7594bbba677001a88b31d5b, user_id=2b7ccf354b7a45cead1a22f9fc3215a2, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:40.816850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe38344-191b-4aa8-975b-311b87201e75 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:40.827324 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1218/2403] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:32:40 2022] PUT /identity/v3/projects/5e012babd7594bbba677001a88b31d5b/users/2b7ccf354b7a45cead1a22f9fc3215a2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:40.837280 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc18108-1712-476e-a1b5-fa00566e389e None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:40.837572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc18108-1712-476e-a1b5-fa00566e389e None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:40.837855 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc18108-1712-476e-a1b5-fa00566e389e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:40.863018 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-0dc18108-1712-476e-a1b5-fa00566e389e None None] MFA Rules not processed for user `2b7ccf354b7a45cead1a22f9fc3215a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:40.864217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0dc18108-1712-476e-a1b5-fa00566e389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:40.931086 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1186/2404] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:40.942834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe38344-191b-4aa8-975b-311b87201e75 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:40.944432 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7fe38344-191b-4aa8-975b-311b87201e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:41.001554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe38344-191b-4aa8-975b-311b87201e75 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:41.005196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e498e2-1253-497c-8728-af1b0082f12f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:41.005876 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e498e2-1253-497c-8728-af1b0082f12f service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:41.006162 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e498e2-1253-497c-8728-af1b0082f12f service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:41.006441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e498e2-1253-497c-8728-af1b0082f12f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:41.062941 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e498e2-1253-497c-8728-af1b0082f12f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:41.064378 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e498e2-1253-497c-8728-af1b0082f12f service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:41.073636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1219/2405] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:42.552384 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc18108-1712-476e-a1b5-fa00566e389e None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:42.554078 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0dc18108-1712-476e-a1b5-fa00566e389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:42.565549 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc18108-1712-476e-a1b5-fa00566e389e None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:42.569484 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe3425-fd7c-437d-a0ea-922649377674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:42.570131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3425-fd7c-437d-a0ea-922649377674 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:42.570418 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3425-fd7c-437d-a0ea-922649377674 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:42.570698 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3425-fd7c-437d-a0ea-922649377674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:42.625636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe3425-fd7c-437d-a0ea-922649377674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:42.626991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe3425-fd7c-437d-a0ea-922649377674 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:42.636150 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1187/2406] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:43.165092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e498e2-1253-497c-8728-af1b0082f12f service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:43.174116 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e498e2-1253-497c-8728-af1b0082f12f service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:43.177677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1be06-4c25-4846-9f3a-fac7b9ff3e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:43.178304 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1be06-4c25-4846-9f3a-fac7b9ff3e8b service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:43.178584 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1be06-4c25-4846-9f3a-fac7b9ff3e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:43.178883 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1be06-4c25-4846-9f3a-fac7b9ff3e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:43.187521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1be06-4c25-4846-9f3a-fac7b9ff3e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:43.188919 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1be06-4c25-4846-9f3a-fac7b9ff3e8b service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:43.198610 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1220/2407] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:47.023590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe3425-fd7c-437d-a0ea-922649377674 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:47.056340 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:47.089672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe3425-fd7c-437d-a0ea-922649377674 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:47.094182 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209288-5371-45c0-acfc-257eae97cd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:47.095057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209288-5371-45c0-acfc-257eae97cd2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:47.095341 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209288-5371-45c0-acfc-257eae97cd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:47.095625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209288-5371-45c0-acfc-257eae97cd2f admin admin] PATH_INFO: `/v3/users/7ba8e97ae98e4638b2be8c8b98a79650` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:47.096809 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209288-5371-45c0-acfc-257eae97cd2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ba8e97ae98e4638b2be8c8b98a79650)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:47.098771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209288-5371-45c0-acfc-257eae97cd2f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:47.145464 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7a209288-5371-45c0-acfc-257eae97cd2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ba8e97ae98e4638b2be8c8b98a79650'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:47.153329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7a209288-5371-45c0-acfc-257eae97cd2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ba8e97ae98e4638b2be8c8b98a79650'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:47.154032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7a209288-5371-45c0-acfc-257eae97cd2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ba8e97ae98e4638b2be8c8b98a79650'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:47.166300 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7a209288-5371-45c0-acfc-257eae97cd2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ba8e97ae98e4638b2be8c8b98a79650'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:47.174058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-7a209288-5371-45c0-acfc-257eae97cd2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ba8e97ae98e4638b2be8c8b98a79650'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:47.180418 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1188/2408] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:32:47 2022] DELETE /identity/v3/users/7ba8e97ae98e4638b2be8c8b98a79650 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:47.184908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f2c8e-b817-40de-a56b-b1622c6a8dae None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:47.185368 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f2c8e-b817-40de-a56b-b1622c6a8dae None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:47.185660 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f2c8e-b817-40de-a56b-b1622c6a8dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:47.205163 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-210f2c8e-b817-40de-a56b-b1622c6a8dae None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:32:47.206407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-210f2c8e-b817-40de-a56b-b1622c6a8dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:47.238623 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:47.267083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1221/2409] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:32:47.277834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209288-5371-45c0-acfc-257eae97cd2f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:47.279246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-7a209288-5371-45c0-acfc-257eae97cd2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:47.338935 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209288-5371-45c0-acfc-257eae97cd2f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:47.342741 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf338474-843f-448a-9b65-2ebdacf4a868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:47.343400 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf338474-843f-448a-9b65-2ebdacf4a868 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:47.343686 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf338474-843f-448a-9b65-2ebdacf4a868 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:47.343969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf338474-843f-448a-9b65-2ebdacf4a868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:47.353118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf338474-843f-448a-9b65-2ebdacf4a868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:47.354623 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf338474-843f-448a-9b65-2ebdacf4a868 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:47.364172 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1189/2410] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:32:47.772413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f2c8e-b817-40de-a56b-b1622c6a8dae None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:47.773944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-210f2c8e-b817-40de-a56b-b1622c6a8dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:47.786274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f2c8e-b817-40de-a56b-b1622c6a8dae None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:47.793787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:47.794803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:47.795153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:47.795495 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe admin admin] PATH_INFO: `/v3/projects/d23701f280f644b8909defef3939af64` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:47.796698 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d23701f280f644b8909defef3939af64)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:47.798746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:47.849603 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd23701f280f644b8909defef3939af64', 'request_id': 'req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:47.856379 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd23701f280f644b8909defef3939af64', 'request_id': 'req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:47.863055 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd23701f280f644b8909defef3939af64', 'request_id': 'req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:47.878760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe admin admin] The token cache is being invalidate because project d23701f280f644b8909defef3939af64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:32:47.879050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:47.879719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:47.881291 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1222/2411] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:32:47 2022] DELETE /identity/v3/projects/d23701f280f644b8909defef3939af64 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:32:47.885279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf338474-843f-448a-9b65-2ebdacf4a868 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:47.894953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf338474-843f-448a-9b65-2ebdacf4a868 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:47.944705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:47.955483 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43157859-917e-4c80-ac76-8628ddc6c761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:47.956573 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43157859-917e-4c80-ac76-8628ddc6c761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:47.957058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43157859-917e-4c80-ac76-8628ddc6c761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:47.957415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43157859-917e-4c80-ac76-8628ddc6c761 admin admin] PATH_INFO: `/v3/users/f300d15ac4d149a9be546c6777e45618` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:47.958837 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43157859-917e-4c80-ac76-8628ddc6c761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f300d15ac4d149a9be546c6777e45618)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:47.960776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43157859-917e-4c80-ac76-8628ddc6c761 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:48.006381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-43157859-917e-4c80-ac76-8628ddc6c761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f300d15ac4d149a9be546c6777e45618'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:48.013565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-43157859-917e-4c80-ac76-8628ddc6c761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f300d15ac4d149a9be546c6777e45618'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:48.014210 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-43157859-917e-4c80-ac76-8628ddc6c761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f300d15ac4d149a9be546c6777e45618'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:48.025812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-43157859-917e-4c80-ac76-8628ddc6c761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f300d15ac4d149a9be546c6777e45618'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:48.032996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-43157859-917e-4c80-ac76-8628ddc6c761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f300d15ac4d149a9be546c6777e45618'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:48.039100 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1190/2412] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:32:47 2022] DELETE /identity/v3/users/f300d15ac4d149a9be546c6777e45618 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:48.308285 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:48.309758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:48.323105 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1962a5-5f9f-441e-a2c4-9cc7e8c647fe admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:48.378239 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:48.379108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:48.379392 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:48.379670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6 admin admin] PATH_INFO: `/v3/projects/aa51a575c113444d9c2f7d7716d92866` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:48.380846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa51a575c113444d9c2f7d7716d92866)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:48.382819 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:48.427823 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa51a575c113444d9c2f7d7716d92866', 'request_id': 'req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:48.433975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa51a575c113444d9c2f7d7716d92866', 'request_id': 'req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:48.439507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa51a575c113444d9c2f7d7716d92866', 'request_id': 'req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:48.441141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:48.453859 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6 admin admin] The token cache is being invalidate because project aa51a575c113444d9c2f7d7716d92866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:32:48.454150 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:48.454776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:48.456314 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1223/2413] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:32:48 2022] DELETE /identity/v3/projects/aa51a575c113444d9c2f7d7716d92866 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:48.460338 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43157859-917e-4c80-ac76-8628ddc6c761 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:48.461796 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-43157859-917e-4c80-ac76-8628ddc6c761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:48.474870 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43157859-917e-4c80-ac76-8628ddc6c761 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:48.531198 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a70f4-3a1d-49d4-9374-8a625937b3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:48.532050 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a70f4-3a1d-49d4-9374-8a625937b3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:48.532330 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a70f4-3a1d-49d4-9374-8a625937b3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:48.532603 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a70f4-3a1d-49d4-9374-8a625937b3d7 admin admin] PATH_INFO: `/v3/users/2b7ccf354b7a45cead1a22f9fc3215a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:48.533790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a70f4-3a1d-49d4-9374-8a625937b3d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7ccf354b7a45cead1a22f9fc3215a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:48.535703 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a70f4-3a1d-49d4-9374-8a625937b3d7 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:48.579631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-438a70f4-3a1d-49d4-9374-8a625937b3d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7ccf354b7a45cead1a22f9fc3215a2'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:48.586409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-438a70f4-3a1d-49d4-9374-8a625937b3d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7ccf354b7a45cead1a22f9fc3215a2'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:48.587063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-438a70f4-3a1d-49d4-9374-8a625937b3d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7ccf354b7a45cead1a22f9fc3215a2'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:48.599199 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-438a70f4-3a1d-49d4-9374-8a625937b3d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7ccf354b7a45cead1a22f9fc3215a2'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:48.600818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:48.607071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-438a70f4-3a1d-49d4-9374-8a625937b3d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7ccf354b7a45cead1a22f9fc3215a2'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:48.616396 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1191/2414] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:32:48 2022] DELETE /identity/v3/users/2b7ccf354b7a45cead1a22f9fc3215a2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:48.881749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:32:48.883295 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:32:48.895891 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca2611-d0de-4af2-ade7-7708aeb6e0f6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:32:48.957764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac6136-c51f-4504-9a13-8a6a1f5cf37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:32:48.958678 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac6136-c51f-4504-9a13-8a6a1f5cf37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:32:48.958959 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac6136-c51f-4504-9a13-8a6a1f5cf37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:32:48.959235 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac6136-c51f-4504-9a13-8a6a1f5cf37c admin admin] PATH_INFO: `/v3/projects/5e012babd7594bbba677001a88b31d5b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:32:48.960421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac6136-c51f-4504-9a13-8a6a1f5cf37c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e012babd7594bbba677001a88b31d5b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:32:48.962349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac6136-c51f-4504-9a13-8a6a1f5cf37c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:32:49.007707 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-baac6136-c51f-4504-9a13-8a6a1f5cf37c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e012babd7594bbba677001a88b31d5b', 'request_id': 'req-baac6136-c51f-4504-9a13-8a6a1f5cf37c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:49.013835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-baac6136-c51f-4504-9a13-8a6a1f5cf37c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e012babd7594bbba677001a88b31d5b', 'request_id': 'req-baac6136-c51f-4504-9a13-8a6a1f5cf37c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:49.019474 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-baac6136-c51f-4504-9a13-8a6a1f5cf37c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e012babd7594bbba677001a88b31d5b', 'request_id': 'req-baac6136-c51f-4504-9a13-8a6a1f5cf37c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:49.031281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-baac6136-c51f-4504-9a13-8a6a1f5cf37c admin admin] The token cache is being invalidate because project 5e012babd7594bbba677001a88b31d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:32:49.031566 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-baac6136-c51f-4504-9a13-8a6a1f5cf37c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:49.032173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-baac6136-c51f-4504-9a13-8a6a1f5cf37c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:32:49.033709 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1224/2415] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:32:48 2022] DELETE /identity/v3/projects/5e012babd7594bbba677001a88b31d5b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:32:58.614385 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:59.028057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=53 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:14.518224 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a70f4-3a1d-49d4-9374-8a625937b3d7 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:33:14.519694 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-438a70f4-3a1d-49d4-9374-8a625937b3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:33:14.608540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a70f4-3a1d-49d4-9374-8a625937b3d7 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:33:14.707520 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8e502-b950-4979-a2e7-202b6e109ab5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba75bf6ef954eb59d8db1efa6c73d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:33:14.708290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8e502-b950-4979-a2e7-202b6e109ab5 service placement] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:33:14.708580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8e502-b950-4979-a2e7-202b6e109ab5 service placement] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:33:14.715586 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8e502-b950-4979-a2e7-202b6e109ab5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:33:14.718739 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-11f8e502-b950-4979-a2e7-202b6e109ab5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:33:14.738203 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8e502-b950-4979-a2e7-202b6e109ab5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:33:14.739933 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8e502-b950-4979-a2e7-202b6e109ab5 service placement] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:33:14.751247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1192/2416] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:33:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:33:23.822937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621d200-4d71-47e5-afc4-c46d458446af None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:33:23.823404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621d200-4d71-47e5-afc4-c46d458446af None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:33:23.823717 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621d200-4d71-47e5-afc4-c46d458446af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:33:23.846431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7621d200-4d71-47e5-afc4-c46d458446af None None] MFA Rules not processed for user `0ab0db1bbc72471a90bbfc2e47561a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:33:23.847661 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7621d200-4d71-47e5-afc4-c46d458446af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:33:23.905498 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1225/2417] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:33:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:33:24.746504 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=58 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:33.898002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=25 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:34.331063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55430a80-7d5d-4b72-bd79-e4f6ce8b258c None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:33:34.331554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55430a80-7d5d-4b72-bd79-e4f6ce8b258c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:33:34.331554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55430a80-7d5d-4b72-bd79-e4f6ce8b258c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:33:34.348991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-55430a80-7d5d-4b72-bd79-e4f6ce8b258c None None] MFA Rules not processed for user `1e24364e59144eae846d5a5efa260dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:33:34.350229 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-55430a80-7d5d-4b72-bd79-e4f6ce8b258c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:33:34.403490 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1193/2418] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:33:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:33:44.397079 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=25 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:06.400117 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982f166-3ca6-41f6-8315-7dad68e8f82c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:06.400688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982f166-3ca6-41f6-8315-7dad68e8f82c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:06.400688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982f166-3ca6-41f6-8315-7dad68e8f82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:06.418509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2982f166-3ca6-41f6-8315-7dad68e8f82c None None] MFA Rules not processed for user `985006f41c1d484aac532ed38b03e3df`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:34:06.420091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2982f166-3ca6-41f6-8315-7dad68e8f82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:06.473936 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1226/2419] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:34:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:34:16.467378 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=25 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:20.024562 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305c7a4-5dc9-4985-9f6b-14f6f90c7ce9 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:20.025063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305c7a4-5dc9-4985-9f6b-14f6f90c7ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:20.025164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305c7a4-5dc9-4985-9f6b-14f6f90c7ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:20.043515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-7305c7a4-5dc9-4985-9f6b-14f6f90c7ce9 None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:34:20.044699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-7305c7a4-5dc9-4985-9f6b-14f6f90c7ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:20.109407 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1194/2420] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jul 21 22:34:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:34:20.151229 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982f166-3ca6-41f6-8315-7dad68e8f82c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:20.152777 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2982f166-3ca6-41f6-8315-7dad68e8f82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:20.224019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982f166-3ca6-41f6-8315-7dad68e8f82c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:20.229517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d35a0-8771-4955-bc9a-297aab6aa321 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:20.230173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d35a0-8771-4955-bc9a-297aab6aa321 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:20.230460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d35a0-8771-4955-bc9a-297aab6aa321 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:20.230737 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d35a0-8771-4955-bc9a-297aab6aa321 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:20.238777 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d35a0-8771-4955-bc9a-297aab6aa321 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:20.240371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d35a0-8771-4955-bc9a-297aab6aa321 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:20.249112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1227/2421] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:34:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:34:28.057004 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305c7a4-5dc9-4985-9f6b-14f6f90c7ce9 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:28.058527 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-7305c7a4-5dc9-4985-9f6b-14f6f90c7ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:28.167281 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305c7a4-5dc9-4985-9f6b-14f6f90c7ce9 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:28.171812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081c7ee-bfb8-43aa-8732-924e21256f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:28.172668 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081c7ee-bfb8-43aa-8732-924e21256f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:28.172970 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081c7ee-bfb8-43aa-8732-924e21256f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:28.173249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081c7ee-bfb8-43aa-8732-924e21256f6f admin admin] PATH_INFO: `/v3/users/291bbfd399314cb6b9d7af01fcc0d31b` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:28.174434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081c7ee-bfb8-43aa-8732-924e21256f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=291bbfd399314cb6b9d7af01fcc0d31b)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:28.176336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081c7ee-bfb8-43aa-8732-924e21256f6f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:28.233651 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d081c7ee-bfb8-43aa-8732-924e21256f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '291bbfd399314cb6b9d7af01fcc0d31b'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:28.241082 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d081c7ee-bfb8-43aa-8732-924e21256f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '291bbfd399314cb6b9d7af01fcc0d31b'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:28.241886 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d081c7ee-bfb8-43aa-8732-924e21256f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '291bbfd399314cb6b9d7af01fcc0d31b'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:28.259494 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d081c7ee-bfb8-43aa-8732-924e21256f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '291bbfd399314cb6b9d7af01fcc0d31b'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:28.268218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d081c7ee-bfb8-43aa-8732-924e21256f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '291bbfd399314cb6b9d7af01fcc0d31b'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:28.278731 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1195/2422] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:34:28 2022] DELETE /identity/v3/users/291bbfd399314cb6b9d7af01fcc0d31b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:34:28.462478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d35a0-8771-4955-bc9a-297aab6aa321 service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:28.473338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d35a0-8771-4955-bc9a-297aab6aa321 service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:28.557722 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1609d-9dd2-4f72-9712-4b6578857485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:28.558678 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1609d-9dd2-4f72-9712-4b6578857485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:28.559054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1609d-9dd2-4f72-9712-4b6578857485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:28.559410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1609d-9dd2-4f72-9712-4b6578857485 admin admin] PATH_INFO: `/v3/projects/09d3e4a826704bbcb21602b97532b8a0` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:28.561038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1609d-9dd2-4f72-9712-4b6578857485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d3e4a826704bbcb21602b97532b8a0)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:28.563031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1609d-9dd2-4f72-9712-4b6578857485 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:28.612606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3dc1609d-9dd2-4f72-9712-4b6578857485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d3e4a826704bbcb21602b97532b8a0', 'request_id': 'req-3dc1609d-9dd2-4f72-9712-4b6578857485'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:28.619870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3dc1609d-9dd2-4f72-9712-4b6578857485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d3e4a826704bbcb21602b97532b8a0', 'request_id': 'req-3dc1609d-9dd2-4f72-9712-4b6578857485'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:28.626512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3dc1609d-9dd2-4f72-9712-4b6578857485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d3e4a826704bbcb21602b97532b8a0', 'request_id': 'req-3dc1609d-9dd2-4f72-9712-4b6578857485'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:28.641094 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3dc1609d-9dd2-4f72-9712-4b6578857485 admin admin] The token cache is being invalidate because project 09d3e4a826704bbcb21602b97532b8a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:34:28.641557 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3dc1609d-9dd2-4f72-9712-4b6578857485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:28.642403 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3dc1609d-9dd2-4f72-9712-4b6578857485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:28.644623 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1228/2423] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:34:28 2022] DELETE /identity/v3/projects/09d3e4a826704bbcb21602b97532b8a0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:34:28.649862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081c7ee-bfb8-43aa-8732-924e21256f6f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:28.650590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-d081c7ee-bfb8-43aa-8732-924e21256f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:28.667465 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081c7ee-bfb8-43aa-8732-924e21256f6f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:28.698422 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:28.744095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab1517-934c-4bd6-b494-e3dec36f507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:28.745038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab1517-934c-4bd6-b494-e3dec36f507f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:28.745309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab1517-934c-4bd6-b494-e3dec36f507f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:28.745582 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab1517-934c-4bd6-b494-e3dec36f507f admin admin] PATH_INFO: `/v3/users/66ca7ed9b65d4d8280ad87b9f3936672` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:28.746835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab1517-934c-4bd6-b494-e3dec36f507f admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ca7ed9b65d4d8280ad87b9f3936672)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:28.748894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab1517-934c-4bd6-b494-e3dec36f507f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:28.814982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-6eab1517-934c-4bd6-b494-e3dec36f507f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ca7ed9b65d4d8280ad87b9f3936672'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:28.824461 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-6eab1517-934c-4bd6-b494-e3dec36f507f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ca7ed9b65d4d8280ad87b9f3936672'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:28.825250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-6eab1517-934c-4bd6-b494-e3dec36f507f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ca7ed9b65d4d8280ad87b9f3936672'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:28.844131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-6eab1517-934c-4bd6-b494-e3dec36f507f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ca7ed9b65d4d8280ad87b9f3936672'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:28.854991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-6eab1517-934c-4bd6-b494-e3dec36f507f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ca7ed9b65d4d8280ad87b9f3936672'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:28.862974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1196/2424] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:34:28 2022] DELETE /identity/v3/users/66ca7ed9b65d4d8280ad87b9f3936672 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:34:29.090098 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1609d-9dd2-4f72-9712-4b6578857485 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:29.105893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3dc1609d-9dd2-4f72-9712-4b6578857485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:29.121741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1609d-9dd2-4f72-9712-4b6578857485 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:29.140036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:29.214066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e06352-caf2-4b4c-bd21-745fae6d1113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:29.216012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e06352-caf2-4b4c-bd21-745fae6d1113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:29.216311 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e06352-caf2-4b4c-bd21-745fae6d1113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:29.216603 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e06352-caf2-4b4c-bd21-745fae6d1113 admin admin] PATH_INFO: `/v3/projects/c1bed41218cc470a9bcad442ae29863e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:29.218163 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e06352-caf2-4b4c-bd21-745fae6d1113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1bed41218cc470a9bcad442ae29863e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:29.220494 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e06352-caf2-4b4c-bd21-745fae6d1113 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:29.272444 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-45e06352-caf2-4b4c-bd21-745fae6d1113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1bed41218cc470a9bcad442ae29863e', 'request_id': 'req-45e06352-caf2-4b4c-bd21-745fae6d1113'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:29.278973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-45e06352-caf2-4b4c-bd21-745fae6d1113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1bed41218cc470a9bcad442ae29863e', 'request_id': 'req-45e06352-caf2-4b4c-bd21-745fae6d1113'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:29.285498 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-45e06352-caf2-4b4c-bd21-745fae6d1113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1bed41218cc470a9bcad442ae29863e', 'request_id': 'req-45e06352-caf2-4b4c-bd21-745fae6d1113'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:29.299311 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-45e06352-caf2-4b4c-bd21-745fae6d1113 admin admin] The token cache is being invalidate because project c1bed41218cc470a9bcad442ae29863e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:34:29.299689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-45e06352-caf2-4b4c-bd21-745fae6d1113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:29.300572 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-45e06352-caf2-4b4c-bd21-745fae6d1113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:29.309122 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1229/2425] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:34:29 2022] DELETE /identity/v3/projects/c1bed41218cc470a9bcad442ae29863e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:34:38.858723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:39.296002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:40.245055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45f70d-130b-4c00-b0f9-b3c3962d035f None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:40.245531 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45f70d-130b-4c00-b0f9-b3c3962d035f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:40.245657 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45f70d-130b-4c00-b0f9-b3c3962d035f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:40.263799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-4c45f70d-130b-4c00-b0f9-b3c3962d035f None None] MFA Rules not processed for user `0ab0db1bbc72471a90bbfc2e47561a26`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:34:40.265012 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4c45f70d-130b-4c00-b0f9-b3c3962d035f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:40.318027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1197/2426] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:34:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:34:44.263739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e06352-caf2-4b4c-bd21-745fae6d1113 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:44.265365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-45e06352-caf2-4b4c-bd21-745fae6d1113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:44.333202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e06352-caf2-4b4c-bd21-745fae6d1113 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:44.337539 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae9006-0861-4dc2-97b0-9f8c327a2683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:44.338273 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae9006-0861-4dc2-97b0-9f8c327a2683 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:44.338565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae9006-0861-4dc2-97b0-9f8c327a2683 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:44.338851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae9006-0861-4dc2-97b0-9f8c327a2683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:44.340719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-82ae9006-0861-4dc2-97b0-9f8c327a2683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:44.379011 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45f70d-130b-4c00-b0f9-b3c3962d035f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:44.388495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45f70d-130b-4c00-b0f9-b3c3962d035f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:44.392179 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a862b4-418e-4535-8cd3-6c31cec943d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:44.392830 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a862b4-418e-4535-8cd3-6c31cec943d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:44.393145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a862b4-418e-4535-8cd3-6c31cec943d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:44.393433 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a862b4-418e-4535-8cd3-6c31cec943d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:44.395184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-89a862b4-418e-4535-8cd3-6c31cec943d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:44.414843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae9006-0861-4dc2-97b0-9f8c327a2683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:44.416272 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae9006-0861-4dc2-97b0-9f8c327a2683 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:44.427365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1230/2427] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:34:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:34:44.469607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a862b4-418e-4535-8cd3-6c31cec943d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:44.471041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a862b4-418e-4535-8cd3-6c31cec943d0 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:44.484149 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1198/2428] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:34:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:34:46.645890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae9006-0861-4dc2-97b0-9f8c327a2683 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:46.655535 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae9006-0861-4dc2-97b0-9f8c327a2683 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:46.659870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd7edf-33a9-4fd0-8b1b-f0f1b7943861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:46.660711 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd7edf-33a9-4fd0-8b1b-f0f1b7943861 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:46.661124 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd7edf-33a9-4fd0-8b1b-f0f1b7943861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:46.661475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd7edf-33a9-4fd0-8b1b-f0f1b7943861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:46.663499 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c7fd7edf-33a9-4fd0-8b1b-f0f1b7943861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:46.733136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd7edf-33a9-4fd0-8b1b-f0f1b7943861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:46.734594 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd7edf-33a9-4fd0-8b1b-f0f1b7943861 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:46.745005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1231/2429] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:34:47.588744 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5203d-ca61-4d9b-8e26-7cd9452b11b0 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:47.589446 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5203d-ca61-4d9b-8e26-7cd9452b11b0 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:47.589446 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5203d-ca61-4d9b-8e26-7cd9452b11b0 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:47.591154 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1199/2430] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jul 21 22:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:34:47.601534 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf683b-abec-4b3d-8f76-e43558c37320 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:47.601827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf683b-abec-4b3d-8f76-e43558c37320 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:47.602112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf683b-abec-4b3d-8f76-e43558c37320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:47.623329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2edf683b-abec-4b3d-8f76-e43558c37320 None None] MFA Rules not processed for user `23aaef489c0948fe8bc10acb8e76c84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:34:47.624712 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2edf683b-abec-4b3d-8f76-e43558c37320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:47.632013 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1232/2431] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jul 21 22:34:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:34:47.677538 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5203d-ca61-4d9b-8e26-7cd9452b11b0 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:47.679698 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-86f5203d-ca61-4d9b-8e26-7cd9452b11b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:47.700489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5203d-ca61-4d9b-8e26-7cd9452b11b0 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:47.704139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde8293-822e-42e5-a3ba-7da954946e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:47.704894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde8293-822e-42e5-a3ba-7da954946e21 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:47.705321 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde8293-822e-42e5-a3ba-7da954946e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:47.705752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde8293-822e-42e5-a3ba-7da954946e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:47.714782 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde8293-822e-42e5-a3ba-7da954946e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:47.716561 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde8293-822e-42e5-a3ba-7da954946e21 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:47.725980 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1200/2432] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:34:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:34:47.841389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e543-5e33-4a45-a5cf-0720b424558e None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:47.842512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e543-5e33-4a45-a5cf-0720b424558e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:47.843050 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e543-5e33-4a45-a5cf-0720b424558e None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:47.846982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1233/2433] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jul 21 22:34:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:34:47.852478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ce331-5663-4f10-941e-5670032d15f7 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:47.852478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ce331-5663-4f10-941e-5670032d15f7 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:47.852478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ce331-5663-4f10-941e-5670032d15f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:47.880726 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-087ce331-5663-4f10-941e-5670032d15f7 None None] MFA Rules not processed for user `2c04dc3ee4484afaab388cbb306974af`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:34:47.882623 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-087ce331-5663-4f10-941e-5670032d15f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:47.899064 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1201/2434] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jul 21 22:34:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:34:47.907159 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88e543-5e33-4a45-a5cf-0720b424558e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:47.919290 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88e543-5e33-4a45-a5cf-0720b424558e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:47.924625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9110f2-3de8-450e-b6a7-81902017d721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:47.925400 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9110f2-3de8-450e-b6a7-81902017d721 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:47.925675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9110f2-3de8-450e-b6a7-81902017d721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:47.926137 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9110f2-3de8-450e-b6a7-81902017d721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:47.941018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9110f2-3de8-450e-b6a7-81902017d721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:47.946434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9110f2-3de8-450e-b6a7-81902017d721 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:47.962201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1234/2435] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:34:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:34:50.904687 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ce331-5663-4f10-941e-5670032d15f7 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:50.906179 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-087ce331-5663-4f10-941e-5670032d15f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:50.928681 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ce331-5663-4f10-941e-5670032d15f7 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:50.940193 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aced099-e206-41a2-88a4-7cded1210e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:50.941202 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aced099-e206-41a2-88a4-7cded1210e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:50.941561 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aced099-e206-41a2-88a4-7cded1210e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:50.941903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aced099-e206-41a2-88a4-7cded1210e12 admin admin] PATH_INFO: `/v3/users/1e24364e59144eae846d5a5efa260dba` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:50.943273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aced099-e206-41a2-88a4-7cded1210e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e24364e59144eae846d5a5efa260dba)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:50.946151 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aced099-e206-41a2-88a4-7cded1210e12 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:50.995161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2aced099-e206-41a2-88a4-7cded1210e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e24364e59144eae846d5a5efa260dba'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:51.001988 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2aced099-e206-41a2-88a4-7cded1210e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e24364e59144eae846d5a5efa260dba'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:51.002740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2aced099-e206-41a2-88a4-7cded1210e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e24364e59144eae846d5a5efa260dba'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:51.010206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:51.016503 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2aced099-e206-41a2-88a4-7cded1210e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e24364e59144eae846d5a5efa260dba'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:51.025301 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2aced099-e206-41a2-88a4-7cded1210e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e24364e59144eae846d5a5efa260dba'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:51.031736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1202/2436] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:34:50 2022] DELETE /identity/v3/users/1e24364e59144eae846d5a5efa260dba => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:34:51.215808 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9110f2-3de8-450e-b6a7-81902017d721 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:51.234588 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9110f2-3de8-450e-b6a7-81902017d721 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:51.262898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:51.318874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052de3e-b986-4ee3-b34a-6b370d8afe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:51.319849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052de3e-b986-4ee3-b34a-6b370d8afe63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:51.320137 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052de3e-b986-4ee3-b34a-6b370d8afe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:51.320566 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052de3e-b986-4ee3-b34a-6b370d8afe63 admin admin] PATH_INFO: `/v3/projects/2bf549cae6ec41c2a5638ca0d10d4a99` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:51.323063 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052de3e-b986-4ee3-b34a-6b370d8afe63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf549cae6ec41c2a5638ca0d10d4a99)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:51.325322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052de3e-b986-4ee3-b34a-6b370d8afe63 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:51.388589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a052de3e-b986-4ee3-b34a-6b370d8afe63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf549cae6ec41c2a5638ca0d10d4a99', 'request_id': 'req-a052de3e-b986-4ee3-b34a-6b370d8afe63'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:51.397088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a052de3e-b986-4ee3-b34a-6b370d8afe63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf549cae6ec41c2a5638ca0d10d4a99', 'request_id': 'req-a052de3e-b986-4ee3-b34a-6b370d8afe63'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:51.405485 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a052de3e-b986-4ee3-b34a-6b370d8afe63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf549cae6ec41c2a5638ca0d10d4a99', 'request_id': 'req-a052de3e-b986-4ee3-b34a-6b370d8afe63'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:51.423477 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a052de3e-b986-4ee3-b34a-6b370d8afe63 admin admin] The token cache is being invalidate because project 2bf549cae6ec41c2a5638ca0d10d4a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:34:51.423972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a052de3e-b986-4ee3-b34a-6b370d8afe63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:51.424793 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a052de3e-b986-4ee3-b34a-6b370d8afe63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:34:51.427454 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1235/2437] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:34:51 2022] DELETE /identity/v3/projects/2bf549cae6ec41c2a5638ca0d10d4a99 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:34:51.432593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139c5c-e1cc-4c76-8375-2c39c8a9ef9c None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:51.432880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139c5c-e1cc-4c76-8375-2c39c8a9ef9c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:51.433180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139c5c-e1cc-4c76-8375-2c39c8a9ef9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:51.454319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-80139c5c-e1cc-4c76-8375-2c39c8a9ef9c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:34:51.456316 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-80139c5c-e1cc-4c76-8375-2c39c8a9ef9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:51.521659 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1203/2438] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:34:51.530089 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491716a9-0452-403e-8aad-0b4842b336d5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:51.530378 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491716a9-0452-403e-8aad-0b4842b336d5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:51.530655 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491716a9-0452-403e-8aad-0b4842b336d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:51.548610 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-491716a9-0452-403e-8aad-0b4842b336d5 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:34:51.549822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-491716a9-0452-403e-8aad-0b4842b336d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:51.557704 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1236/2439] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:34:51.561908 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80139c5c-e1cc-4c76-8375-2c39c8a9ef9c None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:51.571853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80139c5c-e1cc-4c76-8375-2c39c8a9ef9c None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:51.576389 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e411f2b-87dc-4aae-ac64-803966c98084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:51.577071 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e411f2b-87dc-4aae-ac64-803966c98084 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:51.577363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e411f2b-87dc-4aae-ac64-803966c98084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:51.577641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e411f2b-87dc-4aae-ac64-803966c98084 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:51.578371 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e411f2b-87dc-4aae-ac64-803966c98084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:34:51.578680 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e411f2b-87dc-4aae-ac64-803966c98084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:51.580260 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e411f2b-87dc-4aae-ac64-803966c98084 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:51.592059 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1204/2440] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:34:51.596038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491716a9-0452-403e-8aad-0b4842b336d5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:51.605108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491716a9-0452-403e-8aad-0b4842b336d5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:51.609667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f94be-1260-4020-b6ca-cd5fc3c11ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:51.610471 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f94be-1260-4020-b6ca-cd5fc3c11ede admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:51.610752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f94be-1260-4020-b6ca-cd5fc3c11ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:51.611023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f94be-1260-4020-b6ca-cd5fc3c11ede admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:51.611701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f94be-1260-4020-b6ca-cd5fc3c11ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:51.613631 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f94be-1260-4020-b6ca-cd5fc3c11ede admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:51.638762 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1237/2441] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:34:51 2022] POST /identity/v3/projects => generated 389 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:34:51.642676 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e411f2b-87dc-4aae-ac64-803966c98084 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:51.653022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e411f2b-87dc-4aae-ac64-803966c98084 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:51.707256 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1645b-01c8-43f8-a717-7ddbe4f01820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:51.707923 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1645b-01c8-43f8-a717-7ddbe4f01820 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:51.708205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1645b-01c8-43f8-a717-7ddbe4f01820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:51.708481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1645b-01c8-43f8-a717-7ddbe4f01820 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:51.709206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1645b-01c8-43f8-a717-7ddbe4f01820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:51.711679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1645b-01c8-43f8-a717-7ddbe4f01820 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:51.734419 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1205/2442] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:34:51 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:34:51.738689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f94be-1260-4020-b6ca-cd5fc3c11ede admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:51.749079 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f94be-1260-4020-b6ca-cd5fc3c11ede admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:51.753648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0d8fe-345a-4603-b4d0-de1cd87b6533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:51.754306 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0d8fe-345a-4603-b4d0-de1cd87b6533 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:51.754777 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0d8fe-345a-4603-b4d0-de1cd87b6533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:51.755061 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0d8fe-345a-4603-b4d0-de1cd87b6533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:51.755785 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0d8fe-345a-4603-b4d0-de1cd87b6533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:51.757911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0d8fe-345a-4603-b4d0-de1cd87b6533 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:51.769960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1238/2443] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:34:51.774160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1645b-01c8-43f8-a717-7ddbe4f01820 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:51.784443 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1645b-01c8-43f8-a717-7ddbe4f01820 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:51.789183 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020dccd-25d8-4251-a836-710fbd14d8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:51.789881 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020dccd-25d8-4251-a836-710fbd14d8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:51.790173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020dccd-25d8-4251-a836-710fbd14d8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:51.790458 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020dccd-25d8-4251-a836-710fbd14d8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:51.791196 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020dccd-25d8-4251-a836-710fbd14d8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:51.792854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020dccd-25d8-4251-a836-710fbd14d8e0 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:51.806353 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1206/2444] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:34:51.807488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0d8fe-345a-4603-b4d0-de1cd87b6533 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:51.817826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0d8fe-345a-4603-b4d0-de1cd87b6533 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:51.823031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed44027-cb9a-4edf-9eff-917060309e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:51.823917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed44027-cb9a-4edf-9eff-917060309e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:51.824202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed44027-cb9a-4edf-9eff-917060309e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:51.824617 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed44027-cb9a-4edf-9eff-917060309e89 admin admin] PATH_INFO: `/v3/projects/e7941c09b25f4a4dac6c8b040b14fddc/users/67216e70494c4f0296ace1d11600f6ab/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:51.840888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed44027-cb9a-4edf-9eff-917060309e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7941c09b25f4a4dac6c8b040b14fddc, user_id=67216e70494c4f0296ace1d11600f6ab, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:51.843567 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed44027-cb9a-4edf-9eff-917060309e89 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:51.857088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1239/2445] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:34:51 2022] PUT /identity/v3/projects/e7941c09b25f4a4dac6c8b040b14fddc/users/67216e70494c4f0296ace1d11600f6ab/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:34:51.862216 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e9ede-eb66-4454-8431-5ec481912dbb None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:51.862603 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e9ede-eb66-4454-8431-5ec481912dbb None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:51.862951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e9ede-eb66-4454-8431-5ec481912dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:51.881080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-f16e9ede-eb66-4454-8431-5ec481912dbb None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:34:51.882850 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f16e9ede-eb66-4454-8431-5ec481912dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:51.925638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:51.943026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1207/2446] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:34:51.953238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed44027-cb9a-4edf-9eff-917060309e89 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:51.955015 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bed44027-cb9a-4edf-9eff-917060309e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:51.999946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:52.013189 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed44027-cb9a-4edf-9eff-917060309e89 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:52.016756 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69739e4d-f67e-4480-b034-ba051d69432d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:52.017507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69739e4d-f67e-4480-b034-ba051d69432d service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:52.017787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69739e4d-f67e-4480-b034-ba051d69432d service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:52.018059 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69739e4d-f67e-4480-b034-ba051d69432d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:52.027407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69739e4d-f67e-4480-b034-ba051d69432d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:52.028824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69739e4d-f67e-4480-b034-ba051d69432d service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:52.038511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1240/2447] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:34:57.080026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edab22-71ea-4daa-823d-bbcd9e73c778 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:57.080501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edab22-71ea-4daa-823d-bbcd9e73c778 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:57.080600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edab22-71ea-4daa-823d-bbcd9e73c778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:57.114885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-92edab22-71ea-4daa-823d-bbcd9e73c778 None None] MFA Rules not processed for user `67216e70494c4f0296ace1d11600f6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:34:57.117350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-92edab22-71ea-4daa-823d-bbcd9e73c778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:57.184244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1208/2448] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:34:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:34:57.198910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69739e4d-f67e-4480-b034-ba051d69432d service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:34:57.200262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-69739e4d-f67e-4480-b034-ba051d69432d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:57.286397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69739e4d-f67e-4480-b034-ba051d69432d service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:34:57.296876 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c38e75-8e85-433a-bb2f-6d5186ee8adf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:34:57.301388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c38e75-8e85-433a-bb2f-6d5186ee8adf service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:57.303652 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c38e75-8e85-433a-bb2f-6d5186ee8adf service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:57.304021 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c38e75-8e85-433a-bb2f-6d5186ee8adf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:57.314827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c38e75-8e85-433a-bb2f-6d5186ee8adf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:34:57.316664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c38e75-8e85-433a-bb2f-6d5186ee8adf service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:34:57.332724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1241/2449] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:34:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:34:58.646529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e3edb-19db-4bdb-a665-2f2216d71954 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:34:58.647519 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e3edb-19db-4bdb-a665-2f2216d71954 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:34:58.647771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e3edb-19db-4bdb-a665-2f2216d71954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:34:58.671695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-211e3edb-19db-4bdb-a665-2f2216d71954 None None] MFA Rules not processed for user `67216e70494c4f0296ace1d11600f6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:34:58.672897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-211e3edb-19db-4bdb-a665-2f2216d71954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:34:58.680440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1209/2450] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:34:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:35:07.322739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=41 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:08.284705 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c38e75-8e85-433a-bb2f-6d5186ee8adf service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:08.286138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b5c38e75-8e85-433a-bb2f-6d5186ee8adf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:08.301000 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c38e75-8e85-433a-bb2f-6d5186ee8adf service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:08.307330 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c4a6d-aef2-4965-a104-cc72b8a7e83f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:08.307959 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c4a6d-aef2-4965-a104-cc72b8a7e83f service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:08.308244 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c4a6d-aef2-4965-a104-cc72b8a7e83f service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:08.308522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c4a6d-aef2-4965-a104-cc72b8a7e83f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:08.310250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-865c4a6d-aef2-4965-a104-cc72b8a7e83f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:08.366832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c4a6d-aef2-4965-a104-cc72b8a7e83f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:08.368411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c4a6d-aef2-4965-a104-cc72b8a7e83f service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:08.377325 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1242/2451] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:35:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:35:08.665435 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=40 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:11.264285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e3edb-19db-4bdb-a665-2f2216d71954 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:11.265746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-211e3edb-19db-4bdb-a665-2f2216d71954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:11.282678 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e3edb-19db-4bdb-a665-2f2216d71954 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:11.286869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60427-ead4-4aa4-8c86-1a6c6586ebcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:11.287636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60427-ead4-4aa4-8c86-1a6c6586ebcf service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:11.287998 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60427-ead4-4aa4-8c86-1a6c6586ebcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:11.288457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60427-ead4-4aa4-8c86-1a6c6586ebcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:11.290564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a8a60427-ead4-4aa4-8c86-1a6c6586ebcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:11.301305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a60427-ead4-4aa4-8c86-1a6c6586ebcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:11.302875 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a60427-ead4-4aa4-8c86-1a6c6586ebcf service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:11.311586 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1210/2452] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:35:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:35:18.373062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=28 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:21.307835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=6 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:23.021426 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c4a6d-aef2-4965-a104-cc72b8a7e83f service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:23.034452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c4a6d-aef2-4965-a104-cc72b8a7e83f service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:23.042982 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b78c75-13aa-42f1-93e4-7533a1b849f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:23.043923 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b78c75-13aa-42f1-93e4-7533a1b849f5 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:23.044095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b78c75-13aa-42f1-93e4-7533a1b849f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:23.044479 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b78c75-13aa-42f1-93e4-7533a1b849f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:23.046751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e7b78c75-13aa-42f1-93e4-7533a1b849f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:23.065663 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b78c75-13aa-42f1-93e4-7533a1b849f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:23.067281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b78c75-13aa-42f1-93e4-7533a1b849f5 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:23.080974 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1243/2453] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:35:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:35:28.077400 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60427-ead4-4aa4-8c86-1a6c6586ebcf service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:28.085550 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60427-ead4-4aa4-8c86-1a6c6586ebcf service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:28.089160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc4ec2-b3fd-48ef-bfd0-ecf39c1971d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:28.089796 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc4ec2-b3fd-48ef-bfd0-ecf39c1971d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:28.090074 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc4ec2-b3fd-48ef-bfd0-ecf39c1971d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:28.090348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc4ec2-b3fd-48ef-bfd0-ecf39c1971d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:28.092075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c9fc4ec2-b3fd-48ef-bfd0-ecf39c1971d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:28.103991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc4ec2-b3fd-48ef-bfd0-ecf39c1971d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:28.105430 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc4ec2-b3fd-48ef-bfd0-ecf39c1971d4 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:28.114813 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1211/2454] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:35:31.211896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b78c75-13aa-42f1-93e4-7533a1b849f5 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:31.214371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e7b78c75-13aa-42f1-93e4-7533a1b849f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:31.228897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b78c75-13aa-42f1-93e4-7533a1b849f5 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:31.233486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed5186-d932-440d-afef-c3e05de54cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:31.234425 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed5186-d932-440d-afef-c3e05de54cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:31.234712 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed5186-d932-440d-afef-c3e05de54cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:31.234991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed5186-d932-440d-afef-c3e05de54cc6 admin admin] PATH_INFO: `/v3/users/985006f41c1d484aac532ed38b03e3df` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:31.236167 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed5186-d932-440d-afef-c3e05de54cc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=985006f41c1d484aac532ed38b03e3df)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:31.238111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed5186-d932-440d-afef-c3e05de54cc6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:31.284853 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e7ed5186-d932-440d-afef-c3e05de54cc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '985006f41c1d484aac532ed38b03e3df'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:31.296457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e7ed5186-d932-440d-afef-c3e05de54cc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '985006f41c1d484aac532ed38b03e3df'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:31.303139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e7ed5186-d932-440d-afef-c3e05de54cc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '985006f41c1d484aac532ed38b03e3df'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:31.303801 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e7ed5186-d932-440d-afef-c3e05de54cc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '985006f41c1d484aac532ed38b03e3df'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:31.311383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e7ed5186-d932-440d-afef-c3e05de54cc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '985006f41c1d484aac532ed38b03e3df'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:31.317261 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1244/2455] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:35:31 2022] DELETE /identity/v3/users/985006f41c1d484aac532ed38b03e3df => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:35:31.489310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc4ec2-b3fd-48ef-bfd0-ecf39c1971d4 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:31.499997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc4ec2-b3fd-48ef-bfd0-ecf39c1971d4 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:31.557667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812d4dc-b031-4c48-886f-9fc86460f861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:31.558519 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812d4dc-b031-4c48-886f-9fc86460f861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:31.558796 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812d4dc-b031-4c48-886f-9fc86460f861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:31.559067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812d4dc-b031-4c48-886f-9fc86460f861 admin admin] PATH_INFO: `/v3/projects/53fd701459624b60b0d3e5fc72e76a17` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:31.560215 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812d4dc-b031-4c48-886f-9fc86460f861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53fd701459624b60b0d3e5fc72e76a17)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:31.562128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812d4dc-b031-4c48-886f-9fc86460f861 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:31.606620 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f812d4dc-b031-4c48-886f-9fc86460f861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53fd701459624b60b0d3e5fc72e76a17', 'request_id': 'req-f812d4dc-b031-4c48-886f-9fc86460f861'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:31.613760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f812d4dc-b031-4c48-886f-9fc86460f861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53fd701459624b60b0d3e5fc72e76a17', 'request_id': 'req-f812d4dc-b031-4c48-886f-9fc86460f861'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:31.619617 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f812d4dc-b031-4c48-886f-9fc86460f861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53fd701459624b60b0d3e5fc72e76a17', 'request_id': 'req-f812d4dc-b031-4c48-886f-9fc86460f861'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:31.630123 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f812d4dc-b031-4c48-886f-9fc86460f861 admin admin] The token cache is being invalidate because project 53fd701459624b60b0d3e5fc72e76a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:35:31.630405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f812d4dc-b031-4c48-886f-9fc86460f861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:31.631021 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f812d4dc-b031-4c48-886f-9fc86460f861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:31.632515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1212/2456] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:35:31 2022] DELETE /identity/v3/projects/53fd701459624b60b0d3e5fc72e76a17 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:35:31.637529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54d073-84dd-47a1-bb59-85739f9d0e20 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:31.637820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54d073-84dd-47a1-bb59-85739f9d0e20 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:31.638129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54d073-84dd-47a1-bb59-85739f9d0e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:31.656572 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fc54d073-84dd-47a1-bb59-85739f9d0e20 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:35:31.657796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fc54d073-84dd-47a1-bb59-85739f9d0e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:31.715734 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1245/2457] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:35:31.724160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2082f3-629c-49a0-ad0b-6ec553649dea None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:31.724451 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2082f3-629c-49a0-ad0b-6ec553649dea None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:31.724727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2082f3-629c-49a0-ad0b-6ec553649dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:31.743514 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-4a2082f3-629c-49a0-ad0b-6ec553649dea None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:35:31.744699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4a2082f3-629c-49a0-ad0b-6ec553649dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:31.752472 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1213/2458] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:35:31.757265 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54d073-84dd-47a1-bb59-85739f9d0e20 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:31.766769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54d073-84dd-47a1-bb59-85739f9d0e20 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:31.771267 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8571951-eeca-45d1-9f75-94c3cdffddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:31.771912 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8571951-eeca-45d1-9f75-94c3cdffddc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:31.772195 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8571951-eeca-45d1-9f75-94c3cdffddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:31.772469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8571951-eeca-45d1-9f75-94c3cdffddc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:31.773222 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8571951-eeca-45d1-9f75-94c3cdffddc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:35:31.773527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8571951-eeca-45d1-9f75-94c3cdffddc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:31.775109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8571951-eeca-45d1-9f75-94c3cdffddc0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:31.786806 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1246/2459] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:35:31.790893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2082f3-629c-49a0-ad0b-6ec553649dea None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:31.799965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2082f3-629c-49a0-ad0b-6ec553649dea None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:31.805003 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113d7c5-1e0f-4875-8098-e52b890c142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:31.805640 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113d7c5-1e0f-4875-8098-e52b890c142a admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:31.805920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113d7c5-1e0f-4875-8098-e52b890c142a admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:31.806201 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113d7c5-1e0f-4875-8098-e52b890c142a admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:31.807443 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113d7c5-1e0f-4875-8098-e52b890c142a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:31.809404 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113d7c5-1e0f-4875-8098-e52b890c142a admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:31.838469 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1214/2460] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:35:31 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:35:31.839620 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8571951-eeca-45d1-9f75-94c3cdffddc0 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:31.849532 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8571951-eeca-45d1-9f75-94c3cdffddc0 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:31.891954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:31.907203 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af609321-3222-4a29-80af-b3c6959ffa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:31.907862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609321-3222-4a29-80af-b3c6959ffa43 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:31.908144 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609321-3222-4a29-80af-b3c6959ffa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:31.908418 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609321-3222-4a29-80af-b3c6959ffa43 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:31.909129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af609321-3222-4a29-80af-b3c6959ffa43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:31.911022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af609321-3222-4a29-80af-b3c6959ffa43 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:31.931195 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1247/2461] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:35:31 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:35:31.935352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113d7c5-1e0f-4875-8098-e52b890c142a admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:31.946406 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113d7c5-1e0f-4875-8098-e52b890c142a admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:31.951008 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae916113-a100-4108-9669-c88ea1e23578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:31.951657 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae916113-a100-4108-9669-c88ea1e23578 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:31.951938 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae916113-a100-4108-9669-c88ea1e23578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:31.952214 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae916113-a100-4108-9669-c88ea1e23578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:31.952950 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae916113-a100-4108-9669-c88ea1e23578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:31.954535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae916113-a100-4108-9669-c88ea1e23578 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:31.965241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1215/2462] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:35:31.969136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af609321-3222-4a29-80af-b3c6959ffa43 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:31.979073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af609321-3222-4a29-80af-b3c6959ffa43 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:31.983742 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410612e-3248-493c-9eae-f822d46da718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:31.984401 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410612e-3248-493c-9eae-f822d46da718 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:31.984686 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410612e-3248-493c-9eae-f822d46da718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:31.984995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410612e-3248-493c-9eae-f822d46da718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:31.985915 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410612e-3248-493c-9eae-f822d46da718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:31.987568 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410612e-3248-493c-9eae-f822d46da718 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:31.997423 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1248/2463] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:35:32.001367 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae916113-a100-4108-9669-c88ea1e23578 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:32.011521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae916113-a100-4108-9669-c88ea1e23578 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:32.016137 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166314c-2ab3-454e-b07f-4395a4eacf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:32.017030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166314c-2ab3-454e-b07f-4395a4eacf4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:32.017319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166314c-2ab3-454e-b07f-4395a4eacf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:32.017599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166314c-2ab3-454e-b07f-4395a4eacf4e admin admin] PATH_INFO: `/v3/projects/96f928bff25b4dc481e1b7cb346b1a22/users/182b5b6eed86440f8f452aff726b8491/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:32.032564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166314c-2ab3-454e-b07f-4395a4eacf4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f928bff25b4dc481e1b7cb346b1a22, user_id=182b5b6eed86440f8f452aff726b8491, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:32.035231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166314c-2ab3-454e-b07f-4395a4eacf4e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:32.049188 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1216/2464] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:35:32 2022] PUT /identity/v3/projects/96f928bff25b4dc481e1b7cb346b1a22/users/182b5b6eed86440f8f452aff726b8491/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:35:32.061010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818a23d-6a37-429c-be4a-1d89ca114b9a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:32.061299 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818a23d-6a37-429c-be4a-1d89ca114b9a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:32.061578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818a23d-6a37-429c-be4a-1d89ca114b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:32.090125 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c818a23d-6a37-429c-be4a-1d89ca114b9a None None] MFA Rules not processed for user `182b5b6eed86440f8f452aff726b8491`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:35:32.091324 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c818a23d-6a37-429c-be4a-1d89ca114b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:32.154103 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1249/2465] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:35:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:35:32.158555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166314c-2ab3-454e-b07f-4395a4eacf4e admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:32.171767 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:32.220450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166314c-2ab3-454e-b07f-4395a4eacf4e admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:32.224903 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e9283-4442-4da6-87a2-7187a1ca738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:32.225580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e9283-4442-4da6-87a2-7187a1ca738e admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:32.225865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e9283-4442-4da6-87a2-7187a1ca738e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:32.226146 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e9283-4442-4da6-87a2-7187a1ca738e admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:32.226838 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e9283-4442-4da6-87a2-7187a1ca738e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:32.228739 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e9283-4442-4da6-87a2-7187a1ca738e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:32.254334 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1217/2466] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:35:32 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:35:32.258966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818a23d-6a37-429c-be4a-1d89ca114b9a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:32.269722 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818a23d-6a37-429c-be4a-1d89ca114b9a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:32.324269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3cd9f-6ce0-4da8-a11f-6b2945300706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:32.324948 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3cd9f-6ce0-4da8-a11f-6b2945300706 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:32.325236 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3cd9f-6ce0-4da8-a11f-6b2945300706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:32.325506 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3cd9f-6ce0-4da8-a11f-6b2945300706 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:32.326178 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3cd9f-6ce0-4da8-a11f-6b2945300706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:32.328074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3cd9f-6ce0-4da8-a11f-6b2945300706 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:32.347686 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1250/2467] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:35:32 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:35:32.351922 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e9283-4442-4da6-87a2-7187a1ca738e admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:32.363723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e9283-4442-4da6-87a2-7187a1ca738e admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:32.369002 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747f5bf-bf08-400c-a5d6-dcc46a2fcb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:32.369668 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747f5bf-bf08-400c-a5d6-dcc46a2fcb7c admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:32.369956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747f5bf-bf08-400c-a5d6-dcc46a2fcb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:32.370248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747f5bf-bf08-400c-a5d6-dcc46a2fcb7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:32.370968 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747f5bf-bf08-400c-a5d6-dcc46a2fcb7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:32.372785 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747f5bf-bf08-400c-a5d6-dcc46a2fcb7c admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:32.384277 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1218/2468] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:35:32.388492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3cd9f-6ce0-4da8-a11f-6b2945300706 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:32.398515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3cd9f-6ce0-4da8-a11f-6b2945300706 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:32.403212 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff67f82-323c-41bc-9088-b551b9b16925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:32.404338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff67f82-323c-41bc-9088-b551b9b16925 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:32.404617 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff67f82-323c-41bc-9088-b551b9b16925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:32.404890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff67f82-323c-41bc-9088-b551b9b16925 admin admin] PATH_INFO: `/v3/projects/b5fb412ed109482b85b3abe1c49a7003/users/d20d0dd671204410a971afefee740052/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:32.420082 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff67f82-323c-41bc-9088-b551b9b16925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5fb412ed109482b85b3abe1c49a7003, user_id=d20d0dd671204410a971afefee740052, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:32.422741 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff67f82-323c-41bc-9088-b551b9b16925 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:32.436527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1251/2469] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:35:32 2022] PUT /identity/v3/projects/b5fb412ed109482b85b3abe1c49a7003/users/d20d0dd671204410a971afefee740052/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:35:32.440466 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747f5bf-bf08-400c-a5d6-dcc46a2fcb7c admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:32.451117 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747f5bf-bf08-400c-a5d6-dcc46a2fcb7c admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:32.506149 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38504b-b112-46c0-bcec-cb360884a3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:32.506811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38504b-b112-46c0-bcec-cb360884a3fa admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:32.507092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38504b-b112-46c0-bcec-cb360884a3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:32.507368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38504b-b112-46c0-bcec-cb360884a3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:32.508080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38504b-b112-46c0-bcec-cb360884a3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:32.509700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38504b-b112-46c0-bcec-cb360884a3fa admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:32.519174 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1219/2470] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:35:32.523175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff67f82-323c-41bc-9088-b551b9b16925 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:32.533323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff67f82-323c-41bc-9088-b551b9b16925 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:32.537865 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba8288-2e09-41f3-93fd-7a46dd9fbc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:32.538731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba8288-2e09-41f3-93fd-7a46dd9fbc54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:32.539011 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba8288-2e09-41f3-93fd-7a46dd9fbc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:32.539286 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba8288-2e09-41f3-93fd-7a46dd9fbc54 admin admin] PATH_INFO: `/v3/projects/b5fb412ed109482b85b3abe1c49a7003/users/d20d0dd671204410a971afefee740052/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:32.541241 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba8288-2e09-41f3-93fd-7a46dd9fbc54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5fb412ed109482b85b3abe1c49a7003, user_id=d20d0dd671204410a971afefee740052, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:32.543859 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba8288-2e09-41f3-93fd-7a46dd9fbc54 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:32.554224 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1252/2471] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:35:32 2022] PUT /identity/v3/projects/b5fb412ed109482b85b3abe1c49a7003/users/d20d0dd671204410a971afefee740052/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:35:32.564012 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ec17a-ebc1-4c1d-83d1-ba20402a458f None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:32.564310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ec17a-ebc1-4c1d-83d1-ba20402a458f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:32.564594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ec17a-ebc1-4c1d-83d1-ba20402a458f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:32.590331 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-754ec17a-ebc1-4c1d-83d1-ba20402a458f None None] MFA Rules not processed for user `d20d0dd671204410a971afefee740052`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:35:32.591531 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-754ec17a-ebc1-4c1d-83d1-ba20402a458f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:32.657169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1220/2472] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:35:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:35:32.668400 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba8288-2e09-41f3-93fd-7a46dd9fbc54 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:32.670156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-69ba8288-2e09-41f3-93fd-7a46dd9fbc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:32.680222 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:32.727650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba8288-2e09-41f3-93fd-7a46dd9fbc54 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:32.731157 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc4686-fcd3-4c73-a79c-85daa7f0663e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:32.731783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc4686-fcd3-4c73-a79c-85daa7f0663e service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:32.732062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc4686-fcd3-4c73-a79c-85daa7f0663e service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:32.732344 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc4686-fcd3-4c73-a79c-85daa7f0663e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:32.741574 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc4686-fcd3-4c73-a79c-85daa7f0663e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:32.742986 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc4686-fcd3-4c73-a79c-85daa7f0663e service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:32.752207 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1253/2473] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:35:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:35:32.821835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ec17a-ebc1-4c1d-83d1-ba20402a458f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:32.831763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ec17a-ebc1-4c1d-83d1-ba20402a458f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:32.835372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d1ad5-158e-460b-bfd1-6057fa4cf0e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:32.836016 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d1ad5-158e-460b-bfd1-6057fa4cf0e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:32.836310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d1ad5-158e-460b-bfd1-6057fa4cf0e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:32.836584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d1ad5-158e-460b-bfd1-6057fa4cf0e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:32.841737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:32.894271 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d1ad5-158e-460b-bfd1-6057fa4cf0e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:32.896012 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d1ad5-158e-460b-bfd1-6057fa4cf0e6 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:32.905348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1221/2474] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:35:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:35:42.106372 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc4686-fcd3-4c73-a79c-85daa7f0663e service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:42.107793 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-95dc4686-fcd3-4c73-a79c-85daa7f0663e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:42.178810 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc4686-fcd3-4c73-a79c-85daa7f0663e service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:42.184172 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46061d5-819d-48b8-924b-7add250ab382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:42.184811 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46061d5-819d-48b8-924b-7add250ab382 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:42.185137 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46061d5-819d-48b8-924b-7add250ab382 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:42.185415 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46061d5-819d-48b8-924b-7add250ab382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:42.187181 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e46061d5-819d-48b8-924b-7add250ab382 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:42.250684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46061d5-819d-48b8-924b-7add250ab382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:42.252297 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46061d5-819d-48b8-924b-7add250ab382 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:42.262580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1254/2475] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:35:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:35:42.901190 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=24 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:52.257854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=79 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:55.491986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d1ad5-158e-460b-bfd1-6057fa4cf0e6 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:55.493421 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ce0d1ad5-158e-460b-bfd1-6057fa4cf0e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:55.561523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d1ad5-158e-460b-bfd1-6057fa4cf0e6 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:55.565090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041af987-92e8-4255-9b74-ddf1a5d145a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:55.565736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041af987-92e8-4255-9b74-ddf1a5d145a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:55.566015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041af987-92e8-4255-9b74-ddf1a5d145a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:55.566288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041af987-92e8-4255-9b74-ddf1a5d145a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:55.568038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-041af987-92e8-4255-9b74-ddf1a5d145a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:55.630109 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041af987-92e8-4255-9b74-ddf1a5d145a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:55.631553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041af987-92e8-4255-9b74-ddf1a5d145a5 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:55.641188 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1222/2476] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:35:58.862832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46061d5-819d-48b8-924b-7add250ab382 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:58.865073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e46061d5-819d-48b8-924b-7add250ab382 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:58.881695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46061d5-819d-48b8-924b-7add250ab382 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:58.886331 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64804069-621f-4695-9cfb-0d84f7ec0c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:58.887238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64804069-621f-4695-9cfb-0d84f7ec0c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:58.887526 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64804069-621f-4695-9cfb-0d84f7ec0c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:58.887812 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64804069-621f-4695-9cfb-0d84f7ec0c92 admin admin] PATH_INFO: `/v3/users/0ab0db1bbc72471a90bbfc2e47561a26` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:58.889055 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64804069-621f-4695-9cfb-0d84f7ec0c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab0db1bbc72471a90bbfc2e47561a26)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:58.890981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64804069-621f-4695-9cfb-0d84f7ec0c92 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:58.958175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-64804069-621f-4695-9cfb-0d84f7ec0c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab0db1bbc72471a90bbfc2e47561a26'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:58.971036 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-64804069-621f-4695-9cfb-0d84f7ec0c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab0db1bbc72471a90bbfc2e47561a26'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:58.978585 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-64804069-621f-4695-9cfb-0d84f7ec0c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab0db1bbc72471a90bbfc2e47561a26'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:58.979306 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-64804069-621f-4695-9cfb-0d84f7ec0c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab0db1bbc72471a90bbfc2e47561a26'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:58.986279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-64804069-621f-4695-9cfb-0d84f7ec0c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab0db1bbc72471a90bbfc2e47561a26'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:58.993053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1255/2477] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:35:58 2022] DELETE /identity/v3/users/0ab0db1bbc72471a90bbfc2e47561a26 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:35:59.185545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041af987-92e8-4255-9b74-ddf1a5d145a5 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:59.200282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041af987-92e8-4255-9b74-ddf1a5d145a5 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:59.265981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2602a-8eec-48f5-b9e3-264dd25b6d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:59.267127 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2602a-8eec-48f5-b9e3-264dd25b6d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:59.267591 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2602a-8eec-48f5-b9e3-264dd25b6d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:59.267941 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2602a-8eec-48f5-b9e3-264dd25b6d18 admin admin] PATH_INFO: `/v3/projects/998e34a4434240f28c48cde8f99f974a` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:59.269393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2602a-8eec-48f5-b9e3-264dd25b6d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=998e34a4434240f28c48cde8f99f974a)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:59.272148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2602a-8eec-48f5-b9e3-264dd25b6d18 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:59.319909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cfe2602a-8eec-48f5-b9e3-264dd25b6d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998e34a4434240f28c48cde8f99f974a', 'request_id': 'req-cfe2602a-8eec-48f5-b9e3-264dd25b6d18'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:59.322378 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:59.327433 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cfe2602a-8eec-48f5-b9e3-264dd25b6d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998e34a4434240f28c48cde8f99f974a', 'request_id': 'req-cfe2602a-8eec-48f5-b9e3-264dd25b6d18'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:59.334308 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cfe2602a-8eec-48f5-b9e3-264dd25b6d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998e34a4434240f28c48cde8f99f974a', 'request_id': 'req-cfe2602a-8eec-48f5-b9e3-264dd25b6d18'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:59.345033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cfe2602a-8eec-48f5-b9e3-264dd25b6d18 admin admin] The token cache is being invalidate because project 998e34a4434240f28c48cde8f99f974a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:35:59.345321 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cfe2602a-8eec-48f5-b9e3-264dd25b6d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:59.345957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-cfe2602a-8eec-48f5-b9e3-264dd25b6d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:35:59.347502 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1223/2478] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:35:59 2022] DELETE /identity/v3/projects/998e34a4434240f28c48cde8f99f974a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:35:59.352522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95768673-bbb3-4bef-9822-70deccdeadd3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:59.352809 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95768673-bbb3-4bef-9822-70deccdeadd3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:59.353132 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95768673-bbb3-4bef-9822-70deccdeadd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:59.372139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-95768673-bbb3-4bef-9822-70deccdeadd3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:35:59.373361 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-95768673-bbb3-4bef-9822-70deccdeadd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:59.433973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1256/2479] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:35:59.442039 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33367ff9-1f7e-4650-8abd-6f2b559b5d3a None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:59.442339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33367ff9-1f7e-4650-8abd-6f2b559b5d3a None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:59.442621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33367ff9-1f7e-4650-8abd-6f2b559b5d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:59.460372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-33367ff9-1f7e-4650-8abd-6f2b559b5d3a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:35:59.461612 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-33367ff9-1f7e-4650-8abd-6f2b559b5d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:59.470178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1224/2480] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:35:59.475478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95768673-bbb3-4bef-9822-70deccdeadd3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:59.484907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95768673-bbb3-4bef-9822-70deccdeadd3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:59.490017 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b32591-aa57-4b45-8a5c-e273a328b2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:59.490662 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b32591-aa57-4b45-8a5c-e273a328b2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:59.490942 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b32591-aa57-4b45-8a5c-e273a328b2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:59.491216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b32591-aa57-4b45-8a5c-e273a328b2e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:59.491938 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b32591-aa57-4b45-8a5c-e273a328b2e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:35:59.492242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b32591-aa57-4b45-8a5c-e273a328b2e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:59.493845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b32591-aa57-4b45-8a5c-e273a328b2e4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:59.505711 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1257/2481] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:35:59.509768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33367ff9-1f7e-4650-8abd-6f2b559b5d3a None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:59.518937 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33367ff9-1f7e-4650-8abd-6f2b559b5d3a None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:59.523516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62190908-7359-40f9-9015-3c0531b26c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:59.524162 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62190908-7359-40f9-9015-3c0531b26c2b admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:59.524446 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62190908-7359-40f9-9015-3c0531b26c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:59.524725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62190908-7359-40f9-9015-3c0531b26c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:59.525450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62190908-7359-40f9-9015-3c0531b26c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:59.527346 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62190908-7359-40f9-9015-3c0531b26c2b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:59.553756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1225/2482] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:35:59 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:35:59.559352 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b32591-aa57-4b45-8a5c-e273a328b2e4 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:59.569839 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b32591-aa57-4b45-8a5c-e273a328b2e4 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:59.624057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c28f87-36b4-49c1-b732-0a8940964561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:59.624721 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c28f87-36b4-49c1-b732-0a8940964561 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:59.625044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c28f87-36b4-49c1-b732-0a8940964561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:59.625326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c28f87-36b4-49c1-b732-0a8940964561 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:59.626004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c28f87-36b4-49c1-b732-0a8940964561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:59.627906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c28f87-36b4-49c1-b732-0a8940964561 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:59.635023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:59.648331 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1258/2483] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:35:59 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:35:59.652421 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62190908-7359-40f9-9015-3c0531b26c2b admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:59.662889 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62190908-7359-40f9-9015-3c0531b26c2b admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:59.668171 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0041f-b0ef-48f8-a388-0cdd87b3a1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:59.668858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0041f-b0ef-48f8-a388-0cdd87b3a1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:59.669179 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0041f-b0ef-48f8-a388-0cdd87b3a1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:59.669460 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0041f-b0ef-48f8-a388-0cdd87b3a1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:59.670194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0041f-b0ef-48f8-a388-0cdd87b3a1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:59.671783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0041f-b0ef-48f8-a388-0cdd87b3a1b4 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:59.682552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1226/2484] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:35:59.686421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c28f87-36b4-49c1-b732-0a8940964561 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:59.696770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c28f87-36b4-49c1-b732-0a8940964561 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:59.701295 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5bf3b-d7fe-44bf-8157-777bd82d03aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:59.701965 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5bf3b-d7fe-44bf-8157-777bd82d03aa admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:59.702250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5bf3b-d7fe-44bf-8157-777bd82d03aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:59.702524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5bf3b-d7fe-44bf-8157-777bd82d03aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:59.703238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5bf3b-d7fe-44bf-8157-777bd82d03aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:59.704807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5bf3b-d7fe-44bf-8157-777bd82d03aa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:59.714446 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1259/2485] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:35:59.718399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0041f-b0ef-48f8-a388-0cdd87b3a1b4 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:59.729218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0041f-b0ef-48f8-a388-0cdd87b3a1b4 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:59.733828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13561a7f-2a4c-4e91-935a-885073b9754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:59.734706 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13561a7f-2a4c-4e91-935a-885073b9754b admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:59.735124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13561a7f-2a4c-4e91-935a-885073b9754b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:59.735396 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13561a7f-2a4c-4e91-935a-885073b9754b admin admin] PATH_INFO: `/v3/projects/2d0273df80094b0d9f538df63e1ef07a/users/b008e438c391472da777ac888b62162d/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:59.750502 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13561a7f-2a4c-4e91-935a-885073b9754b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0273df80094b0d9f538df63e1ef07a, user_id=b008e438c391472da777ac888b62162d, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:59.753169 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13561a7f-2a4c-4e91-935a-885073b9754b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:59.765705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1227/2486] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:35:59 2022] PUT /identity/v3/projects/2d0273df80094b0d9f538df63e1ef07a/users/b008e438c391472da777ac888b62162d/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:35:59.777085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ea97-0ada-4909-afd4-1c0460d27acd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:59.777375 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ea97-0ada-4909-afd4-1c0460d27acd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:59.777664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ea97-0ada-4909-afd4-1c0460d27acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:59.805515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c660ea97-0ada-4909-afd4-1c0460d27acd None None] MFA Rules not processed for user `b008e438c391472da777ac888b62162d`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:35:59.806716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c660ea97-0ada-4909-afd4-1c0460d27acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:59.869692 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1260/2487] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:35:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:35:59.880573 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13561a7f-2a4c-4e91-935a-885073b9754b admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:35:59.882399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-13561a7f-2a4c-4e91-935a-885073b9754b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:35:59.958640 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13561a7f-2a4c-4e91-935a-885073b9754b admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:35:59.965590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd86b8-3a79-4015-8cbb-edd58b8ba7aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:35:59.966291 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd86b8-3a79-4015-8cbb-edd58b8ba7aa service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:35:59.966580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd86b8-3a79-4015-8cbb-edd58b8ba7aa service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:35:59.966856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd86b8-3a79-4015-8cbb-edd58b8ba7aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:35:59.975356 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd86b8-3a79-4015-8cbb-edd58b8ba7aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:35:59.976959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd86b8-3a79-4015-8cbb-edd58b8ba7aa service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:35:59.986289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1228/2488] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:35:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:01.970642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660ea97-0ada-4909-afd4-1c0460d27acd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:01.972023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c660ea97-0ada-4909-afd4-1c0460d27acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:02.035492 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660ea97-0ada-4909-afd4-1c0460d27acd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:02.040013 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a21252-75a6-428d-98b2-7ba6902d8dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:02.040908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a21252-75a6-428d-98b2-7ba6902d8dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:02.041215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a21252-75a6-428d-98b2-7ba6902d8dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:02.041486 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a21252-75a6-428d-98b2-7ba6902d8dfb admin admin] PATH_INFO: `/v3/users/182b5b6eed86440f8f452aff726b8491` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:02.042648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a21252-75a6-428d-98b2-7ba6902d8dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=182b5b6eed86440f8f452aff726b8491)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:02.044577 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a21252-75a6-428d-98b2-7ba6902d8dfb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:02.091078 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e4a21252-75a6-428d-98b2-7ba6902d8dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '182b5b6eed86440f8f452aff726b8491'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:02.102765 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e4a21252-75a6-428d-98b2-7ba6902d8dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '182b5b6eed86440f8f452aff726b8491'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:02.107129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:02.111052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e4a21252-75a6-428d-98b2-7ba6902d8dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '182b5b6eed86440f8f452aff726b8491'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:02.111986 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e4a21252-75a6-428d-98b2-7ba6902d8dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '182b5b6eed86440f8f452aff726b8491'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:02.119786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e4a21252-75a6-428d-98b2-7ba6902d8dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '182b5b6eed86440f8f452aff726b8491'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:02.125719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1261/2489] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:01 2022] DELETE /identity/v3/users/182b5b6eed86440f8f452aff726b8491 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:02.130779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e8853-fcb4-4e02-80c4-7e333f5c0e0d None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:02.131235 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e8853-fcb4-4e02-80c4-7e333f5c0e0d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:02.131330 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e8853-fcb4-4e02-80c4-7e333f5c0e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:02.148805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-e15e8853-fcb4-4e02-80c4-7e333f5c0e0d None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:02.149985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e15e8853-fcb4-4e02-80c4-7e333f5c0e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:02.207825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1229/2490] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:02.217437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a21252-75a6-428d-98b2-7ba6902d8dfb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:02.218831 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e4a21252-75a6-428d-98b2-7ba6902d8dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:02.274725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a21252-75a6-428d-98b2-7ba6902d8dfb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:02.278547 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a0d99-108d-4539-b7b8-8a48c8e88971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:02.279188 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a0d99-108d-4539-b7b8-8a48c8e88971 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:02.279472 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a0d99-108d-4539-b7b8-8a48c8e88971 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:02.279743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a0d99-108d-4539-b7b8-8a48c8e88971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:02.288490 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a0d99-108d-4539-b7b8-8a48c8e88971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:02.289934 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a0d99-108d-4539-b7b8-8a48c8e88971 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:02.299158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1262/2491] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:02.591981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e8853-fcb4-4e02-80c4-7e333f5c0e0d None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:02.593796 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e15e8853-fcb4-4e02-80c4-7e333f5c0e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:02.602719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:02.630200 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e8853-fcb4-4e02-80c4-7e333f5c0e0d None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:02.642127 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a65ba-4784-4b32-aac1-ffedcac9b5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:02.643198 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a65ba-4784-4b32-aac1-ffedcac9b5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:02.643637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a65ba-4784-4b32-aac1-ffedcac9b5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:02.643924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a65ba-4784-4b32-aac1-ffedcac9b5fe admin admin] PATH_INFO: `/v3/projects/96f928bff25b4dc481e1b7cb346b1a22` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:02.645201 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a65ba-4784-4b32-aac1-ffedcac9b5fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f928bff25b4dc481e1b7cb346b1a22)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:02.647128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a65ba-4784-4b32-aac1-ffedcac9b5fe admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:02.704986 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a0d99-108d-4539-b7b8-8a48c8e88971 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:02.706253 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-de6a0d99-108d-4539-b7b8-8a48c8e88971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:02.710453 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-862a65ba-4784-4b32-aac1-ffedcac9b5fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f928bff25b4dc481e1b7cb346b1a22', 'request_id': 'req-862a65ba-4784-4b32-aac1-ffedcac9b5fe'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:02.720512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a0d99-108d-4539-b7b8-8a48c8e88971 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:02.720669 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-862a65ba-4784-4b32-aac1-ffedcac9b5fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f928bff25b4dc481e1b7cb346b1a22', 'request_id': 'req-862a65ba-4784-4b32-aac1-ffedcac9b5fe'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:02.729042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-862a65ba-4784-4b32-aac1-ffedcac9b5fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f928bff25b4dc481e1b7cb346b1a22', 'request_id': 'req-862a65ba-4784-4b32-aac1-ffedcac9b5fe'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:02.741878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-862a65ba-4784-4b32-aac1-ffedcac9b5fe admin admin] The token cache is being invalidate because project 96f928bff25b4dc481e1b7cb346b1a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:02.742161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-862a65ba-4784-4b32-aac1-ffedcac9b5fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:02.742802 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-862a65ba-4784-4b32-aac1-ffedcac9b5fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:02.744574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1230/2492] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:02 2022] DELETE /identity/v3/projects/96f928bff25b4dc481e1b7cb346b1a22 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:02.748156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a65ba-4784-4b32-aac1-ffedcac9b5fe admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:02.749575 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-862a65ba-4784-4b32-aac1-ffedcac9b5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:02.779826 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac53478-33c9-4e96-a5c4-e226c70e9d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:02.780700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac53478-33c9-4e96-a5c4-e226c70e9d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:02.781017 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac53478-33c9-4e96-a5c4-e226c70e9d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:02.781300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac53478-33c9-4e96-a5c4-e226c70e9d32 admin admin] PATH_INFO: `/v3/users/b008e438c391472da777ac888b62162d` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:02.782520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac53478-33c9-4e96-a5c4-e226c70e9d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b008e438c391472da777ac888b62162d)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:02.784431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac53478-33c9-4e96-a5c4-e226c70e9d32 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:02.817513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a65ba-4784-4b32-aac1-ffedcac9b5fe admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:02.822254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3c777-60b6-4271-952f-e2b00dc719dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:02.823183 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3c777-60b6-4271-952f-e2b00dc719dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:02.823472 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3c777-60b6-4271-952f-e2b00dc719dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:02.823748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3c777-60b6-4271-952f-e2b00dc719dd admin admin] PATH_INFO: `/v3/users/d20d0dd671204410a971afefee740052` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:02.825108 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3c777-60b6-4271-952f-e2b00dc719dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d20d0dd671204410a971afefee740052)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:02.827304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3c777-60b6-4271-952f-e2b00dc719dd admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:02.832167 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fac53478-33c9-4e96-a5c4-e226c70e9d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b008e438c391472da777ac888b62162d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:02.844370 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fac53478-33c9-4e96-a5c4-e226c70e9d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b008e438c391472da777ac888b62162d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:02.852555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fac53478-33c9-4e96-a5c4-e226c70e9d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b008e438c391472da777ac888b62162d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:02.853337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fac53478-33c9-4e96-a5c4-e226c70e9d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b008e438c391472da777ac888b62162d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:02.862191 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fac53478-33c9-4e96-a5c4-e226c70e9d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b008e438c391472da777ac888b62162d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:02.869822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1263/2493] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:02 2022] DELETE /identity/v3/users/b008e438c391472da777ac888b62162d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:02.874448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b6d88-6e11-42dd-8eb5-4a34d28165d9 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:02.874735 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b6d88-6e11-42dd-8eb5-4a34d28165d9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:02.875011 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b6d88-6e11-42dd-8eb5-4a34d28165d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:02.894188 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-902b6d88-6e11-42dd-8eb5-4a34d28165d9 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:02.895537 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-902b6d88-6e11-42dd-8eb5-4a34d28165d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:02.899943 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:02.969058 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1264/2494] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:36:02.976090 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b6d88-6e11-42dd-8eb5-4a34d28165d9 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:02.977610 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-902b6d88-6e11-42dd-8eb5-4a34d28165d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:03.008635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c1c3c777-60b6-4271-952f-e2b00dc719dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd20d0dd671204410a971afefee740052'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:03.019003 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c1c3c777-60b6-4271-952f-e2b00dc719dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd20d0dd671204410a971afefee740052'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:03.020125 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c1c3c777-60b6-4271-952f-e2b00dc719dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd20d0dd671204410a971afefee740052'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:03.032526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c1c3c777-60b6-4271-952f-e2b00dc719dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd20d0dd671204410a971afefee740052'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:03.037158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b6d88-6e11-42dd-8eb5-4a34d28165d9 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:03.041791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c1c3c777-60b6-4271-952f-e2b00dc719dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd20d0dd671204410a971afefee740052'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:03.042475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d4c70-5759-4667-bc7d-228ace364708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:03.043510 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d4c70-5759-4667-bc7d-228ace364708 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.043961 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d4c70-5759-4667-bc7d-228ace364708 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.044438 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d4c70-5759-4667-bc7d-228ace364708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.046472 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-771d4c70-5759-4667-bc7d-228ace364708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:03.049742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1231/2495] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:02 2022] DELETE /identity/v3/users/d20d0dd671204410a971afefee740052 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:03.067312 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d4c70-5759-4667-bc7d-228ace364708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:03.068782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d4c70-5759-4667-bc7d-228ace364708 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:03.084277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1265/2496] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:36:03.417461 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3c777-60b6-4271-952f-e2b00dc719dd admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:03.418975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c1c3c777-60b6-4271-952f-e2b00dc719dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:03.427164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:03.471137 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d4c70-5759-4667-bc7d-228ace364708 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:03.472678 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-771d4c70-5759-4667-bc7d-228ace364708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:03.490097 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d4c70-5759-4667-bc7d-228ace364708 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:03.494946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8463e-a79c-4a3a-b740-496ed6ab2756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:03.495815 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8463e-a79c-4a3a-b740-496ed6ab2756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.496105 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8463e-a79c-4a3a-b740-496ed6ab2756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.496558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8463e-a79c-4a3a-b740-496ed6ab2756 admin admin] PATH_INFO: `/v3/projects/2d0273df80094b0d9f538df63e1ef07a` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.497964 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8463e-a79c-4a3a-b740-496ed6ab2756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0273df80094b0d9f538df63e1ef07a)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:03.499854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8463e-a79c-4a3a-b740-496ed6ab2756 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:03.507979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3c777-60b6-4271-952f-e2b00dc719dd admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:03.512664 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26622c6-48a9-41e5-a32d-b998a90d33a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:03.513558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26622c6-48a9-41e5-a32d-b998a90d33a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.513841 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26622c6-48a9-41e5-a32d-b998a90d33a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.514113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26622c6-48a9-41e5-a32d-b998a90d33a4 admin admin] PATH_INFO: `/v3/projects/b5fb412ed109482b85b3abe1c49a7003` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.515336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26622c6-48a9-41e5-a32d-b998a90d33a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5fb412ed109482b85b3abe1c49a7003)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:03.518001 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26622c6-48a9-41e5-a32d-b998a90d33a4 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:03.550490 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7e8463e-a79c-4a3a-b740-496ed6ab2756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0273df80094b0d9f538df63e1ef07a', 'request_id': 'req-f7e8463e-a79c-4a3a-b740-496ed6ab2756'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:03.557105 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7e8463e-a79c-4a3a-b740-496ed6ab2756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0273df80094b0d9f538df63e1ef07a', 'request_id': 'req-f7e8463e-a79c-4a3a-b740-496ed6ab2756'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:03.563205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7e8463e-a79c-4a3a-b740-496ed6ab2756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0273df80094b0d9f538df63e1ef07a', 'request_id': 'req-f7e8463e-a79c-4a3a-b740-496ed6ab2756'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:03.564832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b26622c6-48a9-41e5-a32d-b998a90d33a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5fb412ed109482b85b3abe1c49a7003', 'request_id': 'req-b26622c6-48a9-41e5-a32d-b998a90d33a4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:03.573252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b26622c6-48a9-41e5-a32d-b998a90d33a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5fb412ed109482b85b3abe1c49a7003', 'request_id': 'req-b26622c6-48a9-41e5-a32d-b998a90d33a4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:03.576408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7e8463e-a79c-4a3a-b740-496ed6ab2756 admin admin] The token cache is being invalidate because project 2d0273df80094b0d9f538df63e1ef07a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:03.576694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7e8463e-a79c-4a3a-b740-496ed6ab2756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:03.577320 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7e8463e-a79c-4a3a-b740-496ed6ab2756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:03.578881 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1266/2497] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:03 2022] DELETE /identity/v3/projects/2d0273df80094b0d9f538df63e1ef07a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:03.579003 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b26622c6-48a9-41e5-a32d-b998a90d33a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5fb412ed109482b85b3abe1c49a7003', 'request_id': 'req-b26622c6-48a9-41e5-a32d-b998a90d33a4'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:03.584008 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4682e0-b3f2-4876-8ceb-3da221d79d8a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.584300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4682e0-b3f2-4876-8ceb-3da221d79d8a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.584615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4682e0-b3f2-4876-8ceb-3da221d79d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.590547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b26622c6-48a9-41e5-a32d-b998a90d33a4 admin admin] The token cache is being invalidate because project b5fb412ed109482b85b3abe1c49a7003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:03.590836 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b26622c6-48a9-41e5-a32d-b998a90d33a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:03.591482 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b26622c6-48a9-41e5-a32d-b998a90d33a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:03.593022 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1232/2498] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:03 2022] DELETE /identity/v3/projects/b5fb412ed109482b85b3abe1c49a7003 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:03.597700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c6bbf-9502-4515-a0a5-327770a7489e None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.597991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c6bbf-9502-4515-a0a5-327770a7489e None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.598268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c6bbf-9502-4515-a0a5-327770a7489e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.602094 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7c4682e0-b3f2-4876-8ceb-3da221d79d8a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:03.603291 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7c4682e0-b3f2-4876-8ceb-3da221d79d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:03.615517 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-8b9c6bbf-9502-4515-a0a5-327770a7489e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:03.616787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8b9c6bbf-9502-4515-a0a5-327770a7489e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:03.634859 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:03.667016 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1267/2499] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:03.674482 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24d89b-1568-4df7-86f1-ad6eef870d7e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.674769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24d89b-1568-4df7-86f1-ad6eef870d7e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.675045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24d89b-1568-4df7-86f1-ad6eef870d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.676704 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1233/2500] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:36:03.684245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fdfbd-e7a2-46b0-bca2-95f22998240e None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.684528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fdfbd-e7a2-46b0-bca2-95f22998240e None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.684798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fdfbd-e7a2-46b0-bca2-95f22998240e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.693435 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9f24d89b-1568-4df7-86f1-ad6eef870d7e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:03.694695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9f24d89b-1568-4df7-86f1-ad6eef870d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:03.702513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-f78fdfbd-e7a2-46b0-bca2-95f22998240e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:03.702664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1268/2501] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:36:03.703672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f78fdfbd-e7a2-46b0-bca2-95f22998240e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:03.706752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24d89b-1568-4df7-86f1-ad6eef870d7e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:03.712425 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1234/2502] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:36:03.716386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78fdfbd-e7a2-46b0-bca2-95f22998240e None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:03.716516 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24d89b-1568-4df7-86f1-ad6eef870d7e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:03.721098 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f628b2-a4b0-4fdb-8bcf-959bf0c12817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:03.721740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f628b2-a4b0-4fdb-8bcf-959bf0c12817 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.722023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f628b2-a4b0-4fdb-8bcf-959bf0c12817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.722299 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f628b2-a4b0-4fdb-8bcf-959bf0c12817 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.723049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f628b2-a4b0-4fdb-8bcf-959bf0c12817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:36:03.723355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f628b2-a4b0-4fdb-8bcf-959bf0c12817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:03.724953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f628b2-a4b0-4fdb-8bcf-959bf0c12817 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:03.725224 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78fdfbd-e7a2-46b0-bca2-95f22998240e None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:03.729799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bbb95-3f53-4759-81b1-7dcd258ae1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:03.730430 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bbb95-3f53-4759-81b1-7dcd258ae1cc admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.730715 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bbb95-3f53-4759-81b1-7dcd258ae1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.730995 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bbb95-3f53-4759-81b1-7dcd258ae1cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.731723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bbb95-3f53-4759-81b1-7dcd258ae1cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:36:03.732030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bbb95-3f53-4759-81b1-7dcd258ae1cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:03.733649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bbb95-3f53-4759-81b1-7dcd258ae1cc admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:03.736838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1269/2503] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:36:03.741173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f628b2-a4b0-4fdb-8bcf-959bf0c12817 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:03.745934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1235/2504] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:36:03.750934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bbb95-3f53-4759-81b1-7dcd258ae1cc admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:03.755314 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f628b2-a4b0-4fdb-8bcf-959bf0c12817 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:03.760262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6675a-7cea-4e5c-af9e-eaae9cf6d969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:03.760954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6675a-7cea-4e5c-af9e-eaae9cf6d969 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.761231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6675a-7cea-4e5c-af9e-eaae9cf6d969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.761517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6675a-7cea-4e5c-af9e-eaae9cf6d969 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.762210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6675a-7cea-4e5c-af9e-eaae9cf6d969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:03.763397 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bbb95-3f53-4759-81b1-7dcd258ae1cc admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:03.764130 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6675a-7cea-4e5c-af9e-eaae9cf6d969 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:03.769399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5e69e-f2cc-4d9c-a3bb-2a2642d1cb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:03.770974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e69e-f2cc-4d9c-a3bb-2a2642d1cb24 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.771436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e69e-f2cc-4d9c-a3bb-2a2642d1cb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.771902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e69e-f2cc-4d9c-a3bb-2a2642d1cb24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.772786 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5e69e-f2cc-4d9c-a3bb-2a2642d1cb24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:03.775780 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5e69e-f2cc-4d9c-a3bb-2a2642d1cb24 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:03.792548 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:03.792771 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1270/2505] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:36:03 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:03.797614 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6675a-7cea-4e5c-af9e-eaae9cf6d969 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:03.812813 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1236/2506] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:36:03 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:03.817349 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5e69e-f2cc-4d9c-a3bb-2a2642d1cb24 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:03.869972 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6675a-7cea-4e5c-af9e-eaae9cf6d969 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:03.883794 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5e69e-f2cc-4d9c-a3bb-2a2642d1cb24 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:03.893894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e4ff8-fff2-41d3-9e5b-b2b82aaa6d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:03.895206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e4ff8-fff2-41d3-9e5b-b2b82aaa6d2b admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.895559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e4ff8-fff2-41d3-9e5b-b2b82aaa6d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.895906 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e4ff8-fff2-41d3-9e5b-b2b82aaa6d2b admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.897105 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e4ff8-fff2-41d3-9e5b-b2b82aaa6d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:03.899487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e4ff8-fff2-41d3-9e5b-b2b82aaa6d2b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:03.933581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1237/2507] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:36:03 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:03.933789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23f27b-4ac0-46af-9226-61088e3fe555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:03.933789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23f27b-4ac0-46af-9226-61088e3fe555 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.933789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23f27b-4ac0-46af-9226-61088e3fe555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.934071 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23f27b-4ac0-46af-9226-61088e3fe555 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.934581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e4ff8-fff2-41d3-9e5b-b2b82aaa6d2b admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:03.934709 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23f27b-4ac0-46af-9226-61088e3fe555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:03.936570 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23f27b-4ac0-46af-9226-61088e3fe555 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:03.945892 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e4ff8-fff2-41d3-9e5b-b2b82aaa6d2b admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:03.951764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd70e1-270b-40a5-abf5-73717ccb6641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:03.952531 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd70e1-270b-40a5-abf5-73717ccb6641 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.952874 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd70e1-270b-40a5-abf5-73717ccb6641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.953188 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd70e1-270b-40a5-abf5-73717ccb6641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.953916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd70e1-270b-40a5-abf5-73717ccb6641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:03.955486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd70e1-270b-40a5-abf5-73717ccb6641 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:03.960113 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1271/2508] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:36:03 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:36:03.961372 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23f27b-4ac0-46af-9226-61088e3fe555 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:03.965562 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1238/2509] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:03.969489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd70e1-270b-40a5-abf5-73717ccb6641 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:03.974390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23f27b-4ac0-46af-9226-61088e3fe555 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:03.978952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d27a9-959b-46cd-8c2f-f9cde1115a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:03.979569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd70e1-270b-40a5-abf5-73717ccb6641 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:03.979724 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d27a9-959b-46cd-8c2f-f9cde1115a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.979860 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d27a9-959b-46cd-8c2f-f9cde1115a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.980139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d27a9-959b-46cd-8c2f-f9cde1115a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.980885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d27a9-959b-46cd-8c2f-f9cde1115a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:03.982493 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d27a9-959b-46cd-8c2f-f9cde1115a7d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:03.984257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fc386-52aa-4286-bf1a-165984d44886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:03.984982 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fc386-52aa-4286-bf1a-165984d44886 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:03.985270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fc386-52aa-4286-bf1a-165984d44886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:03.985548 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fc386-52aa-4286-bf1a-165984d44886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:03.986288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fc386-52aa-4286-bf1a-165984d44886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:03.987833 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fc386-52aa-4286-bf1a-165984d44886 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:03.992837 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1272/2510] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:36:03.996763 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d27a9-959b-46cd-8c2f-f9cde1115a7d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:04.001777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1239/2511] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:36:04.002856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fc386-52aa-4286-bf1a-165984d44886 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:04.006966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d27a9-959b-46cd-8c2f-f9cde1115a7d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:04.012702 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a7e35-152e-4f94-acea-dd906a395d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:04.012861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fc386-52aa-4286-bf1a-165984d44886 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:04.013465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a7e35-152e-4f94-acea-dd906a395d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:04.013751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a7e35-152e-4f94-acea-dd906a395d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:04.014026 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a7e35-152e-4f94-acea-dd906a395d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:04.014740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a7e35-152e-4f94-acea-dd906a395d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:04.016410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a7e35-152e-4f94-acea-dd906a395d49 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:04.017469 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e60590-51f2-4bbd-abcc-2b1bd5309720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:04.018324 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e60590-51f2-4bbd-abcc-2b1bd5309720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:04.018606 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e60590-51f2-4bbd-abcc-2b1bd5309720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:04.018880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e60590-51f2-4bbd-abcc-2b1bd5309720 admin admin] PATH_INFO: `/v3/projects/eeb678cd6e9447a3a5237a77384ce8ec/users/40584d8dd6ce452f88f74c6448253086/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:04.027179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1273/2512] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:04.031762 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a7e35-152e-4f94-acea-dd906a395d49 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:04.034034 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e60590-51f2-4bbd-abcc-2b1bd5309720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb678cd6e9447a3a5237a77384ce8ec, user_id=40584d8dd6ce452f88f74c6448253086, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:04.036673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e60590-51f2-4bbd-abcc-2b1bd5309720 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:04.041432 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a7e35-152e-4f94-acea-dd906a395d49 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:04.046397 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad530953-80ab-4359-adff-25a46845823d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:04.047262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad530953-80ab-4359-adff-25a46845823d admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:04.047545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad530953-80ab-4359-adff-25a46845823d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:04.047820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad530953-80ab-4359-adff-25a46845823d admin admin] PATH_INFO: `/v3/projects/1d7118d064ae410c8473710c806f3523/users/286ae48bd4914c779b95183fa7e602d5/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:04.049680 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1240/2513] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:04 2022] PUT /identity/v3/projects/eeb678cd6e9447a3a5237a77384ce8ec/users/40584d8dd6ce452f88f74c6448253086/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:36:04.051550 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:04.064053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997589-fc9e-4bd5-a80d-541709879b68 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:04.064240 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997589-fc9e-4bd5-a80d-541709879b68 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:04.064522 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2997589-fc9e-4bd5-a80d-541709879b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:04.067495 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad530953-80ab-4359-adff-25a46845823d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7118d064ae410c8473710c806f3523, user_id=286ae48bd4914c779b95183fa7e602d5, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:04.070204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad530953-80ab-4359-adff-25a46845823d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:04.085820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1274/2514] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:04 2022] PUT /identity/v3/projects/1d7118d064ae410c8473710c806f3523/users/286ae48bd4914c779b95183fa7e602d5/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:36:04.095407 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-e2997589-fc9e-4bd5-a80d-541709879b68 None None] MFA Rules not processed for user `40584d8dd6ce452f88f74c6448253086`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:04.095850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79c131-1743-41ea-af44-0ee0ce6be80c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:04.096170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79c131-1743-41ea-af44-0ee0ce6be80c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:04.096472 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79c131-1743-41ea-af44-0ee0ce6be80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:04.096664 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e2997589-fc9e-4bd5-a80d-541709879b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:04.125773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ec79c131-1743-41ea-af44-0ee0ce6be80c None None] MFA Rules not processed for user `286ae48bd4914c779b95183fa7e602d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:04.127070 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ec79c131-1743-41ea-af44-0ee0ce6be80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:04.161893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1241/2515] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:04.166311 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997589-fc9e-4bd5-a80d-541709879b68 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:04.191256 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1275/2516] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:36:04.195895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:04.203447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79c131-1743-41ea-af44-0ee0ce6be80c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:04.204993 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ec79c131-1743-41ea-af44-0ee0ce6be80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:04.229744 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2997589-fc9e-4bd5-a80d-541709879b68 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:04.234236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2778a45-fcef-47ab-b7be-e0bfb463da7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:04.234916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2778a45-fcef-47ab-b7be-e0bfb463da7e admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:04.235199 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2778a45-fcef-47ab-b7be-e0bfb463da7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:04.235475 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2778a45-fcef-47ab-b7be-e0bfb463da7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:04.236149 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2778a45-fcef-47ab-b7be-e0bfb463da7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:04.238650 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2778a45-fcef-47ab-b7be-e0bfb463da7e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:04.263087 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79c131-1743-41ea-af44-0ee0ce6be80c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:04.264020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1242/2517] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:36:04 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:36:04.267953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2778a45-fcef-47ab-b7be-e0bfb463da7e admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:04.311485 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b28fe-3cfd-4330-bab0-f769ecce8f1a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefb0fe4d09b451a861510508bb9cf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:04.312127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b28fe-3cfd-4330-bab0-f769ecce8f1a service glance] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:04.312412 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b28fe-3cfd-4330-bab0-f769ecce8f1a service glance] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:04.312685 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b28fe-3cfd-4330-bab0-f769ecce8f1a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:04.329568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2778a45-fcef-47ab-b7be-e0bfb463da7e admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:04.334119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa792db7-268b-4a56-8061-16fc46a0d7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:04.334786 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa792db7-268b-4a56-8061-16fc46a0d7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:04.335075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa792db7-268b-4a56-8061-16fc46a0d7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:04.335353 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa792db7-268b-4a56-8061-16fc46a0d7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:04.336035 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa792db7-268b-4a56-8061-16fc46a0d7b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:04.338125 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa792db7-268b-4a56-8061-16fc46a0d7b7 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:04.357867 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:04.359915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1243/2518] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:36:04 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:36:04.364849 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa792db7-268b-4a56-8061-16fc46a0d7b7 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:04.372452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b28fe-3cfd-4330-bab0-f769ecce8f1a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:04.374044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b28fe-3cfd-4330-bab0-f769ecce8f1a service glance] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:04.374292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa792db7-268b-4a56-8061-16fc46a0d7b7 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:04.378827 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62adba-c490-484f-b3c0-c1002f23ee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:04.379461 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62adba-c490-484f-b3c0-c1002f23ee50 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:04.379741 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62adba-c490-484f-b3c0-c1002f23ee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:04.380013 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62adba-c490-484f-b3c0-c1002f23ee50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:04.380726 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62adba-c490-484f-b3c0-c1002f23ee50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:04.382301 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62adba-c490-484f-b3c0-c1002f23ee50 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:04.383179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1276/2519] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:36:04.392967 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1244/2520] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:36:04.396198 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b28fe-3cfd-4330-bab0-f769ecce8f1a service glance] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:04.407942 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b28fe-3cfd-4330-bab0-f769ecce8f1a service glance] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:04.413139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d93c2-9f75-4844-8886-86defaf504be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:04.414080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d93c2-9f75-4844-8886-86defaf504be admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:04.414456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d93c2-9f75-4844-8886-86defaf504be admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:04.414738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d93c2-9f75-4844-8886-86defaf504be admin admin] PATH_INFO: `/v3/projects/1f086a1dcd774dcc9ddd3a0a693ec7e2/users/8c7e31f0bfe7417c8dd994dcbd98f0cf/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:04.430525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d93c2-9f75-4844-8886-86defaf504be admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f086a1dcd774dcc9ddd3a0a693ec7e2, user_id=8c7e31f0bfe7417c8dd994dcbd98f0cf, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:04.433457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d93c2-9f75-4844-8886-86defaf504be admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:04.451141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1277/2521] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:04 2022] PUT /identity/v3/projects/1f086a1dcd774dcc9ddd3a0a693ec7e2/users/8c7e31f0bfe7417c8dd994dcbd98f0cf/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:04.455089 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62adba-c490-484f-b3c0-c1002f23ee50 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:04.465389 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62adba-c490-484f-b3c0-c1002f23ee50 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:04.522033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be39e1-0736-4f7b-bff2-e196739cbbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:04.522693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be39e1-0736-4f7b-bff2-e196739cbbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:04.522974 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be39e1-0736-4f7b-bff2-e196739cbbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:04.523246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be39e1-0736-4f7b-bff2-e196739cbbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:04.523993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be39e1-0736-4f7b-bff2-e196739cbbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:04.525598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be39e1-0736-4f7b-bff2-e196739cbbc9 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:04.540413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1245/2522] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:36:04.541610 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d93c2-9f75-4844-8886-86defaf504be admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:04.552478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d93c2-9f75-4844-8886-86defaf504be admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:04.557841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e71d-2fe8-4ba1-b5b4-b95a832efa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:04.558723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e71d-2fe8-4ba1-b5b4-b95a832efa24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:04.559004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e71d-2fe8-4ba1-b5b4-b95a832efa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:04.559278 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e71d-2fe8-4ba1-b5b4-b95a832efa24 admin admin] PATH_INFO: `/v3/projects/1f086a1dcd774dcc9ddd3a0a693ec7e2/users/8c7e31f0bfe7417c8dd994dcbd98f0cf/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:04.561370 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360e71d-2fe8-4ba1-b5b4-b95a832efa24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f086a1dcd774dcc9ddd3a0a693ec7e2, user_id=8c7e31f0bfe7417c8dd994dcbd98f0cf, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:04.564004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360e71d-2fe8-4ba1-b5b4-b95a832efa24 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:04.575108 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1278/2523] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:04 2022] PUT /identity/v3/projects/1f086a1dcd774dcc9ddd3a0a693ec7e2/users/8c7e31f0bfe7417c8dd994dcbd98f0cf/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:04.586826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c4730-448a-4bbd-8f0e-d4b331bf6de4 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:04.587051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c4730-448a-4bbd-8f0e-d4b331bf6de4 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:04.587331 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c4730-448a-4bbd-8f0e-d4b331bf6de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:04.614601 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-462c4730-448a-4bbd-8f0e-d4b331bf6de4 None None] MFA Rules not processed for user `8c7e31f0bfe7417c8dd994dcbd98f0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:04.615812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-462c4730-448a-4bbd-8f0e-d4b331bf6de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:04.629641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:04.693224 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1246/2524] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:04.705292 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e71d-2fe8-4ba1-b5b4-b95a832efa24 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:04.707598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2360e71d-2fe8-4ba1-b5b4-b95a832efa24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:04.772160 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e71d-2fe8-4ba1-b5b4-b95a832efa24 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:04.776777 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18fe4c-6f6c-4b5c-b41f-30d9df0af737 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:04.777527 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18fe4c-6f6c-4b5c-b41f-30d9df0af737 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:04.777879 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18fe4c-6f6c-4b5c-b41f-30d9df0af737 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:04.778161 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18fe4c-6f6c-4b5c-b41f-30d9df0af737 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:04.841496 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18fe4c-6f6c-4b5c-b41f-30d9df0af737 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:04.843016 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18fe4c-6f6c-4b5c-b41f-30d9df0af737 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:04.853102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1279/2525] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:36:06.225403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c4730-448a-4bbd-8f0e-d4b331bf6de4 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:06.234933 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c4730-448a-4bbd-8f0e-d4b331bf6de4 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:06.238484 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd14e90-fbfe-457f-acc4-01ed1de0dbca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:06.239122 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd14e90-fbfe-457f-acc4-01ed1de0dbca service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:06.239403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd14e90-fbfe-457f-acc4-01ed1de0dbca service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:06.239676 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd14e90-fbfe-457f-acc4-01ed1de0dbca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:06.248724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd14e90-fbfe-457f-acc4-01ed1de0dbca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:06.250175 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd14e90-fbfe-457f-acc4-01ed1de0dbca service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:06.262480 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1247/2526] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:36:10.001092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18fe4c-6f6c-4b5c-b41f-30d9df0af737 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:10.186883 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18fe4c-6f6c-4b5c-b41f-30d9df0af737 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:10.193010 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1d1d5-7fcc-4fa4-ae95-6c4507a58ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:10.193203 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1d1d5-7fcc-4fa4-ae95-6c4507a58ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:10.194339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1d1d5-7fcc-4fa4-ae95-6c4507a58ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:10.194339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1d1d5-7fcc-4fa4-ae95-6c4507a58ed0 admin admin] PATH_INFO: `/v3/users/40584d8dd6ce452f88f74c6448253086` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:10.194919 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1d1d5-7fcc-4fa4-ae95-6c4507a58ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40584d8dd6ce452f88f74c6448253086)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:10.196843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1d1d5-7fcc-4fa4-ae95-6c4507a58ed0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:10.199413 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:10.244740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-97c1d1d5-7fcc-4fa4-ae95-6c4507a58ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40584d8dd6ce452f88f74c6448253086'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:10.256441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-97c1d1d5-7fcc-4fa4-ae95-6c4507a58ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40584d8dd6ce452f88f74c6448253086'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:10.263350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-97c1d1d5-7fcc-4fa4-ae95-6c4507a58ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40584d8dd6ce452f88f74c6448253086'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:10.264058 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-97c1d1d5-7fcc-4fa4-ae95-6c4507a58ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40584d8dd6ce452f88f74c6448253086'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:10.272374 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-97c1d1d5-7fcc-4fa4-ae95-6c4507a58ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40584d8dd6ce452f88f74c6448253086'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:10.278846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1280/2527] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:10 2022] DELETE /identity/v3/users/40584d8dd6ce452f88f74c6448253086 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:10.283515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e2497-eddb-486f-852c-a061657a6816 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:10.283968 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e2497-eddb-486f-852c-a061657a6816 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:10.284061 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e2497-eddb-486f-852c-a061657a6816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:10.301844 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-970e2497-eddb-486f-852c-a061657a6816 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:10.303026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-970e2497-eddb-486f-852c-a061657a6816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:10.362043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1248/2528] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:10.372350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1d1d5-7fcc-4fa4-ae95-6c4507a58ed0 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:10.373792 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-97c1d1d5-7fcc-4fa4-ae95-6c4507a58ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:10.431021 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1d1d5-7fcc-4fa4-ae95-6c4507a58ed0 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:10.434816 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44968136-f7c5-4973-bb3a-5c86a3d64a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:10.435491 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44968136-f7c5-4973-bb3a-5c86a3d64a2f service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:10.435774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44968136-f7c5-4973-bb3a-5c86a3d64a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:10.436066 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44968136-f7c5-4973-bb3a-5c86a3d64a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:10.445596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44968136-f7c5-4973-bb3a-5c86a3d64a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:10.447062 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44968136-f7c5-4973-bb3a-5c86a3d64a2f service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:10.456603 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1281/2529] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:10.738789 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e2497-eddb-486f-852c-a061657a6816 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:10.740479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-970e2497-eddb-486f-852c-a061657a6816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:10.753676 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e2497-eddb-486f-852c-a061657a6816 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:10.758588 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eda147-43d3-4a95-83a5-f8516ea0ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:10.759468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eda147-43d3-4a95-83a5-f8516ea0ad49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:10.759751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eda147-43d3-4a95-83a5-f8516ea0ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:10.760028 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eda147-43d3-4a95-83a5-f8516ea0ad49 admin admin] PATH_INFO: `/v3/projects/eeb678cd6e9447a3a5237a77384ce8ec` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:10.761264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eda147-43d3-4a95-83a5-f8516ea0ad49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb678cd6e9447a3a5237a77384ce8ec)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:10.763181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eda147-43d3-4a95-83a5-f8516ea0ad49 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:10.810322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78eda147-43d3-4a95-83a5-f8516ea0ad49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb678cd6e9447a3a5237a77384ce8ec', 'request_id': 'req-78eda147-43d3-4a95-83a5-f8516ea0ad49'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:10.820455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78eda147-43d3-4a95-83a5-f8516ea0ad49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb678cd6e9447a3a5237a77384ce8ec', 'request_id': 'req-78eda147-43d3-4a95-83a5-f8516ea0ad49'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:10.823659 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78eda147-43d3-4a95-83a5-f8516ea0ad49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb678cd6e9447a3a5237a77384ce8ec', 'request_id': 'req-78eda147-43d3-4a95-83a5-f8516ea0ad49'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:10.836768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78eda147-43d3-4a95-83a5-f8516ea0ad49 admin admin] The token cache is being invalidate because project eeb678cd6e9447a3a5237a77384ce8ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:10.837083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78eda147-43d3-4a95-83a5-f8516ea0ad49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:10.837727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-78eda147-43d3-4a95-83a5-f8516ea0ad49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:10.839252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1249/2530] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:10 2022] DELETE /identity/v3/projects/eeb678cd6e9447a3a5237a77384ce8ec => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:10.843239 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44968136-f7c5-4973-bb3a-5c86a3d64a2f service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:10.853512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44968136-f7c5-4973-bb3a-5c86a3d64a2f service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:10.915817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75c079-9c05-40ac-b658-d5c2739a52e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:10.916766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75c079-9c05-40ac-b658-d5c2739a52e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:10.917148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75c079-9c05-40ac-b658-d5c2739a52e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:10.917499 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75c079-9c05-40ac-b658-d5c2739a52e7 admin admin] PATH_INFO: `/v3/users/8c7e31f0bfe7417c8dd994dcbd98f0cf` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:10.918764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75c079-9c05-40ac-b658-d5c2739a52e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7e31f0bfe7417c8dd994dcbd98f0cf)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:10.920683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75c079-9c05-40ac-b658-d5c2739a52e7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:10.952276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:10.975996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2f75c079-9c05-40ac-b658-d5c2739a52e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7e31f0bfe7417c8dd994dcbd98f0cf'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:10.992902 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2f75c079-9c05-40ac-b658-d5c2739a52e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7e31f0bfe7417c8dd994dcbd98f0cf'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:11.002820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2f75c079-9c05-40ac-b658-d5c2739a52e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7e31f0bfe7417c8dd994dcbd98f0cf'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:11.004265 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2f75c079-9c05-40ac-b658-d5c2739a52e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7e31f0bfe7417c8dd994dcbd98f0cf'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:11.012123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2f75c079-9c05-40ac-b658-d5c2739a52e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7e31f0bfe7417c8dd994dcbd98f0cf'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:11.020840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1282/2531] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:10 2022] DELETE /identity/v3/users/8c7e31f0bfe7417c8dd994dcbd98f0cf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:11.298291 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eda147-43d3-4a95-83a5-f8516ea0ad49 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:11.299753 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-78eda147-43d3-4a95-83a5-f8516ea0ad49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:11.318621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eda147-43d3-4a95-83a5-f8516ea0ad49 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:11.344240 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:11.385483 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30309ae6-6549-49de-822f-fee6149a0caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:11.386347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30309ae6-6549-49de-822f-fee6149a0caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:11.386654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30309ae6-6549-49de-822f-fee6149a0caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:11.386910 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30309ae6-6549-49de-822f-fee6149a0caa admin admin] PATH_INFO: `/v3/projects/1f086a1dcd774dcc9ddd3a0a693ec7e2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:11.388083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30309ae6-6549-49de-822f-fee6149a0caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f086a1dcd774dcc9ddd3a0a693ec7e2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:11.390011 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30309ae6-6549-49de-822f-fee6149a0caa admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:11.436325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-30309ae6-6549-49de-822f-fee6149a0caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f086a1dcd774dcc9ddd3a0a693ec7e2', 'request_id': 'req-30309ae6-6549-49de-822f-fee6149a0caa'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:11.445887 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-30309ae6-6549-49de-822f-fee6149a0caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f086a1dcd774dcc9ddd3a0a693ec7e2', 'request_id': 'req-30309ae6-6549-49de-822f-fee6149a0caa'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:11.451522 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-30309ae6-6549-49de-822f-fee6149a0caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f086a1dcd774dcc9ddd3a0a693ec7e2', 'request_id': 'req-30309ae6-6549-49de-822f-fee6149a0caa'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:11.462521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-30309ae6-6549-49de-822f-fee6149a0caa admin admin] The token cache is being invalidate because project 1f086a1dcd774dcc9ddd3a0a693ec7e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:11.462849 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-30309ae6-6549-49de-822f-fee6149a0caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:11.463502 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-30309ae6-6549-49de-822f-fee6149a0caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:11.465095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1250/2532] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:11 2022] DELETE /identity/v3/projects/1f086a1dcd774dcc9ddd3a0a693ec7e2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:11.469956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe83f8-72cc-4c17-9bfe-628a04b584c0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:11.470243 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe83f8-72cc-4c17-9bfe-628a04b584c0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:11.470520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe83f8-72cc-4c17-9bfe-628a04b584c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:11.488318 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8ebe83f8-72cc-4c17-9bfe-628a04b584c0 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:11.489521 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8ebe83f8-72cc-4c17-9bfe-628a04b584c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:11.549493 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1283/2533] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:11.557645 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c354bf-d549-4e11-9cbf-e84e44a75f73 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:11.557954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c354bf-d549-4e11-9cbf-e84e44a75f73 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:11.558233 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c354bf-d549-4e11-9cbf-e84e44a75f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:11.577055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-a5c354bf-d549-4e11-9cbf-e84e44a75f73 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:11.578266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a5c354bf-d549-4e11-9cbf-e84e44a75f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:11.586622 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1251/2534] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:36:11.590832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe83f8-72cc-4c17-9bfe-628a04b584c0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:11.600908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe83f8-72cc-4c17-9bfe-628a04b584c0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:11.605671 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e1e5e-439a-4b02-bae0-57c9ca74749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:11.606321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e1e5e-439a-4b02-bae0-57c9ca74749a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:11.606601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e1e5e-439a-4b02-bae0-57c9ca74749a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:11.606873 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e1e5e-439a-4b02-bae0-57c9ca74749a admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:11.607656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e1e5e-439a-4b02-bae0-57c9ca74749a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:36:11.607956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e1e5e-439a-4b02-bae0-57c9ca74749a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:11.609597 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e1e5e-439a-4b02-bae0-57c9ca74749a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:11.621958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1284/2535] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:36:11.626161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c354bf-d549-4e11-9cbf-e84e44a75f73 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:11.635641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c354bf-d549-4e11-9cbf-e84e44a75f73 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:11.640358 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520abfd-fac9-4a0a-bf87-a6b3c3775d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:11.641062 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520abfd-fac9-4a0a-bf87-a6b3c3775d82 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:11.641350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520abfd-fac9-4a0a-bf87-a6b3c3775d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:11.641623 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520abfd-fac9-4a0a-bf87-a6b3c3775d82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:11.642307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520abfd-fac9-4a0a-bf87-a6b3c3775d82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:11.644719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520abfd-fac9-4a0a-bf87-a6b3c3775d82 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:11.670177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1252/2536] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:36:11 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:11.674457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e1e5e-439a-4b02-bae0-57c9ca74749a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:11.684303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e1e5e-439a-4b02-bae0-57c9ca74749a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:11.740851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c001c2-40de-4a73-b5b7-2fc107d345af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:11.741695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c001c2-40de-4a73-b5b7-2fc107d345af admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:11.741985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c001c2-40de-4a73-b5b7-2fc107d345af admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:11.742408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c001c2-40de-4a73-b5b7-2fc107d345af admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:11.743184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c001c2-40de-4a73-b5b7-2fc107d345af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:11.745349 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c001c2-40de-4a73-b5b7-2fc107d345af admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:11.768053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1285/2537] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:36:11 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:36:11.769951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520abfd-fac9-4a0a-bf87-a6b3c3775d82 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:11.780279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520abfd-fac9-4a0a-bf87-a6b3c3775d82 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:11.784878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53ed5f-5dbe-4388-b1f2-e66e432b405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:11.785559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53ed5f-5dbe-4388-b1f2-e66e432b405f admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:11.785844 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53ed5f-5dbe-4388-b1f2-e66e432b405f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:11.786121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53ed5f-5dbe-4388-b1f2-e66e432b405f admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:11.786847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53ed5f-5dbe-4388-b1f2-e66e432b405f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:11.788462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53ed5f-5dbe-4388-b1f2-e66e432b405f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:11.800896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1253/2538] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:11.804784 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c001c2-40de-4a73-b5b7-2fc107d345af admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:11.814715 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c001c2-40de-4a73-b5b7-2fc107d345af admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:11.819807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a7189-74ff-456d-b125-e154448088b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:11.820461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a7189-74ff-456d-b125-e154448088b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:11.820743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a7189-74ff-456d-b125-e154448088b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:11.821047 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a7189-74ff-456d-b125-e154448088b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:11.821776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a7189-74ff-456d-b125-e154448088b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:11.823360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a7189-74ff-456d-b125-e154448088b3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:11.833903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1286/2539] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:11.838070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53ed5f-5dbe-4388-b1f2-e66e432b405f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:11.848023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53ed5f-5dbe-4388-b1f2-e66e432b405f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:11.852513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537215d-6699-4db9-8fcd-419facc82fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:11.853417 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537215d-6699-4db9-8fcd-419facc82fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:11.853695 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537215d-6699-4db9-8fcd-419facc82fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:11.853985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537215d-6699-4db9-8fcd-419facc82fad admin admin] PATH_INFO: `/v3/projects/efc76572f0304a4e89e93a3859e43660/users/9b40ca3c30a14770adc3c5f25c0f014d/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:11.868121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537215d-6699-4db9-8fcd-419facc82fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc76572f0304a4e89e93a3859e43660, user_id=9b40ca3c30a14770adc3c5f25c0f014d, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:11.870753 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537215d-6699-4db9-8fcd-419facc82fad admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:11.884240 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1254/2540] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:11 2022] PUT /identity/v3/projects/efc76572f0304a4e89e93a3859e43660/users/9b40ca3c30a14770adc3c5f25c0f014d/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:36:11.896248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24353f-2cd9-4ffe-9537-e392a8cbb5e6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:11.896564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24353f-2cd9-4ffe-9537-e392a8cbb5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:11.896845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24353f-2cd9-4ffe-9537-e392a8cbb5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:11.914680 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:11.926188 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4f24353f-2cd9-4ffe-9537-e392a8cbb5e6 None None] MFA Rules not processed for user `9b40ca3c30a14770adc3c5f25c0f014d`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:11.927775 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4f24353f-2cd9-4ffe-9537-e392a8cbb5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:11.991949 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1287/2541] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:11.996683 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537215d-6699-4db9-8fcd-419facc82fad admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:12.048827 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:12.080808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537215d-6699-4db9-8fcd-419facc82fad admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:12.086368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d34f28-dd89-4306-8dc0-37ddb537285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:12.087199 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d34f28-dd89-4306-8dc0-37ddb537285e admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:12.087486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d34f28-dd89-4306-8dc0-37ddb537285e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:12.087752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d34f28-dd89-4306-8dc0-37ddb537285e admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:12.088450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d34f28-dd89-4306-8dc0-37ddb537285e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:12.090393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d34f28-dd89-4306-8dc0-37ddb537285e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:12.116976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1255/2542] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:36:11 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:12.120827 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24353f-2cd9-4ffe-9537-e392a8cbb5e6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:12.134158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24353f-2cd9-4ffe-9537-e392a8cbb5e6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:12.203589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05f3a0-6067-47f0-9640-cde6427096f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:12.204283 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05f3a0-6067-47f0-9640-cde6427096f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:12.204571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05f3a0-6067-47f0-9640-cde6427096f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:12.204852 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05f3a0-6067-47f0-9640-cde6427096f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:12.205600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05f3a0-6067-47f0-9640-cde6427096f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:12.207569 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05f3a0-6067-47f0-9640-cde6427096f9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:12.227971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1288/2543] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:36:12 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:12.232091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d34f28-dd89-4306-8dc0-37ddb537285e admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:12.242875 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d34f28-dd89-4306-8dc0-37ddb537285e admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:12.247878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe990de9-9354-4a23-bad6-68deb5c4f6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:12.248552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe990de9-9354-4a23-bad6-68deb5c4f6ed admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:12.248837 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe990de9-9354-4a23-bad6-68deb5c4f6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:12.249153 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe990de9-9354-4a23-bad6-68deb5c4f6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:12.249888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe990de9-9354-4a23-bad6-68deb5c4f6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:12.251787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe990de9-9354-4a23-bad6-68deb5c4f6ed admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:12.263408 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1256/2544] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:12.267647 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05f3a0-6067-47f0-9640-cde6427096f9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:12.277773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05f3a0-6067-47f0-9640-cde6427096f9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:12.282731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f7786-ff1f-406b-8e50-5523a9e49d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:12.283605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7786-ff1f-406b-8e50-5523a9e49d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:12.283893 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7786-ff1f-406b-8e50-5523a9e49d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:12.284174 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7786-ff1f-406b-8e50-5523a9e49d97 admin admin] PATH_INFO: `/v3/projects/9901ba96b8e54536a6e5f27f142be156/users/c516584c5977412196e6b6493652c58f/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:12.299341 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f7786-ff1f-406b-8e50-5523a9e49d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9901ba96b8e54536a6e5f27f142be156, user_id=c516584c5977412196e6b6493652c58f, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:12.302565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f7786-ff1f-406b-8e50-5523a9e49d97 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:12.316960 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1289/2545] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:12 2022] PUT /identity/v3/projects/9901ba96b8e54536a6e5f27f142be156/users/c516584c5977412196e6b6493652c58f/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:36:12.320914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe990de9-9354-4a23-bad6-68deb5c4f6ed admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:12.331849 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe990de9-9354-4a23-bad6-68deb5c4f6ed admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:12.390209 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bbb09-8bc5-4984-9313-dddd8e76d462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:12.390886 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bbb09-8bc5-4984-9313-dddd8e76d462 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:12.391196 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bbb09-8bc5-4984-9313-dddd8e76d462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:12.391454 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bbb09-8bc5-4984-9313-dddd8e76d462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:12.392177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bbb09-8bc5-4984-9313-dddd8e76d462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:12.393795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bbb09-8bc5-4984-9313-dddd8e76d462 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:12.404643 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1257/2546] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:12.408626 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f7786-ff1f-406b-8e50-5523a9e49d97 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:12.419083 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f7786-ff1f-406b-8e50-5523a9e49d97 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:12.423912 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e99f3-17ea-461e-abb8-4139b397ca5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:12.424786 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e99f3-17ea-461e-abb8-4139b397ca5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:12.425095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e99f3-17ea-461e-abb8-4139b397ca5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:12.425862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e99f3-17ea-461e-abb8-4139b397ca5e admin admin] PATH_INFO: `/v3/projects/9901ba96b8e54536a6e5f27f142be156/users/c516584c5977412196e6b6493652c58f/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:12.427901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e99f3-17ea-461e-abb8-4139b397ca5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9901ba96b8e54536a6e5f27f142be156, user_id=c516584c5977412196e6b6493652c58f, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:12.431018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e99f3-17ea-461e-abb8-4139b397ca5e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:12.443745 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1290/2547] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:12 2022] PUT /identity/v3/projects/9901ba96b8e54536a6e5f27f142be156/users/c516584c5977412196e6b6493652c58f/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:12.453966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d8db4-c0b0-4994-9251-b4da7ff6327f None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:12.454255 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d8db4-c0b0-4994-9251-b4da7ff6327f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:12.454535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d8db4-c0b0-4994-9251-b4da7ff6327f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:12.481831 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-c06d8db4-c0b0-4994-9251-b4da7ff6327f None None] MFA Rules not processed for user `c516584c5977412196e6b6493652c58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:12.483039 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c06d8db4-c0b0-4994-9251-b4da7ff6327f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:12.553566 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1258/2548] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:12.564812 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e99f3-17ea-461e-abb8-4139b397ca5e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:12.566555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3d1e99f3-17ea-461e-abb8-4139b397ca5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:12.623457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e99f3-17ea-461e-abb8-4139b397ca5e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:12.626963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba3f9b-8f74-4d2a-9bca-777479bb9b5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:12.627595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba3f9b-8f74-4d2a-9bca-777479bb9b5b service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:12.627874 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba3f9b-8f74-4d2a-9bca-777479bb9b5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:12.628148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba3f9b-8f74-4d2a-9bca-777479bb9b5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:12.633906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:12.637990 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba3f9b-8f74-4d2a-9bca-777479bb9b5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:12.640252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba3f9b-8f74-4d2a-9bca-777479bb9b5b service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:12.650538 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1291/2549] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:12.713915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d8db4-c0b0-4994-9251-b4da7ff6327f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:12.760145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:12.777078 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d8db4-c0b0-4994-9251-b4da7ff6327f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:12.781729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c268415-1511-42b5-9be2-8e4cb5021ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:12.782594 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c268415-1511-42b5-9be2-8e4cb5021ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:12.782877 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c268415-1511-42b5-9be2-8e4cb5021ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:12.783148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c268415-1511-42b5-9be2-8e4cb5021ab1 admin admin] PATH_INFO: `/v3/users/9b40ca3c30a14770adc3c5f25c0f014d` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:12.784329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c268415-1511-42b5-9be2-8e4cb5021ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b40ca3c30a14770adc3c5f25c0f014d)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:12.786826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c268415-1511-42b5-9be2-8e4cb5021ab1 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:12.835455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-6c268415-1511-42b5-9be2-8e4cb5021ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b40ca3c30a14770adc3c5f25c0f014d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:12.843223 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-6c268415-1511-42b5-9be2-8e4cb5021ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b40ca3c30a14770adc3c5f25c0f014d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:12.843937 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-6c268415-1511-42b5-9be2-8e4cb5021ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b40ca3c30a14770adc3c5f25c0f014d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:12.857774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-6c268415-1511-42b5-9be2-8e4cb5021ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b40ca3c30a14770adc3c5f25c0f014d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:12.866895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-6c268415-1511-42b5-9be2-8e4cb5021ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b40ca3c30a14770adc3c5f25c0f014d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:12.873158 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1259/2550] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:12 2022] DELETE /identity/v3/users/9b40ca3c30a14770adc3c5f25c0f014d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:12.877855 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f081afc-8d14-44a0-b925-f0a9800ec40b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:12.878086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f081afc-8d14-44a0-b925-f0a9800ec40b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:12.878386 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f081afc-8d14-44a0-b925-f0a9800ec40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:12.896138 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2f081afc-8d14-44a0-b925-f0a9800ec40b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:12.897392 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2f081afc-8d14-44a0-b925-f0a9800ec40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:12.958337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1292/2551] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:12.967960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c268415-1511-42b5-9be2-8e4cb5021ab1 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:12.969362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6c268415-1511-42b5-9be2-8e4cb5021ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:13.026059 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c268415-1511-42b5-9be2-8e4cb5021ab1 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:13.030425 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e17ba3-6509-49e3-a757-8e0573fb26e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:13.031263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e17ba3-6509-49e3-a757-8e0573fb26e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:13.031647 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e17ba3-6509-49e3-a757-8e0573fb26e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:13.031924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e17ba3-6509-49e3-a757-8e0573fb26e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:13.042070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e17ba3-6509-49e3-a757-8e0573fb26e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:13.043570 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e17ba3-6509-49e3-a757-8e0573fb26e9 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:13.054948 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1260/2552] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:13.352884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f081afc-8d14-44a0-b925-f0a9800ec40b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:13.354458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2f081afc-8d14-44a0-b925-f0a9800ec40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:13.393148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f081afc-8d14-44a0-b925-f0a9800ec40b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:13.398301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:13.399168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:13.399450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:13.399727 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be admin admin] PATH_INFO: `/v3/projects/efc76572f0304a4e89e93a3859e43660` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:13.400909 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc76572f0304a4e89e93a3859e43660)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:13.402946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:13.452051 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc76572f0304a4e89e93a3859e43660', 'request_id': 'req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:13.458980 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc76572f0304a4e89e93a3859e43660', 'request_id': 'req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:13.464629 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc76572f0304a4e89e93a3859e43660', 'request_id': 'req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:13.476728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be admin admin] The token cache is being invalidate because project efc76572f0304a4e89e93a3859e43660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:13.477049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:13.477670 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:13.479193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1293/2553] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:13 2022] DELETE /identity/v3/projects/efc76572f0304a4e89e93a3859e43660 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:13.483167 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e17ba3-6509-49e3-a757-8e0573fb26e9 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:13.493585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e17ba3-6509-49e3-a757-8e0573fb26e9 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:13.550056 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6199c2-a3a7-46ce-8b7a-ea81351915cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:13.550963 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6199c2-a3a7-46ce-8b7a-ea81351915cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:13.551268 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6199c2-a3a7-46ce-8b7a-ea81351915cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:13.551529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6199c2-a3a7-46ce-8b7a-ea81351915cd admin admin] PATH_INFO: `/v3/users/c516584c5977412196e6b6493652c58f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:13.552714 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6199c2-a3a7-46ce-8b7a-ea81351915cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c516584c5977412196e6b6493652c58f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:13.554715 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6199c2-a3a7-46ce-8b7a-ea81351915cd admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:13.559847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:13.603351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-6e6199c2-a3a7-46ce-8b7a-ea81351915cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c516584c5977412196e6b6493652c58f'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:13.610457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-6e6199c2-a3a7-46ce-8b7a-ea81351915cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c516584c5977412196e6b6493652c58f'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:13.611153 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-6e6199c2-a3a7-46ce-8b7a-ea81351915cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c516584c5977412196e6b6493652c58f'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:13.623322 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-6e6199c2-a3a7-46ce-8b7a-ea81351915cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c516584c5977412196e6b6493652c58f'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:13.632390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-6e6199c2-a3a7-46ce-8b7a-ea81351915cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c516584c5977412196e6b6493652c58f'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:13.641493 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1261/2554] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:13 2022] DELETE /identity/v3/users/c516584c5977412196e6b6493652c58f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:13.918386 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:13.919850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:13.933801 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9db3-1cf3-4ac9-a37d-5b85771444be admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:13.997091 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf43e1-27cd-4011-b6e7-d19b5dbed7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:13.997949 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf43e1-27cd-4011-b6e7-d19b5dbed7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:13.998228 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf43e1-27cd-4011-b6e7-d19b5dbed7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:13.998499 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf43e1-27cd-4011-b6e7-d19b5dbed7e1 admin admin] PATH_INFO: `/v3/projects/9901ba96b8e54536a6e5f27f142be156` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:13.999665 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf43e1-27cd-4011-b6e7-d19b5dbed7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9901ba96b8e54536a6e5f27f142be156)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:14.001609 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf43e1-27cd-4011-b6e7-d19b5dbed7e1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:14.022201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:14.049282 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9bbf43e1-27cd-4011-b6e7-d19b5dbed7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9901ba96b8e54536a6e5f27f142be156', 'request_id': 'req-9bbf43e1-27cd-4011-b6e7-d19b5dbed7e1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:14.055774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9bbf43e1-27cd-4011-b6e7-d19b5dbed7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9901ba96b8e54536a6e5f27f142be156', 'request_id': 'req-9bbf43e1-27cd-4011-b6e7-d19b5dbed7e1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:14.062038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9bbf43e1-27cd-4011-b6e7-d19b5dbed7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9901ba96b8e54536a6e5f27f142be156', 'request_id': 'req-9bbf43e1-27cd-4011-b6e7-d19b5dbed7e1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:14.077863 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9bbf43e1-27cd-4011-b6e7-d19b5dbed7e1 admin admin] The token cache is being invalidate because project 9901ba96b8e54536a6e5f27f142be156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:14.078164 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9bbf43e1-27cd-4011-b6e7-d19b5dbed7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:14.078783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9bbf43e1-27cd-4011-b6e7-d19b5dbed7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:14.080315 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1294/2555] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:13 2022] DELETE /identity/v3/projects/9901ba96b8e54536a6e5f27f142be156 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:14.085264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677d661-4381-48f1-9ff7-5888f3e00962 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.085562 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677d661-4381-48f1-9ff7-5888f3e00962 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.085846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677d661-4381-48f1-9ff7-5888f3e00962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.105644 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-7677d661-4381-48f1-9ff7-5888f3e00962 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:14.106874 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-7677d661-4381-48f1-9ff7-5888f3e00962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:14.166287 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1262/2556] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:14.174315 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc0729-9a30-44b7-90d3-a78210fea58a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.174605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc0729-9a30-44b7-90d3-a78210fea58a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.174889 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc0729-9a30-44b7-90d3-a78210fea58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.193367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c6fc0729-9a30-44b7-90d3-a78210fea58a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:14.194567 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c6fc0729-9a30-44b7-90d3-a78210fea58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:14.202354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1295/2557] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:14.207139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677d661-4381-48f1-9ff7-5888f3e00962 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:14.216719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677d661-4381-48f1-9ff7-5888f3e00962 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:14.221294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3578dd-579e-40af-8907-18d38be2fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:14.221959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3578dd-579e-40af-8907-18d38be2fc94 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.222241 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3578dd-579e-40af-8907-18d38be2fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.222518 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3578dd-579e-40af-8907-18d38be2fc94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.223283 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3578dd-579e-40af-8907-18d38be2fc94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:36:14.223586 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3578dd-579e-40af-8907-18d38be2fc94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:14.225257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3578dd-579e-40af-8907-18d38be2fc94 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:14.239918 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1263/2558] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:36:14.241530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc0729-9a30-44b7-90d3-a78210fea58a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:14.251224 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc0729-9a30-44b7-90d3-a78210fea58a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:14.256229 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbd06e-1e49-4d0b-a340-caa013e38043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:14.256885 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbd06e-1e49-4d0b-a340-caa013e38043 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.257197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbd06e-1e49-4d0b-a340-caa013e38043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.257477 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbd06e-1e49-4d0b-a340-caa013e38043 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.258187 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbd06e-1e49-4d0b-a340-caa013e38043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:14.260119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbd06e-1e49-4d0b-a340-caa013e38043 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:14.289755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1296/2559] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:36:14 2022] POST /identity/v3/projects => generated 407 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:14.293529 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3578dd-579e-40af-8907-18d38be2fc94 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:14.303272 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3578dd-579e-40af-8907-18d38be2fc94 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:14.358512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecd592-f644-42c3-9d74-90787172f54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:14.359186 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecd592-f644-42c3-9d74-90787172f54a admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.359468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecd592-f644-42c3-9d74-90787172f54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.359745 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecd592-f644-42c3-9d74-90787172f54a admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.360431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecd592-f644-42c3-9d74-90787172f54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:14.362364 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecd592-f644-42c3-9d74-90787172f54a admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:14.383239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1264/2560] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:36:14 2022] POST /identity/v3/users => generated 304 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:14.386723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbd06e-1e49-4d0b-a340-caa013e38043 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:14.398004 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbd06e-1e49-4d0b-a340-caa013e38043 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:14.402869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487ec21-0fcf-4db0-a9a5-d5d124806263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:14.403912 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487ec21-0fcf-4db0-a9a5-d5d124806263 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.404398 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487ec21-0fcf-4db0-a9a5-d5d124806263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.404910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487ec21-0fcf-4db0-a9a5-d5d124806263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.406031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487ec21-0fcf-4db0-a9a5-d5d124806263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:14.408001 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487ec21-0fcf-4db0-a9a5-d5d124806263 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:14.420605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1297/2561] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:14.424651 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecd592-f644-42c3-9d74-90787172f54a admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:14.429805 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:14.436136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecd592-f644-42c3-9d74-90787172f54a admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:14.445121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7f35f-2358-4cbe-87f9-3aed054958e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:14.445895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7f35f-2358-4cbe-87f9-3aed054958e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.446253 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7f35f-2358-4cbe-87f9-3aed054958e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.446603 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7f35f-2358-4cbe-87f9-3aed054958e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.447413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7f35f-2358-4cbe-87f9-3aed054958e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:14.449276 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7f35f-2358-4cbe-87f9-3aed054958e5 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:14.460526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1265/2562] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:36:14.464795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487ec21-0fcf-4db0-a9a5-d5d124806263 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:14.474957 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487ec21-0fcf-4db0-a9a5-d5d124806263 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:14.480028 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251e1ab-82d0-4e8d-988b-273f41b6432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:14.480954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251e1ab-82d0-4e8d-988b-273f41b6432b admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.481277 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251e1ab-82d0-4e8d-988b-273f41b6432b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.481555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251e1ab-82d0-4e8d-988b-273f41b6432b admin admin] PATH_INFO: `/v3/projects/c9bb50290711425caa8df150b8666926/users/a48f96d87f6d49dc90e8d7c5c8547c47/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.497696 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251e1ab-82d0-4e8d-988b-273f41b6432b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9bb50290711425caa8df150b8666926, user_id=a48f96d87f6d49dc90e8d7c5c8547c47, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:14.500328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251e1ab-82d0-4e8d-988b-273f41b6432b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:14.514677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1298/2563] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:14 2022] PUT /identity/v3/projects/c9bb50290711425caa8df150b8666926/users/a48f96d87f6d49dc90e8d7c5c8547c47/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:14.526854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2feb0e-de46-4929-a0a7-16411175eaa9 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.527424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2feb0e-de46-4929-a0a7-16411175eaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.527424 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2feb0e-de46-4929-a0a7-16411175eaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.555057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-ff2feb0e-de46-4929-a0a7-16411175eaa9 None None] MFA Rules not processed for user `a48f96d87f6d49dc90e8d7c5c8547c47`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:14.556227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ff2feb0e-de46-4929-a0a7-16411175eaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:14.620409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1266/2564] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:14.624871 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251e1ab-82d0-4e8d-988b-273f41b6432b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:14.690148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251e1ab-82d0-4e8d-988b-273f41b6432b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:14.695656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d347089-755e-438a-9226-fc51c8e961f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:14.696327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d347089-755e-438a-9226-fc51c8e961f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.696613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d347089-755e-438a-9226-fc51c8e961f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.697003 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d347089-755e-438a-9226-fc51c8e961f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.697704 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d347089-755e-438a-9226-fc51c8e961f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:14.699646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d347089-755e-438a-9226-fc51c8e961f7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:14.724919 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1299/2565] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:36:14 2022] POST /identity/v3/projects => generated 407 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:14.729145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2feb0e-de46-4929-a0a7-16411175eaa9 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:14.741240 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2feb0e-de46-4929-a0a7-16411175eaa9 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:14.803088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f62d6f-a0b4-4739-ab08-cd56a37a4b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:14.803760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f62d6f-a0b4-4739-ab08-cd56a37a4b62 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.804041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f62d6f-a0b4-4739-ab08-cd56a37a4b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.804315 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f62d6f-a0b4-4739-ab08-cd56a37a4b62 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.805042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f62d6f-a0b4-4739-ab08-cd56a37a4b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:14.806923 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f62d6f-a0b4-4739-ab08-cd56a37a4b62 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:14.827639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1267/2566] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:36:14 2022] POST /identity/v3/users => generated 310 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:36:14.831646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d347089-755e-438a-9226-fc51c8e961f7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:14.842058 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d347089-755e-438a-9226-fc51c8e961f7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:14.846579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4bcde-b5f8-443b-9336-081a5d8cac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:14.847714 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4bcde-b5f8-443b-9336-081a5d8cac52 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.847988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4bcde-b5f8-443b-9336-081a5d8cac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.848269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4bcde-b5f8-443b-9336-081a5d8cac52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.849019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4bcde-b5f8-443b-9336-081a5d8cac52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:14.850606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4bcde-b5f8-443b-9336-081a5d8cac52 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:14.861298 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1300/2567] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:14.866235 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f62d6f-a0b4-4739-ab08-cd56a37a4b62 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:14.875961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f62d6f-a0b4-4739-ab08-cd56a37a4b62 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:14.880523 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1e275-9291-4cf8-90eb-b4dbc91872e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:14.881430 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1e275-9291-4cf8-90eb-b4dbc91872e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.881711 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1e275-9291-4cf8-90eb-b4dbc91872e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.881985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1e275-9291-4cf8-90eb-b4dbc91872e4 admin admin] PATH_INFO: `/v3/projects/cb12466fd2b64169b67ec2668f5c4a63/users/ddbe8adff67b44bda45cc99d8112a793/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.897466 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1e275-9291-4cf8-90eb-b4dbc91872e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb12466fd2b64169b67ec2668f5c4a63, user_id=ddbe8adff67b44bda45cc99d8112a793, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:14.900090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1e275-9291-4cf8-90eb-b4dbc91872e4 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:14.913619 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1268/2568] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:14 2022] PUT /identity/v3/projects/cb12466fd2b64169b67ec2668f5c4a63/users/ddbe8adff67b44bda45cc99d8112a793/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:14.917634 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4bcde-b5f8-443b-9336-081a5d8cac52 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:14.928263 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4bcde-b5f8-443b-9336-081a5d8cac52 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:14.940851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:14.986396 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fc579-94cd-414b-ba57-6536f887fce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:14.987063 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fc579-94cd-414b-ba57-6536f887fce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:14.987344 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fc579-94cd-414b-ba57-6536f887fce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:14.987615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fc579-94cd-414b-ba57-6536f887fce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:14.988952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fc579-94cd-414b-ba57-6536f887fce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:14.990571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fc579-94cd-414b-ba57-6536f887fce9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:15.000650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1301/2569] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:36:15.004969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1e275-9291-4cf8-90eb-b4dbc91872e4 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:15.015206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1e275-9291-4cf8-90eb-b4dbc91872e4 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:15.019733 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca738b46-245f-4798-9b04-a1522b5ad777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:15.020941 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca738b46-245f-4798-9b04-a1522b5ad777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:15.021228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca738b46-245f-4798-9b04-a1522b5ad777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:15.021505 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca738b46-245f-4798-9b04-a1522b5ad777 admin admin] PATH_INFO: `/v3/projects/cb12466fd2b64169b67ec2668f5c4a63/users/ddbe8adff67b44bda45cc99d8112a793/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:15.023508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca738b46-245f-4798-9b04-a1522b5ad777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb12466fd2b64169b67ec2668f5c4a63, user_id=ddbe8adff67b44bda45cc99d8112a793, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:15.026246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca738b46-245f-4798-9b04-a1522b5ad777 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:15.037769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1269/2570] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:15 2022] PUT /identity/v3/projects/cb12466fd2b64169b67ec2668f5c4a63/users/ddbe8adff67b44bda45cc99d8112a793/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:36:15.048393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5ee17-be28-41a1-ad15-2d82a1b7f4fb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:15.048681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5ee17-be28-41a1-ad15-2d82a1b7f4fb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:15.048993 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5ee17-be28-41a1-ad15-2d82a1b7f4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:15.077355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-14a5ee17-be28-41a1-ad15-2d82a1b7f4fb None None] MFA Rules not processed for user `ddbe8adff67b44bda45cc99d8112a793`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:15.078573 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-14a5ee17-be28-41a1-ad15-2d82a1b7f4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:15.150484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1302/2571] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:15 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:15.162138 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca738b46-245f-4798-9b04-a1522b5ad777 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:15.163807 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ca738b46-245f-4798-9b04-a1522b5ad777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:15.198654 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:15.222545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca738b46-245f-4798-9b04-a1522b5ad777 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:15.226217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6b2cf-81b2-4eb5-b6a6-3c5fd989331f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:15.226870 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6b2cf-81b2-4eb5-b6a6-3c5fd989331f service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:15.227156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6b2cf-81b2-4eb5-b6a6-3c5fd989331f service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:15.227437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6b2cf-81b2-4eb5-b6a6-3c5fd989331f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:15.236292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6b2cf-81b2-4eb5-b6a6-3c5fd989331f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:15.238275 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6b2cf-81b2-4eb5-b6a6-3c5fd989331f service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:15.247535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1270/2572] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:15 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:15.398629 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5ee17-be28-41a1-ad15-2d82a1b7f4fb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:15.400018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-14a5ee17-be28-41a1-ad15-2d82a1b7f4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:15.412542 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5ee17-be28-41a1-ad15-2d82a1b7f4fb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:15.416259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442850f-66cd-44d4-bd6b-bdb21f714424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:15.416945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442850f-66cd-44d4-bd6b-bdb21f714424 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:15.417256 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442850f-66cd-44d4-bd6b-bdb21f714424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:15.417560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442850f-66cd-44d4-bd6b-bdb21f714424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:15.473259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442850f-66cd-44d4-bd6b-bdb21f714424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:15.474686 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442850f-66cd-44d4-bd6b-bdb21f714424 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:15.483626 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1303/2573] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:15 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:18.409664 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99483289-8c56-4cc0-9b17-c295a0791198 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:18.410156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99483289-8c56-4cc0-9b17-c295a0791198 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:18.410258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99483289-8c56-4cc0-9b17-c295a0791198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:18.428207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-99483289-8c56-4cc0-9b17-c295a0791198 None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:18.429329 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-99483289-8c56-4cc0-9b17-c295a0791198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:18.487343 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1271/2574] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jul 21 22:36:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:18.532895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442850f-66cd-44d4-bd6b-bdb21f714424 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:18.534821 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8442850f-66cd-44d4-bd6b-bdb21f714424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:18.575599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:18.602112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442850f-66cd-44d4-bd6b-bdb21f714424 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:18.607072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bb5c8-6a58-4aec-8d1b-fada7afd259a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:18.607710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bb5c8-6a58-4aec-8d1b-fada7afd259a service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:18.607991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bb5c8-6a58-4aec-8d1b-fada7afd259a service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:18.608267 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bb5c8-6a58-4aec-8d1b-fada7afd259a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:18.616731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bb5c8-6a58-4aec-8d1b-fada7afd259a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:18.618330 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bb5c8-6a58-4aec-8d1b-fada7afd259a service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:18.626240 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1304/2575] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:36:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:36:19.022017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99483289-8c56-4cc0-9b17-c295a0791198 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:19.023502 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-99483289-8c56-4cc0-9b17-c295a0791198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:19.112309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99483289-8c56-4cc0-9b17-c295a0791198 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:19.117870 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f18b9-eb9b-4650-9a73-41e39488a65c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:19.118516 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f18b9-eb9b-4650-9a73-41e39488a65c service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:19.118934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f18b9-eb9b-4650-9a73-41e39488a65c service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:19.119222 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f18b9-eb9b-4650-9a73-41e39488a65c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:19.122233 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8c3f18b9-eb9b-4650-9a73-41e39488a65c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:19.134992 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f18b9-eb9b-4650-9a73-41e39488a65c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:19.137252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f18b9-eb9b-4650-9a73-41e39488a65c service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:19.150568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1272/2576] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:20.839135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bb5c8-6a58-4aec-8d1b-fada7afd259a service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:20.912389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bb5c8-6a58-4aec-8d1b-fada7afd259a service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:20.918360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db422a14-4684-4a54-8e3c-66d411b05c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:20.919600 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db422a14-4684-4a54-8e3c-66d411b05c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:20.920726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db422a14-4684-4a54-8e3c-66d411b05c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:20.921495 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db422a14-4684-4a54-8e3c-66d411b05c0b admin admin] PATH_INFO: `/v3/users/a48f96d87f6d49dc90e8d7c5c8547c47` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:20.923353 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db422a14-4684-4a54-8e3c-66d411b05c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a48f96d87f6d49dc90e8d7c5c8547c47)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:20.925767 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db422a14-4684-4a54-8e3c-66d411b05c0b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:20.977403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f18b9-eb9b-4650-9a73-41e39488a65c service nova] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:20.979178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8c3f18b9-eb9b-4650-9a73-41e39488a65c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:20.987177 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-db422a14-4684-4a54-8e3c-66d411b05c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a48f96d87f6d49dc90e8d7c5c8547c47'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:20.996255 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f18b9-eb9b-4650-9a73-41e39488a65c service nova] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:21.004465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-db422a14-4684-4a54-8e3c-66d411b05c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a48f96d87f6d49dc90e8d7c5c8547c47'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:21.018386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5833c-c51e-41e9-80e8-2720d5bcfdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:21.018663 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-db422a14-4684-4a54-8e3c-66d411b05c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a48f96d87f6d49dc90e8d7c5c8547c47'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:21.019197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-db422a14-4684-4a54-8e3c-66d411b05c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a48f96d87f6d49dc90e8d7c5c8547c47'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:21.019346 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5833c-c51e-41e9-80e8-2720d5bcfdd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:21.019629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5833c-c51e-41e9-80e8-2720d5bcfdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:21.019909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5833c-c51e-41e9-80e8-2720d5bcfdd3 admin admin] PATH_INFO: `/v3/users/286ae48bd4914c779b95183fa7e602d5` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:21.021153 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5833c-c51e-41e9-80e8-2720d5bcfdd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=286ae48bd4914c779b95183fa7e602d5)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:21.023080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5833c-c51e-41e9-80e8-2720d5bcfdd3 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:21.027297 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-db422a14-4684-4a54-8e3c-66d411b05c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a48f96d87f6d49dc90e8d7c5c8547c47'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:21.036436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1305/2577] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:20 2022] DELETE /identity/v3/users/a48f96d87f6d49dc90e8d7c5c8547c47 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:21.040906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bb037-d525-427b-8298-c6396eb1d0a6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:21.041299 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bb037-d525-427b-8298-c6396eb1d0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:21.041638 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bb037-d525-427b-8298-c6396eb1d0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:21.090246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-222bb037-d525-427b-8298-c6396eb1d0a6 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:21.091579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-222bb037-d525-427b-8298-c6396eb1d0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:21.148754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b7e5833c-c51e-41e9-80e8-2720d5bcfdd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '286ae48bd4914c779b95183fa7e602d5'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:21.156719 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:21.163541 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b7e5833c-c51e-41e9-80e8-2720d5bcfdd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '286ae48bd4914c779b95183fa7e602d5'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:21.165072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b7e5833c-c51e-41e9-80e8-2720d5bcfdd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '286ae48bd4914c779b95183fa7e602d5'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:21.174568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:21.184758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1306/2578] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:21.195139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bb037-d525-427b-8298-c6396eb1d0a6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:21.196699 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-222bb037-d525-427b-8298-c6396eb1d0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:21.198864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b7e5833c-c51e-41e9-80e8-2720d5bcfdd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '286ae48bd4914c779b95183fa7e602d5'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:21.213080 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b7e5833c-c51e-41e9-80e8-2720d5bcfdd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '286ae48bd4914c779b95183fa7e602d5'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:21.229336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1273/2579] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:20 2022] DELETE /identity/v3/users/286ae48bd4914c779b95183fa7e602d5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:36:21.234221 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c063dd-a595-4b7c-9541-774615048528 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:21.234638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c063dd-a595-4b7c-9541-774615048528 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:21.235021 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c063dd-a595-4b7c-9541-774615048528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:21.267342 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-d5c063dd-a595-4b7c-9541-774615048528 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:21.270247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-d5c063dd-a595-4b7c-9541-774615048528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:21.303291 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bb037-d525-427b-8298-c6396eb1d0a6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:21.382736 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b964bfe-0b9c-4caa-8b7e-75607a657273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:21.383728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b964bfe-0b9c-4caa-8b7e-75607a657273 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:21.384332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b964bfe-0b9c-4caa-8b7e-75607a657273 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:21.384776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b964bfe-0b9c-4caa-8b7e-75607a657273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:21.386294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1274/2580] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:21.390523 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5b964bfe-0b9c-4caa-8b7e-75607a657273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:21.396431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c063dd-a595-4b7c-9541-774615048528 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:21.398211 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-d5c063dd-a595-4b7c-9541-774615048528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:21.418426 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b964bfe-0b9c-4caa-8b7e-75607a657273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:21.421036 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c063dd-a595-4b7c-9541-774615048528 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:21.422933 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b964bfe-0b9c-4caa-8b7e-75607a657273 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:21.435572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0de40-855c-40fc-9155-c2557e9dd8fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:21.436406 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0de40-855c-40fc-9155-c2557e9dd8fb service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:21.436803 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0de40-855c-40fc-9155-c2557e9dd8fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:21.437206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0de40-855c-40fc-9155-c2557e9dd8fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:21.450165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1307/2581] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:36:21.455141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0de40-855c-40fc-9155-c2557e9dd8fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:21.456226 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0de40-855c-40fc-9155-c2557e9dd8fb service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:21.469187 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1275/2582] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:36:22.077390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b964bfe-0b9c-4caa-8b7e-75607a657273 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:22.078865 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5b964bfe-0b9c-4caa-8b7e-75607a657273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:22.107393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b964bfe-0b9c-4caa-8b7e-75607a657273 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:22.115270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f149b-57d6-403f-90ee-43c245af59cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:22.116173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f149b-57d6-403f-90ee-43c245af59cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:22.116461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f149b-57d6-403f-90ee-43c245af59cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:22.116752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f149b-57d6-403f-90ee-43c245af59cd admin admin] PATH_INFO: `/v3/projects/1d7118d064ae410c8473710c806f3523` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:22.125834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f149b-57d6-403f-90ee-43c245af59cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7118d064ae410c8473710c806f3523)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:22.127771 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f149b-57d6-403f-90ee-43c245af59cd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:22.221433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-805f149b-57d6-403f-90ee-43c245af59cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7118d064ae410c8473710c806f3523', 'request_id': 'req-805f149b-57d6-403f-90ee-43c245af59cd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:22.237601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-805f149b-57d6-403f-90ee-43c245af59cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7118d064ae410c8473710c806f3523', 'request_id': 'req-805f149b-57d6-403f-90ee-43c245af59cd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:22.246824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-805f149b-57d6-403f-90ee-43c245af59cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7118d064ae410c8473710c806f3523', 'request_id': 'req-805f149b-57d6-403f-90ee-43c245af59cd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:22.300211 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-805f149b-57d6-403f-90ee-43c245af59cd admin admin] The token cache is being invalidate because project 1d7118d064ae410c8473710c806f3523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:22.300469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-805f149b-57d6-403f-90ee-43c245af59cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:22.302987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-805f149b-57d6-403f-90ee-43c245af59cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:22.313864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6274123-e4c6-4449-b2b3-c68c57b3af07 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:22.315086 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6274123-e4c6-4449-b2b3-c68c57b3af07 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:22.316712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6274123-e4c6-4449-b2b3-c68c57b3af07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:22.317839 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1308/2583] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:22 2022] DELETE /identity/v3/projects/1d7118d064ae410c8473710c806f3523 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:22.318710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f149b-57d6-403f-90ee-43c245af59cd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:22.321127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-805f149b-57d6-403f-90ee-43c245af59cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:22.341784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-c6274123-e4c6-4449-b2b3-c68c57b3af07 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:22.343674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c6274123-e4c6-4449-b2b3-c68c57b3af07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:22.365172 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:22.435067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1276/2584] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:22.445399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1357763-d701-4745-893e-f91f76db539c None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:22.445636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1357763-d701-4745-893e-f91f76db539c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:22.446041 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1357763-d701-4745-893e-f91f76db539c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:22.450159 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f149b-57d6-403f-90ee-43c245af59cd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:22.458870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28473f2-10ec-4430-b1f5-215e20229415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:22.459967 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28473f2-10ec-4430-b1f5-215e20229415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:22.460936 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28473f2-10ec-4430-b1f5-215e20229415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:22.461306 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28473f2-10ec-4430-b1f5-215e20229415 admin admin] PATH_INFO: `/v3/projects/c9bb50290711425caa8df150b8666926` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:22.463243 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28473f2-10ec-4430-b1f5-215e20229415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9bb50290711425caa8df150b8666926)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:22.465382 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28473f2-10ec-4430-b1f5-215e20229415 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:22.466806 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-a1357763-d701-4745-893e-f91f76db539c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:22.468227 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a1357763-d701-4745-893e-f91f76db539c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:22.478892 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1277/2585] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:22.484009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1357763-d701-4745-893e-f91f76db539c None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:22.506156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1357763-d701-4745-893e-f91f76db539c None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:22.515263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd7fc4-d8d4-42b7-8020-8b65ab21b269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:22.516298 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd7fc4-d8d4-42b7-8020-8b65ab21b269 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:22.516627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd7fc4-d8d4-42b7-8020-8b65ab21b269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:22.517709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd7fc4-d8d4-42b7-8020-8b65ab21b269 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:22.520635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd7fc4-d8d4-42b7-8020-8b65ab21b269 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:36:22.521593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd7fc4-d8d4-42b7-8020-8b65ab21b269 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:22.525249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd7fc4-d8d4-42b7-8020-8b65ab21b269 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:22.543606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a28473f2-10ec-4430-b1f5-215e20229415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9bb50290711425caa8df150b8666926', 'request_id': 'req-a28473f2-10ec-4430-b1f5-215e20229415'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:22.546809 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1278/2586] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:36:22.550698 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd7fc4-d8d4-42b7-8020-8b65ab21b269 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:22.553288 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a28473f2-10ec-4430-b1f5-215e20229415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9bb50290711425caa8df150b8666926', 'request_id': 'req-a28473f2-10ec-4430-b1f5-215e20229415'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:22.561276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a28473f2-10ec-4430-b1f5-215e20229415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9bb50290711425caa8df150b8666926', 'request_id': 'req-a28473f2-10ec-4430-b1f5-215e20229415'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:22.568828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd7fc4-d8d4-42b7-8020-8b65ab21b269 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:22.579939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a28473f2-10ec-4430-b1f5-215e20229415 admin admin] The token cache is being invalidate because project c9bb50290711425caa8df150b8666926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:22.580551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a28473f2-10ec-4430-b1f5-215e20229415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:22.582078 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a28473f2-10ec-4430-b1f5-215e20229415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:22.587416 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1309/2587] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:22 2022] DELETE /identity/v3/projects/c9bb50290711425caa8df150b8666926 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:36:22.588576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28473f2-10ec-4430-b1f5-215e20229415 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:22.590795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a28473f2-10ec-4430-b1f5-215e20229415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:22.656239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:22.681403 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d647d-f6a5-4cd7-bc48-6d3befdaabcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:22.682547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d647d-f6a5-4cd7-bc48-6d3befdaabcc admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:22.682934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d647d-f6a5-4cd7-bc48-6d3befdaabcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:22.683303 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d647d-f6a5-4cd7-bc48-6d3befdaabcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:22.684180 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d647d-f6a5-4cd7-bc48-6d3befdaabcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:22.685059 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28473f2-10ec-4430-b1f5-215e20229415 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:22.686324 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d647d-f6a5-4cd7-bc48-6d3befdaabcc admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:22.696305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a8757-8e67-4cd0-af08-f136bd3393fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:22.697276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8757-8e67-4cd0-af08-f136bd3393fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:22.697560 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8757-8e67-4cd0-af08-f136bd3393fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:22.698012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8757-8e67-4cd0-af08-f136bd3393fa admin admin] PATH_INFO: `/v3/users/ddbe8adff67b44bda45cc99d8112a793` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:22.699301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a8757-8e67-4cd0-af08-f136bd3393fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddbe8adff67b44bda45cc99d8112a793)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:22.701544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a8757-8e67-4cd0-af08-f136bd3393fa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:22.732585 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1279/2588] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:36:22 2022] POST /identity/v3/projects => generated 359 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:22.735233 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d647d-f6a5-4cd7-bc48-6d3befdaabcc admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:22.737234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-894d647d-f6a5-4cd7-bc48-6d3befdaabcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:22.785890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d52a8757-8e67-4cd0-af08-f136bd3393fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddbe8adff67b44bda45cc99d8112a793'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:22.800155 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:22.802100 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d52a8757-8e67-4cd0-af08-f136bd3393fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddbe8adff67b44bda45cc99d8112a793'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:22.811774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d52a8757-8e67-4cd0-af08-f136bd3393fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddbe8adff67b44bda45cc99d8112a793'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:22.813117 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d52a8757-8e67-4cd0-af08-f136bd3393fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddbe8adff67b44bda45cc99d8112a793'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:22.827648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d52a8757-8e67-4cd0-af08-f136bd3393fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddbe8adff67b44bda45cc99d8112a793'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:22.842067 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1310/2589] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:22 2022] DELETE /identity/v3/users/ddbe8adff67b44bda45cc99d8112a793 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:22.870372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d647d-f6a5-4cd7-bc48-6d3befdaabcc admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:22.990813 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b9313-bae0-40ad-a814-e0d97273f839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:22.991501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b9313-bae0-40ad-a814-e0d97273f839 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:22.991918 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b9313-bae0-40ad-a814-e0d97273f839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:22.992201 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b9313-bae0-40ad-a814-e0d97273f839 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:22.993214 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b9313-bae0-40ad-a814-e0d97273f839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:22.995964 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b9313-bae0-40ad-a814-e0d97273f839 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:23.040038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1280/2590] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:36:22 2022] POST /identity/v3/users => generated 280 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:23.042096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a8757-8e67-4cd0-af08-f136bd3393fa admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:23.043690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d52a8757-8e67-4cd0-af08-f136bd3393fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:23.069464 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a8757-8e67-4cd0-af08-f136bd3393fa admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:23.079701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d990e-5fd1-480a-9f5a-8c037f03db20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:23.080478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d990e-5fd1-480a-9f5a-8c037f03db20 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:23.080869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d990e-5fd1-480a-9f5a-8c037f03db20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:23.082089 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d990e-5fd1-480a-9f5a-8c037f03db20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:23.082945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d990e-5fd1-480a-9f5a-8c037f03db20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:23.084700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d990e-5fd1-480a-9f5a-8c037f03db20 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:23.126658 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b9313-bae0-40ad-a814-e0d97273f839 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:23.127081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1311/2591] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:23.150492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b9313-bae0-40ad-a814-e0d97273f839 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:23.158374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ec62b-643d-4d7f-8884-5251994806f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:23.159353 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ec62b-643d-4d7f-8884-5251994806f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:23.159740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ec62b-643d-4d7f-8884-5251994806f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:23.160420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ec62b-643d-4d7f-8884-5251994806f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:23.161353 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ec62b-643d-4d7f-8884-5251994806f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:23.163091 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ec62b-643d-4d7f-8884-5251994806f3 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:23.186046 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1281/2592] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:36:23.198993 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d990e-5fd1-480a-9f5a-8c037f03db20 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:23.216116 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d990e-5fd1-480a-9f5a-8c037f03db20 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:23.226617 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21f43c-1a49-4401-afd4-306170f5a30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:23.227730 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21f43c-1a49-4401-afd4-306170f5a30f admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:23.228284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21f43c-1a49-4401-afd4-306170f5a30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:23.228659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21f43c-1a49-4401-afd4-306170f5a30f admin admin] PATH_INFO: `/v3/projects/da7aed20356447eeb206dc95a63529bc/users/f589aba4419f41fd87acfb7abfc25d24/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:23.247508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21f43c-1a49-4401-afd4-306170f5a30f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da7aed20356447eeb206dc95a63529bc, user_id=f589aba4419f41fd87acfb7abfc25d24, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:23.251353 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21f43c-1a49-4401-afd4-306170f5a30f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:23.283184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1312/2593] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:23 2022] PUT /identity/v3/projects/da7aed20356447eeb206dc95a63529bc/users/f589aba4419f41fd87acfb7abfc25d24/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:23.295975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d24cc-9199-4d42-95d9-762d25243b27 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:23.296452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d24cc-9199-4d42-95d9-762d25243b27 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:23.297118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d24cc-9199-4d42-95d9-762d25243b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:23.349958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-1a2d24cc-9199-4d42-95d9-762d25243b27 None None] MFA Rules not processed for user `f589aba4419f41fd87acfb7abfc25d24`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:23.351347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-1a2d24cc-9199-4d42-95d9-762d25243b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:23.431055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:23.477230 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1282/2594] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:23 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:23.515172 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21f43c-1a49-4401-afd4-306170f5a30f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:23.516975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9a21f43c-1a49-4401-afd4-306170f5a30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:23.596679 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21f43c-1a49-4401-afd4-306170f5a30f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:23.601747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e63b8-9065-4dd2-a02d-cf49e09eec2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:23.602634 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e63b8-9065-4dd2-a02d-cf49e09eec2b service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:23.603178 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e63b8-9065-4dd2-a02d-cf49e09eec2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:23.603705 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e63b8-9065-4dd2-a02d-cf49e09eec2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:23.617770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e63b8-9065-4dd2-a02d-cf49e09eec2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:23.623565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e63b8-9065-4dd2-a02d-cf49e09eec2b service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:23.624872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d24cc-9199-4d42-95d9-762d25243b27 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:23.627285 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-1a2d24cc-9199-4d42-95d9-762d25243b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:23.638501 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1313/2595] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:23 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:23.661353 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e63b8-9065-4dd2-a02d-cf49e09eec2b service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:23.759936 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e63b8-9065-4dd2-a02d-cf49e09eec2b service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:23.766424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa533c0-4b13-4256-974a-f2dfec8ffaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:23.767461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa533c0-4b13-4256-974a-f2dfec8ffaf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:23.767816 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa533c0-4b13-4256-974a-f2dfec8ffaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:23.768165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa533c0-4b13-4256-974a-f2dfec8ffaf3 admin admin] PATH_INFO: `/v3/users/f589aba4419f41fd87acfb7abfc25d24` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:23.769619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa533c0-4b13-4256-974a-f2dfec8ffaf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f589aba4419f41fd87acfb7abfc25d24)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:23.772747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa533c0-4b13-4256-974a-f2dfec8ffaf3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:23.828969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d24cc-9199-4d42-95d9-762d25243b27 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:23.835076 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa218bb5-406c-4b25-a16f-764182e47a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:23.837259 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa218bb5-406c-4b25-a16f-764182e47a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:23.837759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa218bb5-406c-4b25-a16f-764182e47a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:23.838188 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa218bb5-406c-4b25-a16f-764182e47a96 admin admin] PATH_INFO: `/v3/projects/cb12466fd2b64169b67ec2668f5c4a63` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:23.839988 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa218bb5-406c-4b25-a16f-764182e47a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb12466fd2b64169b67ec2668f5c4a63)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:23.844973 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa218bb5-406c-4b25-a16f-764182e47a96 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:23.866628 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6aa533c0-4b13-4256-974a-f2dfec8ffaf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f589aba4419f41fd87acfb7abfc25d24'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:23.872167 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:23.908038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6aa533c0-4b13-4256-974a-f2dfec8ffaf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f589aba4419f41fd87acfb7abfc25d24'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:23.925966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-fa218bb5-406c-4b25-a16f-764182e47a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb12466fd2b64169b67ec2668f5c4a63', 'request_id': 'req-fa218bb5-406c-4b25-a16f-764182e47a96'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:23.926299 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6aa533c0-4b13-4256-974a-f2dfec8ffaf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f589aba4419f41fd87acfb7abfc25d24'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:23.927159 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6aa533c0-4b13-4256-974a-f2dfec8ffaf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f589aba4419f41fd87acfb7abfc25d24'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:23.938709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-fa218bb5-406c-4b25-a16f-764182e47a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb12466fd2b64169b67ec2668f5c4a63', 'request_id': 'req-fa218bb5-406c-4b25-a16f-764182e47a96'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:23.945997 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6aa533c0-4b13-4256-974a-f2dfec8ffaf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f589aba4419f41fd87acfb7abfc25d24'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:23.949769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-fa218bb5-406c-4b25-a16f-764182e47a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb12466fd2b64169b67ec2668f5c4a63', 'request_id': 'req-fa218bb5-406c-4b25-a16f-764182e47a96'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:23.961287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1314/2596] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:23 2022] DELETE /identity/v3/users/f589aba4419f41fd87acfb7abfc25d24 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:23.963337 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006e61a-70c0-4b60-83e3-e20821a1b17c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:23.963700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006e61a-70c0-4b60-83e3-e20821a1b17c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:23.964370 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006e61a-70c0-4b60-83e3-e20821a1b17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:23.974026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-fa218bb5-406c-4b25-a16f-764182e47a96 admin admin] The token cache is being invalidate because project cb12466fd2b64169b67ec2668f5c4a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:23.974574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-fa218bb5-406c-4b25-a16f-764182e47a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:23.975492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-fa218bb5-406c-4b25-a16f-764182e47a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:23.979373 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1283/2597] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:23 2022] DELETE /identity/v3/projects/cb12466fd2b64169b67ec2668f5c4a63 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:36:23.985260 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd29b65-a949-4025-8efc-b7afd0efd17c None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:23.985625 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd29b65-a949-4025-8efc-b7afd0efd17c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:23.985998 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd29b65-a949-4025-8efc-b7afd0efd17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:24.009030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a006e61a-70c0-4b60-83e3-e20821a1b17c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:24.010408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a006e61a-70c0-4b60-83e3-e20821a1b17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:24.027199 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-2fd29b65-a949-4025-8efc-b7afd0efd17c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:24.031216 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2fd29b65-a949-4025-8efc-b7afd0efd17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:24.139385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1315/2598] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:24.149543 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1284/2599] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:24.161938 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80313cba-51a2-4243-a3ec-b51b82ce51ef None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:24.164308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80313cba-51a2-4243-a3ec-b51b82ce51ef None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:24.167468 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80313cba-51a2-4243-a3ec-b51b82ce51ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:24.169362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd29b65-a949-4025-8efc-b7afd0efd17c None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:24.181094 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2fd29b65-a949-4025-8efc-b7afd0efd17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:24.205625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-80313cba-51a2-4243-a3ec-b51b82ce51ef None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:24.207187 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-80313cba-51a2-4243-a3ec-b51b82ce51ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:24.216561 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1316/2600] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:24.225622 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80313cba-51a2-4243-a3ec-b51b82ce51ef None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:24.226206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:24.242354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80313cba-51a2-4243-a3ec-b51b82ce51ef None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:24.248148 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a4b5a-4914-4eea-a95f-cca0c803b63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:24.249420 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a4b5a-4914-4eea-a95f-cca0c803b63a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:24.249850 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a4b5a-4914-4eea-a95f-cca0c803b63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:24.250289 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a4b5a-4914-4eea-a95f-cca0c803b63a admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:24.251180 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a4b5a-4914-4eea-a95f-cca0c803b63a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:36:24.251777 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a4b5a-4914-4eea-a95f-cca0c803b63a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:24.254520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a4b5a-4914-4eea-a95f-cca0c803b63a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:24.270255 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1317/2601] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:36:24.279854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a4b5a-4914-4eea-a95f-cca0c803b63a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:24.292315 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a4b5a-4914-4eea-a95f-cca0c803b63a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:24.300951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6114270-5538-4dff-bb07-2488c717d91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:24.301688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6114270-5538-4dff-bb07-2488c717d91f admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:24.301975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6114270-5538-4dff-bb07-2488c717d91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:24.302252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6114270-5538-4dff-bb07-2488c717d91f admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:24.302947 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6114270-5538-4dff-bb07-2488c717d91f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:24.304901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6114270-5538-4dff-bb07-2488c717d91f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:24.331604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd29b65-a949-4025-8efc-b7afd0efd17c None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:24.343545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc0df7-4edc-4f7e-b8b7-3f1b4cdd0348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:24.344372 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc0df7-4edc-4f7e-b8b7-3f1b4cdd0348 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:24.344753 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc0df7-4edc-4f7e-b8b7-3f1b4cdd0348 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:24.345642 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc0df7-4edc-4f7e-b8b7-3f1b4cdd0348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:24.367136 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc0df7-4edc-4f7e-b8b7-3f1b4cdd0348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:24.370231 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1318/2602] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:36:24 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:24.374453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6114270-5538-4dff-bb07-2488c717d91f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:24.374696 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc0df7-4edc-4f7e-b8b7-3f1b4cdd0348 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:24.401528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1285/2603] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:36:24.458461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6114270-5538-4dff-bb07-2488c717d91f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:24.465102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33886b74-520d-418d-94ae-5c4c443a573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:24.466284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33886b74-520d-418d-94ae-5c4c443a573f admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:24.466713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33886b74-520d-418d-94ae-5c4c443a573f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:24.467259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33886b74-520d-418d-94ae-5c4c443a573f admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:24.468243 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33886b74-520d-418d-94ae-5c4c443a573f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:24.470888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33886b74-520d-418d-94ae-5c4c443a573f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:24.523597 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1319/2604] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:36:24 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:24.525181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc0df7-4edc-4f7e-b8b7-3f1b4cdd0348 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:24.536161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc0df7-4edc-4f7e-b8b7-3f1b4cdd0348 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:24.545943 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1aac8-2867-40f9-bbfa-dcb760acfeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:24.546887 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1aac8-2867-40f9-bbfa-dcb760acfeaa admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:24.547376 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1aac8-2867-40f9-bbfa-dcb760acfeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:24.547880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1aac8-2867-40f9-bbfa-dcb760acfeaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:24.548850 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1aac8-2867-40f9-bbfa-dcb760acfeaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:24.550787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1aac8-2867-40f9-bbfa-dcb760acfeaa admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:24.571832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33886b74-520d-418d-94ae-5c4c443a573f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:24.578920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1286/2605] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:24.583937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33886b74-520d-418d-94ae-5c4c443a573f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:24.590104 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18813c01-2a40-4d39-9aec-25b567b6f917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:24.591095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18813c01-2a40-4d39-9aec-25b567b6f917 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:24.591606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18813c01-2a40-4d39-9aec-25b567b6f917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:24.592111 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18813c01-2a40-4d39-9aec-25b567b6f917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:24.593242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18813c01-2a40-4d39-9aec-25b567b6f917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:24.595074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18813c01-2a40-4d39-9aec-25b567b6f917 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:24.622186 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1aac8-2867-40f9-bbfa-dcb760acfeaa admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:24.629253 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1320/2606] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:24.635897 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1aac8-2867-40f9-bbfa-dcb760acfeaa admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:24.657430 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53e537-6ac7-4c06-a6e5-fc26756d0943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:24.658196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18813c01-2a40-4d39-9aec-25b567b6f917 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:24.661170 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-18813c01-2a40-4d39-9aec-25b567b6f917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:24.662301 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53e537-6ac7-4c06-a6e5-fc26756d0943 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:24.662723 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53e537-6ac7-4c06-a6e5-fc26756d0943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:24.663110 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53e537-6ac7-4c06-a6e5-fc26756d0943 admin admin] PATH_INFO: `/v3/projects/b7beece548eb4153a611ca9bc1e817ce/users/a0ad750d4ccd49c5a71425951d9d2360/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:24.671514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:24.704959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53e537-6ac7-4c06-a6e5-fc26756d0943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7beece548eb4153a611ca9bc1e817ce, user_id=a0ad750d4ccd49c5a71425951d9d2360, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:24.713062 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53e537-6ac7-4c06-a6e5-fc26756d0943 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:24.766498 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1287/2607] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:24 2022] PUT /identity/v3/projects/b7beece548eb4153a611ca9bc1e817ce/users/a0ad750d4ccd49c5a71425951d9d2360/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:24.769119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d457a85-717e-4da2-a919-5ee162d03b30 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:24.769417 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d457a85-717e-4da2-a919-5ee162d03b30 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:24.769925 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d457a85-717e-4da2-a919-5ee162d03b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:24.805253 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-8d457a85-717e-4da2-a919-5ee162d03b30 None None] MFA Rules not processed for user `a0ad750d4ccd49c5a71425951d9d2360`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:24.806542 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8d457a85-717e-4da2-a919-5ee162d03b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:24.810081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18813c01-2a40-4d39-9aec-25b567b6f917 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:24.937953 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1288/2608] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:24.939171 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d457a85-717e-4da2-a919-5ee162d03b30 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:24.947181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8d457a85-717e-4da2-a919-5ee162d03b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:25.021446 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d457a85-717e-4da2-a919-5ee162d03b30 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:25.031134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54417ac0-3e7b-4d44-86a4-2dcf5139dc45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:25.032048 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54417ac0-3e7b-4d44-86a4-2dcf5139dc45 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:25.032507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54417ac0-3e7b-4d44-86a4-2dcf5139dc45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:25.033033 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54417ac0-3e7b-4d44-86a4-2dcf5139dc45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:25.038512 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1b105-a4ab-48a4-bad4-7f50792c1d18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:25.039185 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1b105-a4ab-48a4-bad4-7f50792c1d18 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:25.039470 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1b105-a4ab-48a4-bad4-7f50792c1d18 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:25.040963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1b105-a4ab-48a4-bad4-7f50792c1d18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:25.044424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dea1b105-a4ab-48a4-bad4-7f50792c1d18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:25.045699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54417ac0-3e7b-4d44-86a4-2dcf5139dc45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:25.047350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54417ac0-3e7b-4d44-86a4-2dcf5139dc45 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:25.067902 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1289/2609] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:25.080164 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1b105-a4ab-48a4-bad4-7f50792c1d18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:25.082431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1b105-a4ab-48a4-bad4-7f50792c1d18 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:25.094640 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54417ac0-3e7b-4d44-86a4-2dcf5139dc45 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:25.114202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1321/2610] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:25.141436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1b105-a4ab-48a4-bad4-7f50792c1d18 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:25.142995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dea1b105-a4ab-48a4-bad4-7f50792c1d18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:25.167532 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:25.270042 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1b105-a4ab-48a4-bad4-7f50792c1d18 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:25.281605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f93cc9-4f0f-49f9-865d-1cf72afb9157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:25.283302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f93cc9-4f0f-49f9-865d-1cf72afb9157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:25.284759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f93cc9-4f0f-49f9-865d-1cf72afb9157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:25.285393 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f93cc9-4f0f-49f9-865d-1cf72afb9157 admin admin] PATH_INFO: `/v3/projects/da7aed20356447eeb206dc95a63529bc` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:25.288872 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f93cc9-4f0f-49f9-865d-1cf72afb9157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da7aed20356447eeb206dc95a63529bc)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:25.294359 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f93cc9-4f0f-49f9-865d-1cf72afb9157 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:25.307961 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54417ac0-3e7b-4d44-86a4-2dcf5139dc45 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:25.320425 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1b4da-c0ed-4ca5-8803-041c20a5847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:25.321621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1b4da-c0ed-4ca5-8803-041c20a5847a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:25.322005 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1b4da-c0ed-4ca5-8803-041c20a5847a admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:25.322434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1b4da-c0ed-4ca5-8803-041c20a5847a admin admin] PATH_INFO: `/v3/users/a0ad750d4ccd49c5a71425951d9d2360` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:25.323820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1b4da-c0ed-4ca5-8803-041c20a5847a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ad750d4ccd49c5a71425951d9d2360)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:25.326387 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1b4da-c0ed-4ca5-8803-041c20a5847a admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:25.371703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:25.398391 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a1f93cc9-4f0f-49f9-865d-1cf72afb9157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da7aed20356447eeb206dc95a63529bc', 'request_id': 'req-a1f93cc9-4f0f-49f9-865d-1cf72afb9157'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:25.407048 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a1f93cc9-4f0f-49f9-865d-1cf72afb9157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da7aed20356447eeb206dc95a63529bc', 'request_id': 'req-a1f93cc9-4f0f-49f9-865d-1cf72afb9157'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:25.414195 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a8b1b4da-c0ed-4ca5-8803-041c20a5847a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ad750d4ccd49c5a71425951d9d2360'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:25.429917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a1f93cc9-4f0f-49f9-865d-1cf72afb9157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da7aed20356447eeb206dc95a63529bc', 'request_id': 'req-a1f93cc9-4f0f-49f9-865d-1cf72afb9157'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:25.431164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a8b1b4da-c0ed-4ca5-8803-041c20a5847a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ad750d4ccd49c5a71425951d9d2360'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:25.431987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a8b1b4da-c0ed-4ca5-8803-041c20a5847a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ad750d4ccd49c5a71425951d9d2360'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:25.447929 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a8b1b4da-c0ed-4ca5-8803-041c20a5847a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ad750d4ccd49c5a71425951d9d2360'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:25.458703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a1f93cc9-4f0f-49f9-865d-1cf72afb9157 admin admin] The token cache is being invalidate because project da7aed20356447eeb206dc95a63529bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:25.459365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a1f93cc9-4f0f-49f9-865d-1cf72afb9157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:25.460502 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a1f93cc9-4f0f-49f9-865d-1cf72afb9157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:25.461799 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a8b1b4da-c0ed-4ca5-8803-041c20a5847a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ad750d4ccd49c5a71425951d9d2360'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:25.463220 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1322/2611] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:25 2022] DELETE /identity/v3/projects/da7aed20356447eeb206dc95a63529bc => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:25.470226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20de2-819a-4cee-8d8b-0ba4ee408387 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:25.470804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20de2-819a-4cee-8d8b-0ba4ee408387 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:25.471499 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20de2-819a-4cee-8d8b-0ba4ee408387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:25.472320 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1290/2612] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:25 2022] DELETE /identity/v3/users/a0ad750d4ccd49c5a71425951d9d2360 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:25.476312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0713f0-b371-4802-b3fb-9ec4e66abf36 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:25.476729 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0713f0-b371-4802-b3fb-9ec4e66abf36 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:25.477143 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0713f0-b371-4802-b3fb-9ec4e66abf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:25.508022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-42c20de2-819a-4cee-8d8b-0ba4ee408387 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:25.509437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-42c20de2-819a-4cee-8d8b-0ba4ee408387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:25.514975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-4f0713f0-b371-4802-b3fb-9ec4e66abf36 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:25.516237 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4f0713f0-b371-4802-b3fb-9ec4e66abf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:25.589439 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1291/2613] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:36:25.600493 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0713f0-b371-4802-b3fb-9ec4e66abf36 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:25.606299 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4f0713f0-b371-4802-b3fb-9ec4e66abf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:25.619084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1323/2614] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:36:25.627115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc97e1-035b-47ee-9e95-62720effad7c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:25.629204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc97e1-035b-47ee-9e95-62720effad7c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:25.629933 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc97e1-035b-47ee-9e95-62720effad7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:25.673480 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f2bc97e1-035b-47ee-9e95-62720effad7c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:25.674868 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f2bc97e1-035b-47ee-9e95-62720effad7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:25.678050 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:25.689681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1324/2615] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:25.693722 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc97e1-035b-47ee-9e95-62720effad7c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:25.704427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc97e1-035b-47ee-9e95-62720effad7c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:25.711167 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68717d1f-f2e0-436c-a65a-8c61a21ce4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:25.712077 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68717d1f-f2e0-436c-a65a-8c61a21ce4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:25.712514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68717d1f-f2e0-436c-a65a-8c61a21ce4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:25.713025 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68717d1f-f2e0-436c-a65a-8c61a21ce4a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:25.713921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68717d1f-f2e0-436c-a65a-8c61a21ce4a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:36:25.714411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68717d1f-f2e0-436c-a65a-8c61a21ce4a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:25.716184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68717d1f-f2e0-436c-a65a-8c61a21ce4a2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:25.727152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0713f0-b371-4802-b3fb-9ec4e66abf36 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:25.741300 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978153e0-315f-4061-889a-847ad25cfcad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:25.741984 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978153e0-315f-4061-889a-847ad25cfcad service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:25.742269 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978153e0-315f-4061-889a-847ad25cfcad service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:25.742547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978153e0-315f-4061-889a-847ad25cfcad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:25.747202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1325/2616] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:36:25.748452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68717d1f-f2e0-436c-a65a-8c61a21ce4a2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:25.763760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978153e0-315f-4061-889a-847ad25cfcad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:25.766460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68717d1f-f2e0-436c-a65a-8c61a21ce4a2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:25.767914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978153e0-315f-4061-889a-847ad25cfcad service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:25.800201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201815c6-0b6d-47f9-b1af-d3aafeb00eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:25.800917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201815c6-0b6d-47f9-b1af-d3aafeb00eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:25.806266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201815c6-0b6d-47f9-b1af-d3aafeb00eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:25.806586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201815c6-0b6d-47f9-b1af-d3aafeb00eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:25.807446 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201815c6-0b6d-47f9-b1af-d3aafeb00eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:25.814669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201815c6-0b6d-47f9-b1af-d3aafeb00eb5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:25.820775 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1292/2617] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:25.865158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1326/2618] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:36:25 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:25.869030 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978153e0-315f-4061-889a-847ad25cfcad service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:25.880708 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978153e0-315f-4061-889a-847ad25cfcad service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:25.967062 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf82806-428c-43ec-b1a6-2490bc29a47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:25.967748 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf82806-428c-43ec-b1a6-2490bc29a47f admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:25.968029 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf82806-428c-43ec-b1a6-2490bc29a47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:25.968349 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf82806-428c-43ec-b1a6-2490bc29a47f admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:25.969206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf82806-428c-43ec-b1a6-2490bc29a47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:25.971106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf82806-428c-43ec-b1a6-2490bc29a47f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:25.997553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1293/2619] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:36:25 2022] POST /identity/v3/users => generated 283 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:26.000431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201815c6-0b6d-47f9-b1af-d3aafeb00eb5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:26.014804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201815c6-0b6d-47f9-b1af-d3aafeb00eb5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:26.021396 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909a68d-9fce-46a7-b6bb-d643e7b56ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:26.022143 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a68d-9fce-46a7-b6bb-d643e7b56ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:26.022427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a68d-9fce-46a7-b6bb-d643e7b56ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:26.022699 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a68d-9fce-46a7-b6bb-d643e7b56ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:26.023441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909a68d-9fce-46a7-b6bb-d643e7b56ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:26.025933 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909a68d-9fce-46a7-b6bb-d643e7b56ed6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:26.042380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1327/2620] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:26.046456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf82806-428c-43ec-b1a6-2490bc29a47f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:26.061512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf82806-428c-43ec-b1a6-2490bc29a47f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:26.068668 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df09ee7-540e-42f7-8210-0a47718d94d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:26.069663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df09ee7-540e-42f7-8210-0a47718d94d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:26.069935 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df09ee7-540e-42f7-8210-0a47718d94d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:26.070217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df09ee7-540e-42f7-8210-0a47718d94d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:26.070962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df09ee7-540e-42f7-8210-0a47718d94d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:26.072574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df09ee7-540e-42f7-8210-0a47718d94d0 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:26.087738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1294/2621] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:26.092208 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909a68d-9fce-46a7-b6bb-d643e7b56ed6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:26.103279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909a68d-9fce-46a7-b6bb-d643e7b56ed6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:26.113956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ea4e2-4a15-467a-ac91-c0be97443527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:26.115500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ea4e2-4a15-467a-ac91-c0be97443527 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:26.115791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ea4e2-4a15-467a-ac91-c0be97443527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:26.116072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ea4e2-4a15-467a-ac91-c0be97443527 admin admin] PATH_INFO: `/v3/projects/8b967ede448e45919bc48fdc2cce7d0b/users/b96eb3eb171c4445b98468d4cd1e611a/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:26.148154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ea4e2-4a15-467a-ac91-c0be97443527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b967ede448e45919bc48fdc2cce7d0b, user_id=b96eb3eb171c4445b98468d4cd1e611a, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:26.150878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ea4e2-4a15-467a-ac91-c0be97443527 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:26.176963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1328/2622] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:26 2022] PUT /identity/v3/projects/8b967ede448e45919bc48fdc2cce7d0b/users/b96eb3eb171c4445b98468d4cd1e611a/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:26.181176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75315338-b37f-4bee-a3fd-bd29ac10ec9e None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:26.181474 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75315338-b37f-4bee-a3fd-bd29ac10ec9e None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:26.181752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75315338-b37f-4bee-a3fd-bd29ac10ec9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:26.212705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-75315338-b37f-4bee-a3fd-bd29ac10ec9e None None] MFA Rules not processed for user `b96eb3eb171c4445b98468d4cd1e611a`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:26.213983 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-75315338-b37f-4bee-a3fd-bd29ac10ec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:26.237537 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ea4e2-4a15-467a-ac91-c0be97443527 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:26.240118 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a04ea4e2-4a15-467a-ac91-c0be97443527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:26.307555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:26.333781 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ea4e2-4a15-467a-ac91-c0be97443527 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:26.339582 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:26.340566 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:26.340693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1295/2623] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:26.340862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:26.341143 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78 admin admin] PATH_INFO: `/v3/projects/b7beece548eb4153a611ca9bc1e817ce` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:26.345723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7beece548eb4153a611ca9bc1e817ce)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:26.347775 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:26.351860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75315338-b37f-4bee-a3fd-bd29ac10ec9e None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:26.353838 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-75315338-b37f-4bee-a3fd-bd29ac10ec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:26.417455 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7beece548eb4153a611ca9bc1e817ce', 'request_id': 'req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:26.419292 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:26.425632 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75315338-b37f-4bee-a3fd-bd29ac10ec9e None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:26.426739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7beece548eb4153a611ca9bc1e817ce', 'request_id': 'req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:26.435524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7beece548eb4153a611ca9bc1e817ce', 'request_id': 'req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:26.454749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78 admin admin] The token cache is being invalidate because project b7beece548eb4153a611ca9bc1e817ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:26.455166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:26.455988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:26.460952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1329/2624] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:26 2022] DELETE /identity/v3/projects/b7beece548eb4153a611ca9bc1e817ce => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:36:26.460952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:26.460952 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:26.505485 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938083b-b681-4559-a38f-19157546ae5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:26.507093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938083b-b681-4559-a38f-19157546ae5d service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:26.507537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938083b-b681-4559-a38f-19157546ae5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:26.508032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938083b-b681-4559-a38f-19157546ae5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:26.510745 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-5938083b-b681-4559-a38f-19157546ae5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:26.556601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826632a-6f7c-4c6b-89dc-ecdc405f2d78 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:26.562883 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4938713-9d1a-4a5c-9a8b-d1981a0b00e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:26.563537 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4938713-9d1a-4a5c-9a8b-d1981a0b00e7 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:26.563817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4938713-9d1a-4a5c-9a8b-d1981a0b00e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:26.564090 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4938713-9d1a-4a5c-9a8b-d1981a0b00e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:26.566623 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b4938713-9d1a-4a5c-9a8b-d1981a0b00e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:26.600075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938083b-b681-4559-a38f-19157546ae5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:26.602571 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938083b-b681-4559-a38f-19157546ae5d service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:26.615264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1296/2625] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:36:26.617383 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479574da-c383-4daa-810b-1d51091b06fe None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:26.618043 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479574da-c383-4daa-810b-1d51091b06fe None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:26.618678 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479574da-c383-4daa-810b-1d51091b06fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:26.642044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-479574da-c383-4daa-810b-1d51091b06fe None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:26.647986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-479574da-c383-4daa-810b-1d51091b06fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:26.669487 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4938713-9d1a-4a5c-9a8b-d1981a0b00e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:26.671252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4938713-9d1a-4a5c-9a8b-d1981a0b00e7 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:26.683140 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1330/2626] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:26.763491 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1297/2627] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:26.771925 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77e271-90f4-4b58-af94-7b7f682751e6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:26.772319 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77e271-90f4-4b58-af94-7b7f682751e6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:26.772835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77e271-90f4-4b58-af94-7b7f682751e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:26.795970 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:26.806910 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ac77e271-90f4-4b58-af94-7b7f682751e6 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:26.808313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ac77e271-90f4-4b58-af94-7b7f682751e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:26.838509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1331/2628] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:26.839930 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479574da-c383-4daa-810b-1d51091b06fe None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:26.852558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479574da-c383-4daa-810b-1d51091b06fe None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:26.865893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0d4d5-898f-4dba-b7f0-c329b215d287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:26.867394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0d4d5-898f-4dba-b7f0-c329b215d287 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:26.868398 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0d4d5-898f-4dba-b7f0-c329b215d287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:26.868907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0d4d5-898f-4dba-b7f0-c329b215d287 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:26.870239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0d4d5-898f-4dba-b7f0-c329b215d287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:36:26.870769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0d4d5-898f-4dba-b7f0-c329b215d287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:26.872882 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0d4d5-898f-4dba-b7f0-c329b215d287 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:26.890201 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1298/2629] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:36:26.891276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77e271-90f4-4b58-af94-7b7f682751e6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:26.903339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77e271-90f4-4b58-af94-7b7f682751e6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:26.917544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5d71f-deb5-49e9-a768-5752099a7eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:26.918234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5d71f-deb5-49e9-a768-5752099a7eaf admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:26.918515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5d71f-deb5-49e9-a768-5752099a7eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:26.918796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5d71f-deb5-49e9-a768-5752099a7eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:26.919510 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5d71f-deb5-49e9-a768-5752099a7eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:26.925941 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5d71f-deb5-49e9-a768-5752099a7eaf admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:26.974888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1332/2630] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:36:26 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:26.979391 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0d4d5-898f-4dba-b7f0-c329b215d287 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:26.994996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0d4d5-898f-4dba-b7f0-c329b215d287 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:27.042048 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5d71f-deb5-49e9-a768-5752099a7eaf admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:27.043909 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-69d5d71f-deb5-49e9-a768-5752099a7eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:27.154509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:27.155262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5d71f-deb5-49e9-a768-5752099a7eaf admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:27.160806 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72486586-47b3-4ddf-ade9-d43b9b10acb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:27.161591 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72486586-47b3-4ddf-ade9-d43b9b10acb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:27.161939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72486586-47b3-4ddf-ade9-d43b9b10acb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:27.162289 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72486586-47b3-4ddf-ade9-d43b9b10acb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:27.164347 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-72486586-47b3-4ddf-ade9-d43b9b10acb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:27.192833 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89af0c-d513-4f4e-beff-4cf73cbda9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:27.193563 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89af0c-d513-4f4e-beff-4cf73cbda9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:27.193854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89af0c-d513-4f4e-beff-4cf73cbda9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:27.194134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89af0c-d513-4f4e-beff-4cf73cbda9a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:27.194850 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89af0c-d513-4f4e-beff-4cf73cbda9a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:27.196793 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89af0c-d513-4f4e-beff-4cf73cbda9a0 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:27.236977 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1299/2631] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:36:26 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:27.238087 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89af0c-d513-4f4e-beff-4cf73cbda9a0 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:27.260067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89af0c-d513-4f4e-beff-4cf73cbda9a0 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:27.273077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b2cc0-c8e4-4071-96b6-07a381e036ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:27.275261 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b2cc0-c8e4-4071-96b6-07a381e036ee admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:27.275648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b2cc0-c8e4-4071-96b6-07a381e036ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:27.276517 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b2cc0-c8e4-4071-96b6-07a381e036ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:27.278352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b2cc0-c8e4-4071-96b6-07a381e036ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:27.280781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b2cc0-c8e4-4071-96b6-07a381e036ee admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:27.295597 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72486586-47b3-4ddf-ade9-d43b9b10acb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:27.296746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72486586-47b3-4ddf-ade9-d43b9b10acb2 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:27.309258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1300/2632] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:27.310302 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b2cc0-c8e4-4071-96b6-07a381e036ee admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:27.325357 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b2cc0-c8e4-4071-96b6-07a381e036ee admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:27.330257 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1333/2633] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:27.333582 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a0183-684f-4b06-9ff5-176108297bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:27.334388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a0183-684f-4b06-9ff5-176108297bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:27.334825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a0183-684f-4b06-9ff5-176108297bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:27.335203 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a0183-684f-4b06-9ff5-176108297bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:27.336046 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a0183-684f-4b06-9ff5-176108297bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:27.337825 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a0183-684f-4b06-9ff5-176108297bfc admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:27.349103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1301/2634] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:27.353102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72486586-47b3-4ddf-ade9-d43b9b10acb2 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:27.363744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72486586-47b3-4ddf-ade9-d43b9b10acb2 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:27.369759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fabce-4d92-43d8-9682-d05cfdb7ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:27.371233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fabce-4d92-43d8-9682-d05cfdb7ecdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:27.371703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fabce-4d92-43d8-9682-d05cfdb7ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:27.372085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fabce-4d92-43d8-9682-d05cfdb7ecdb admin admin] PATH_INFO: `/v3/projects/922417de6de943e587eab397188c2a9e/users/95d7beab7080453d8b0ac02c06b88e65/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:27.394089 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fabce-4d92-43d8-9682-d05cfdb7ecdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=922417de6de943e587eab397188c2a9e, user_id=95d7beab7080453d8b0ac02c06b88e65, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:27.396570 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fabce-4d92-43d8-9682-d05cfdb7ecdb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:27.425955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1334/2635] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:27 2022] PUT /identity/v3/projects/922417de6de943e587eab397188c2a9e/users/95d7beab7080453d8b0ac02c06b88e65/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:36:27.438885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fdcc4-e782-4238-9ff6-d181b67ee868 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:27.439506 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fdcc4-e782-4238-9ff6-d181b67ee868 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:27.439506 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fdcc4-e782-4238-9ff6-d181b67ee868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:27.485299 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-3f2fdcc4-e782-4238-9ff6-d181b67ee868 None None] MFA Rules not processed for user `95d7beab7080453d8b0ac02c06b88e65`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:27.486811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-3f2fdcc4-e782-4238-9ff6-d181b67ee868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:27.573493 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1302/2636] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:27.585210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fabce-4d92-43d8-9682-d05cfdb7ecdb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:27.587132 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9d9fabce-4d92-43d8-9682-d05cfdb7ecdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:27.649422 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fabce-4d92-43d8-9682-d05cfdb7ecdb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:27.653586 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073c00e-84a8-40bb-8777-457dc19ba6f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:27.654243 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c00e-84a8-40bb-8777-457dc19ba6f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:27.654578 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c00e-84a8-40bb-8777-457dc19ba6f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:27.654866 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c00e-84a8-40bb-8777-457dc19ba6f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:27.667333 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073c00e-84a8-40bb-8777-457dc19ba6f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:27.668862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073c00e-84a8-40bb-8777-457dc19ba6f7 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:27.680117 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1335/2637] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:36:33.939763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fdcc4-e782-4238-9ff6-d181b67ee868 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:34.023964 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fdcc4-e782-4238-9ff6-d181b67ee868 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:34.033633 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e869298-8411-48e4-be96-2264ff56e349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:34.034896 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e869298-8411-48e4-be96-2264ff56e349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:34.035396 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e869298-8411-48e4-be96-2264ff56e349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:34.036056 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e869298-8411-48e4-be96-2264ff56e349 admin admin] PATH_INFO: `/v3/users/95d7beab7080453d8b0ac02c06b88e65` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:34.037633 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e869298-8411-48e4-be96-2264ff56e349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d7beab7080453d8b0ac02c06b88e65)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:34.040286 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e869298-8411-48e4-be96-2264ff56e349 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:34.110321 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:34.115103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-8e869298-8411-48e4-be96-2264ff56e349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d7beab7080453d8b0ac02c06b88e65'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:34.129176 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-8e869298-8411-48e4-be96-2264ff56e349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d7beab7080453d8b0ac02c06b88e65'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:34.130550 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-8e869298-8411-48e4-be96-2264ff56e349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d7beab7080453d8b0ac02c06b88e65'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:34.146790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-8e869298-8411-48e4-be96-2264ff56e349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d7beab7080453d8b0ac02c06b88e65'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:34.156221 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-8e869298-8411-48e4-be96-2264ff56e349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d7beab7080453d8b0ac02c06b88e65'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:34.167507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1303/2638] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:33 2022] DELETE /identity/v3/users/95d7beab7080453d8b0ac02c06b88e65 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:34.172796 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5f33c-6435-491f-8f17-91365ced0426 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:34.173370 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5f33c-6435-491f-8f17-91365ced0426 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:34.173751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5f33c-6435-491f-8f17-91365ced0426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:34.192341 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:34.202498 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-22b5f33c-6435-491f-8f17-91365ced0426 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:34.204482 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-22b5f33c-6435-491f-8f17-91365ced0426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:34.313185 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1336/2639] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:34.320446 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e869298-8411-48e4-be96-2264ff56e349 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:34.322104 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8e869298-8411-48e4-be96-2264ff56e349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:34.416314 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e869298-8411-48e4-be96-2264ff56e349 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:34.420394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5879623-607d-4260-9f08-cdc0ad846617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:34.421179 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5879623-607d-4260-9f08-cdc0ad846617 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:34.421492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5879623-607d-4260-9f08-cdc0ad846617 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:34.421772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5879623-607d-4260-9f08-cdc0ad846617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:34.431649 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5879623-607d-4260-9f08-cdc0ad846617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:34.433128 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5879623-607d-4260-9f08-cdc0ad846617 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:34.443550 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1304/2640] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:34.723524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5f33c-6435-491f-8f17-91365ced0426 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:34.725210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-22b5f33c-6435-491f-8f17-91365ced0426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:34.749630 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5f33c-6435-491f-8f17-91365ced0426 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:34.755755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a1182-ed72-4ab5-ae7d-cb9b1d9d3d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:34.756565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a1182-ed72-4ab5-ae7d-cb9b1d9d3d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:34.756845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a1182-ed72-4ab5-ae7d-cb9b1d9d3d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:34.757179 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a1182-ed72-4ab5-ae7d-cb9b1d9d3d64 admin admin] PATH_INFO: `/v3/projects/922417de6de943e587eab397188c2a9e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:34.758530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a1182-ed72-4ab5-ae7d-cb9b1d9d3d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=922417de6de943e587eab397188c2a9e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:34.760433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a1182-ed72-4ab5-ae7d-cb9b1d9d3d64 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:34.878046 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-743a1182-ed72-4ab5-ae7d-cb9b1d9d3d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922417de6de943e587eab397188c2a9e', 'request_id': 'req-743a1182-ed72-4ab5-ae7d-cb9b1d9d3d64'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:34.889800 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-743a1182-ed72-4ab5-ae7d-cb9b1d9d3d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922417de6de943e587eab397188c2a9e', 'request_id': 'req-743a1182-ed72-4ab5-ae7d-cb9b1d9d3d64'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:34.899865 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-743a1182-ed72-4ab5-ae7d-cb9b1d9d3d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922417de6de943e587eab397188c2a9e', 'request_id': 'req-743a1182-ed72-4ab5-ae7d-cb9b1d9d3d64'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:34.927206 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-743a1182-ed72-4ab5-ae7d-cb9b1d9d3d64 admin admin] The token cache is being invalidate because project 922417de6de943e587eab397188c2a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:34.927534 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-743a1182-ed72-4ab5-ae7d-cb9b1d9d3d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:34.928199 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-743a1182-ed72-4ab5-ae7d-cb9b1d9d3d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:34.934900 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1337/2641] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:34 2022] DELETE /identity/v3/projects/922417de6de943e587eab397188c2a9e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:34.936824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61724d72-02e1-4d38-af53-895960d87b57 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:34.937483 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61724d72-02e1-4d38-af53-895960d87b57 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:34.937970 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61724d72-02e1-4d38-af53-895960d87b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:34.959506 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-61724d72-02e1-4d38-af53-895960d87b57 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:34.962744 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-61724d72-02e1-4d38-af53-895960d87b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:35.112789 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1305/2642] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:35.184739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f7ecb-6bd3-4604-8085-853d3e24b3fb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:35.185380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f7ecb-6bd3-4604-8085-853d3e24b3fb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:35.185598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f7ecb-6bd3-4604-8085-853d3e24b3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:35.214391 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-036f7ecb-6bd3-4604-8085-853d3e24b3fb None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:35.216286 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-036f7ecb-6bd3-4604-8085-853d3e24b3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:35.228414 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1338/2643] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:35.233161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61724d72-02e1-4d38-af53-895960d87b57 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:35.247355 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61724d72-02e1-4d38-af53-895960d87b57 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:35.253613 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda67a6-77b5-4272-93f7-a6f836cc9aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:35.254306 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda67a6-77b5-4272-93f7-a6f836cc9aea admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:35.254641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda67a6-77b5-4272-93f7-a6f836cc9aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:35.254848 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda67a6-77b5-4272-93f7-a6f836cc9aea admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:35.255592 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda67a6-77b5-4272-93f7-a6f836cc9aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:36:35.255904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda67a6-77b5-4272-93f7-a6f836cc9aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:35.257562 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda67a6-77b5-4272-93f7-a6f836cc9aea admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:35.286734 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1306/2644] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:36:35.291483 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f7ecb-6bd3-4604-8085-853d3e24b3fb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:35.303683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f7ecb-6bd3-4604-8085-853d3e24b3fb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:35.310259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e9235-18bc-42ae-9780-b8c3074055fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:35.311684 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9235-18bc-42ae-9780-b8c3074055fe admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:35.312268 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9235-18bc-42ae-9780-b8c3074055fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:35.312785 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9235-18bc-42ae-9780-b8c3074055fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:35.314302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e9235-18bc-42ae-9780-b8c3074055fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:35.316900 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e9235-18bc-42ae-9780-b8c3074055fe admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:35.359595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1339/2645] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:36:35 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:36:35.363855 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda67a6-77b5-4272-93f7-a6f836cc9aea admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:35.377546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda67a6-77b5-4272-93f7-a6f836cc9aea admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:35.492486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:35.526542 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e9235-18bc-42ae-9780-b8c3074055fe admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:35.529204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-138e9235-18bc-42ae-9780-b8c3074055fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:35.538088 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa7cb6-e756-4324-9677-01d8ba786773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:35.539019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa7cb6-e756-4324-9677-01d8ba786773 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:35.539454 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa7cb6-e756-4324-9677-01d8ba786773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:35.540351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa7cb6-e756-4324-9677-01d8ba786773 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:35.541466 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa7cb6-e756-4324-9677-01d8ba786773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:35.544412 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa7cb6-e756-4324-9677-01d8ba786773 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:35.557706 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e9235-18bc-42ae-9780-b8c3074055fe admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:35.564633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363483a-369a-4b06-a59d-ef57e7e040ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:35.565581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363483a-369a-4b06-a59d-ef57e7e040ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:35.565907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363483a-369a-4b06-a59d-ef57e7e040ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:35.566264 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363483a-369a-4b06-a59d-ef57e7e040ae admin admin] PATH_INFO: `/v3/users/9d3040d82a814912a3dfeef27739b573` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:35.567415 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363483a-369a-4b06-a59d-ef57e7e040ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3040d82a814912a3dfeef27739b573)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:35.568367 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1307/2646] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:36:35 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:36:35.569440 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363483a-369a-4b06-a59d-ef57e7e040ae admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:35.579554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa7cb6-e756-4324-9677-01d8ba786773 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:35.600032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa7cb6-e756-4324-9677-01d8ba786773 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:35.617756 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3efd43-1ee3-4fad-a1a4-b44ba8faf03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:35.618981 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3efd43-1ee3-4fad-a1a4-b44ba8faf03d admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:35.619358 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3efd43-1ee3-4fad-a1a4-b44ba8faf03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:35.619700 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3efd43-1ee3-4fad-a1a4-b44ba8faf03d admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:35.620513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3efd43-1ee3-4fad-a1a4-b44ba8faf03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:35.622564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3efd43-1ee3-4fad-a1a4-b44ba8faf03d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:35.653206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1308/2647] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:36:35.657312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3efd43-1ee3-4fad-a1a4-b44ba8faf03d admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:35.660867 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4363483a-369a-4b06-a59d-ef57e7e040ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3040d82a814912a3dfeef27739b573'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:35.670949 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:35.671830 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3efd43-1ee3-4fad-a1a4-b44ba8faf03d admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:35.676548 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4363483a-369a-4b06-a59d-ef57e7e040ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3040d82a814912a3dfeef27739b573'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:35.677113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcb7a6-4a03-4b36-b430-74fcc764a807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:35.677775 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcb7a6-4a03-4b36-b430-74fcc764a807 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:35.678060 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcb7a6-4a03-4b36-b430-74fcc764a807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:35.678334 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcb7a6-4a03-4b36-b430-74fcc764a807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:35.679415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcb7a6-4a03-4b36-b430-74fcc764a807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:35.681399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcb7a6-4a03-4b36-b430-74fcc764a807 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:35.685788 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4363483a-369a-4b06-a59d-ef57e7e040ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3040d82a814912a3dfeef27739b573'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:35.686647 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4363483a-369a-4b06-a59d-ef57e7e040ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3040d82a814912a3dfeef27739b573'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:35.696431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1309/2648] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:35.700475 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcb7a6-4a03-4b36-b430-74fcc764a807 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:35.701096 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4363483a-369a-4b06-a59d-ef57e7e040ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3040d82a814912a3dfeef27739b573'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:35.709625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1340/2649] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:35 2022] DELETE /identity/v3/users/9d3040d82a814912a3dfeef27739b573 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:35.711272 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcb7a6-4a03-4b36-b430-74fcc764a807 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:35.780579 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ae3cb-751f-4f10-b05c-742fafce6911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:35.781904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ae3cb-751f-4f10-b05c-742fafce6911 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:35.781904 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ae3cb-751f-4f10-b05c-742fafce6911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:35.782345 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ae3cb-751f-4f10-b05c-742fafce6911 admin admin] PATH_INFO: `/v3/projects/604dcf476b1d42478f7d7964d302f2dc/users/de050afb84fd48d2aaab15ad7dfb819f/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:35.801168 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ae3cb-751f-4f10-b05c-742fafce6911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=604dcf476b1d42478f7d7964d302f2dc, user_id=de050afb84fd48d2aaab15ad7dfb819f, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:35.803841 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ae3cb-751f-4f10-b05c-742fafce6911 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:35.826521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1310/2650] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:35 2022] PUT /identity/v3/projects/604dcf476b1d42478f7d7964d302f2dc/users/de050afb84fd48d2aaab15ad7dfb819f/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:36:35.832630 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5c294-58ac-48bf-aba4-1a4f3e70a963 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:35.832943 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5c294-58ac-48bf-aba4-1a4f3e70a963 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:35.833240 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5c294-58ac-48bf-aba4-1a4f3e70a963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:35.853653 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8eb5c294-58ac-48bf-aba4-1a4f3e70a963 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:35.854685 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8eb5c294-58ac-48bf-aba4-1a4f3e70a963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:35.915969 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ae3cb-751f-4f10-b05c-742fafce6911 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:35.918218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4b4ae3cb-751f-4f10-b05c-742fafce6911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:35.968526 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1341/2651] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:36:35.980566 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5c294-58ac-48bf-aba4-1a4f3e70a963 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:35.982845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8eb5c294-58ac-48bf-aba4-1a4f3e70a963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:35.998488 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ae3cb-751f-4f10-b05c-742fafce6911 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:36.003987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ae949-94d8-431d-acbe-ca0d8e51e991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:36.005511 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ae949-94d8-431d-acbe-ca0d8e51e991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:36.005794 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ae949-94d8-431d-acbe-ca0d8e51e991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:36.006067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ae949-94d8-431d-acbe-ca0d8e51e991 admin admin] PATH_INFO: `/v3/projects/ef2b6916aadb417aa27ff2b30f3312df` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:36.007270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ae949-94d8-431d-acbe-ca0d8e51e991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2b6916aadb417aa27ff2b30f3312df)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:36.009245 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ae949-94d8-431d-acbe-ca0d8e51e991 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:36.063502 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:36.066516 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5c294-58ac-48bf-aba4-1a4f3e70a963 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:36.068213 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a47ae949-94d8-431d-acbe-ca0d8e51e991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2b6916aadb417aa27ff2b30f3312df', 'request_id': 'req-a47ae949-94d8-431d-acbe-ca0d8e51e991'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:36.079833 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a47ae949-94d8-431d-acbe-ca0d8e51e991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2b6916aadb417aa27ff2b30f3312df', 'request_id': 'req-a47ae949-94d8-431d-acbe-ca0d8e51e991'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:36.100097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a47ae949-94d8-431d-acbe-ca0d8e51e991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2b6916aadb417aa27ff2b30f3312df', 'request_id': 'req-a47ae949-94d8-431d-acbe-ca0d8e51e991'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:36.114270 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a47ae949-94d8-431d-acbe-ca0d8e51e991 admin admin] The token cache is being invalidate because project ef2b6916aadb417aa27ff2b30f3312df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:36.114822 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a47ae949-94d8-431d-acbe-ca0d8e51e991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:36.116144 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-a47ae949-94d8-431d-acbe-ca0d8e51e991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:36.118081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1311/2652] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:35 2022] DELETE /identity/v3/projects/ef2b6916aadb417aa27ff2b30f3312df => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:36:36.122517 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ae949-94d8-431d-acbe-ca0d8e51e991 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:36.124289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a47ae949-94d8-431d-acbe-ca0d8e51e991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:36.147583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f474f-f510-45e1-aafb-cd159072c1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:36.148247 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f474f-f510-45e1-aafb-cd159072c1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:36.148575 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f474f-f510-45e1-aafb-cd159072c1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:36.149023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f474f-f510-45e1-aafb-cd159072c1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:36.150900 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e69f474f-f510-45e1-aafb-cd159072c1b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:36.200760 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:36.207859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ae949-94d8-431d-acbe-ca0d8e51e991 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:36.213691 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b658bd9-9f3c-4ca5-9ebd-dc514df1c293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:36.214693 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b658bd9-9f3c-4ca5-9ebd-dc514df1c293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:36.215069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b658bd9-9f3c-4ca5-9ebd-dc514df1c293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:36.215458 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b658bd9-9f3c-4ca5-9ebd-dc514df1c293 admin admin] PATH_INFO: `/v3/users/5dacdcd8e2b047ed91c906ef86428925` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:36.216736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b658bd9-9f3c-4ca5-9ebd-dc514df1c293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dacdcd8e2b047ed91c906ef86428925)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:36.218843 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b658bd9-9f3c-4ca5-9ebd-dc514df1c293 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:36.221333 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f474f-f510-45e1-aafb-cd159072c1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:36.222814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f474f-f510-45e1-aafb-cd159072c1b6 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:36.233611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1342/2653] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:36.273720 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4b658bd9-9f3c-4ca5-9ebd-dc514df1c293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dacdcd8e2b047ed91c906ef86428925'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:36.281759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4b658bd9-9f3c-4ca5-9ebd-dc514df1c293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dacdcd8e2b047ed91c906ef86428925'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:36.282460 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4b658bd9-9f3c-4ca5-9ebd-dc514df1c293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dacdcd8e2b047ed91c906ef86428925'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:36.297093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4b658bd9-9f3c-4ca5-9ebd-dc514df1c293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dacdcd8e2b047ed91c906ef86428925'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:36.305752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4b658bd9-9f3c-4ca5-9ebd-dc514df1c293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dacdcd8e2b047ed91c906ef86428925'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:36.312599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1312/2654] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:36 2022] DELETE /identity/v3/users/5dacdcd8e2b047ed91c906ef86428925 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:36:36.529743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f474f-f510-45e1-aafb-cd159072c1b6 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:36.541232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f474f-f510-45e1-aafb-cd159072c1b6 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:36.621888 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d2262-0125-4eab-acfd-fa2675a27982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:36.622772 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d2262-0125-4eab-acfd-fa2675a27982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:36.623040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d2262-0125-4eab-acfd-fa2675a27982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:36.623309 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d2262-0125-4eab-acfd-fa2675a27982 admin admin] PATH_INFO: `/v3/projects/7a16c67c0b9148d282e562f1a66f23b5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:36.624511 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d2262-0125-4eab-acfd-fa2675a27982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a16c67c0b9148d282e562f1a66f23b5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:36.626971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d2262-0125-4eab-acfd-fa2675a27982 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:36.694582 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-344d2262-0125-4eab-acfd-fa2675a27982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a16c67c0b9148d282e562f1a66f23b5', 'request_id': 'req-344d2262-0125-4eab-acfd-fa2675a27982'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:36.701203 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-344d2262-0125-4eab-acfd-fa2675a27982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a16c67c0b9148d282e562f1a66f23b5', 'request_id': 'req-344d2262-0125-4eab-acfd-fa2675a27982'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:36.707419 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-344d2262-0125-4eab-acfd-fa2675a27982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a16c67c0b9148d282e562f1a66f23b5', 'request_id': 'req-344d2262-0125-4eab-acfd-fa2675a27982'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:36.735611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-344d2262-0125-4eab-acfd-fa2675a27982 admin admin] The token cache is being invalidate because project 7a16c67c0b9148d282e562f1a66f23b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:36.735851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-344d2262-0125-4eab-acfd-fa2675a27982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:36.740057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-344d2262-0125-4eab-acfd-fa2675a27982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:36.740057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1343/2655] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:36 2022] DELETE /identity/v3/projects/7a16c67c0b9148d282e562f1a66f23b5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:37.047763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b658bd9-9f3c-4ca5-9ebd-dc514df1c293 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:37.049282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4b658bd9-9f3c-4ca5-9ebd-dc514df1c293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:37.118350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4075a-b912-46df-bac0-37fc68d245da None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:37.118722 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4075a-b912-46df-bac0-37fc68d245da None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:37.119115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4075a-b912-46df-bac0-37fc68d245da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:37.137914 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b658bd9-9f3c-4ca5-9ebd-dc514df1c293 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:37.145565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:37.159284 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-60d4075a-b912-46df-bac0-37fc68d245da None None] MFA Rules not processed for user `de050afb84fd48d2aaab15ad7dfb819f`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:37.160612 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-60d4075a-b912-46df-bac0-37fc68d245da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:37.216784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10296b27-d37a-4631-9f52-f29e0fc77852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:37.217452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10296b27-d37a-4631-9f52-f29e0fc77852 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:37.218318 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10296b27-d37a-4631-9f52-f29e0fc77852 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:37.219072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10296b27-d37a-4631-9f52-f29e0fc77852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:37.221031 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-10296b27-d37a-4631-9f52-f29e0fc77852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:37.233794 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10296b27-d37a-4631-9f52-f29e0fc77852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:37.235945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10296b27-d37a-4631-9f52-f29e0fc77852 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:37.248063 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1313/2656] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:37.274961 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:37.290451 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1344/2657] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:36:37.297463 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10296b27-d37a-4631-9f52-f29e0fc77852 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:37.299996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-10296b27-d37a-4631-9f52-f29e0fc77852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:37.397623 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10296b27-d37a-4631-9f52-f29e0fc77852 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:37.401983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41be24-d1f3-4020-9397-dbe752c30814 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:37.402269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41be24-d1f3-4020-9397-dbe752c30814 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:37.402426 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57498c7d-1694-4a1d-bca8-099fe45c93f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:37.402556 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41be24-d1f3-4020-9397-dbe752c30814 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:37.403521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57498c7d-1694-4a1d-bca8-099fe45c93f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:37.403874 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57498c7d-1694-4a1d-bca8-099fe45c93f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:37.404216 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57498c7d-1694-4a1d-bca8-099fe45c93f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:37.404453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1345/2658] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jul 21 22:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 22:36:37.408944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482186b-f83f-45e3-ab90-8fb81086e1e3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:37.409598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482186b-f83f-45e3-ab90-8fb81086e1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:37.409966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482186b-f83f-45e3-ab90-8fb81086e1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:37.415554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57498c7d-1694-4a1d-bca8-099fe45c93f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:37.417883 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57498c7d-1694-4a1d-bca8-099fe45c93f3 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:37.429402 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b482186b-f83f-45e3-ab90-8fb81086e1e3 None None] MFA Rules not processed for user `2c04dc3ee4484afaab388cbb306974af`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:37.429789 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1314/2659] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:37.430849 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b482186b-f83f-45e3-ab90-8fb81086e1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:37.547554 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1346/2660] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jul 21 22:36:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:36:37.560492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57498c7d-1694-4a1d-bca8-099fe45c93f3 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:37.562085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-57498c7d-1694-4a1d-bca8-099fe45c93f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:37.633598 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57498c7d-1694-4a1d-bca8-099fe45c93f3 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:37.637219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05a568-ac51-4af2-9ea3-0e221e3cb885 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefb0fe4d09b451a861510508bb9cf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:37.637873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05a568-ac51-4af2-9ea3-0e221e3cb885 service glance] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:37.638183 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05a568-ac51-4af2-9ea3-0e221e3cb885 service glance] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:37.638434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05a568-ac51-4af2-9ea3-0e221e3cb885 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:37.648979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05a568-ac51-4af2-9ea3-0e221e3cb885 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:37.650406 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05a568-ac51-4af2-9ea3-0e221e3cb885 service glance] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:37.661519 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1315/2661] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:37.863783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482186b-f83f-45e3-ab90-8fb81086e1e3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:37.865208 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b482186b-f83f-45e3-ab90-8fb81086e1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:37.932334 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482186b-f83f-45e3-ab90-8fb81086e1e3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:37.937166 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e108f1-d937-490d-9db7-a4505585f169 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba75bf6ef954eb59d8db1efa6c73d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:37.937803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e108f1-d937-490d-9db7-a4505585f169 service placement] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:37.938084 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e108f1-d937-490d-9db7-a4505585f169 service placement] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:37.938359 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e108f1-d937-490d-9db7-a4505585f169 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:37.940596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-57e108f1-d937-490d-9db7-a4505585f169 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:37.952414 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e108f1-d937-490d-9db7-a4505585f169 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:37.954015 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e108f1-d937-490d-9db7-a4505585f169 service placement] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:37.964636 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1347/2662] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:38.834085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40509e-a376-4442-8698-2f1f23d97268 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:38.834719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40509e-a376-4442-8698-2f1f23d97268 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:38.834719 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40509e-a376-4442-8698-2f1f23d97268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:38.855829 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-dd40509e-a376-4442-8698-2f1f23d97268 None None] MFA Rules not processed for user `de050afb84fd48d2aaab15ad7dfb819f`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:38.857156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-dd40509e-a376-4442-8698-2f1f23d97268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:38.864783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1316/2663] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:39.452499 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e108f1-d937-490d-9db7-a4505585f169 service placement] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:39.453942 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-57e108f1-d937-490d-9db7-a4505585f169 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:39.465805 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e108f1-d937-490d-9db7-a4505585f169 service placement] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:39.469478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469a020-242d-42b1-ab71-f0daa025bf7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:39.470123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469a020-242d-42b1-ab71-f0daa025bf7e service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:39.470404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469a020-242d-42b1-ab71-f0daa025bf7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:39.470676 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469a020-242d-42b1-ab71-f0daa025bf7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:39.472485 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6469a020-242d-42b1-ab71-f0daa025bf7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:39.482474 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469a020-242d-42b1-ab71-f0daa025bf7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:39.483920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469a020-242d-42b1-ab71-f0daa025bf7e service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:39.494726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1348/2664] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:40.396772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b4c28-6825-41f4-a7f9-ffde529f1be5 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:40.397624 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b4c28-6825-41f4-a7f9-ffde529f1be5 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:40.398075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b4c28-6825-41f4-a7f9-ffde529f1be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:40.416323 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-a17b4c28-6825-41f4-a7f9-ffde529f1be5 None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:40.417576 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a17b4c28-6825-41f4-a7f9-ffde529f1be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:40.472643 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:40.483947 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1317/2665] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jul 21 22:36:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:40.499024 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469a020-242d-42b1-ab71-f0daa025bf7e service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:40.500535 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6469a020-242d-42b1-ab71-f0daa025bf7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:40.583707 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469a020-242d-42b1-ab71-f0daa025bf7e service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:40.589372 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b5178-e39a-4504-8f03-fa4040351e0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:40.590090 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b5178-e39a-4504-8f03-fa4040351e0b service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:40.590379 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b5178-e39a-4504-8f03-fa4040351e0b service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:40.590662 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b5178-e39a-4504-8f03-fa4040351e0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:40.600450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b5178-e39a-4504-8f03-fa4040351e0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:40.602013 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b5178-e39a-4504-8f03-fa4040351e0b service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:40.605839 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:40.613266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1349/2666] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:36:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:36:50.477109 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:50.612877 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:55.539680 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50625eb1-9e08-4f1c-aff9-2a3d6e20941f None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:55.540196 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50625eb1-9e08-4f1c-aff9-2a3d6e20941f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:55.540298 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50625eb1-9e08-4f1c-aff9-2a3d6e20941f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:55.558821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-50625eb1-9e08-4f1c-aff9-2a3d6e20941f None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:55.560492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-50625eb1-9e08-4f1c-aff9-2a3d6e20941f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:55.567966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1318/2667] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jul 21 22:36:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:55.582080 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b5178-e39a-4504-8f03-fa4040351e0b service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:55.593466 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b5178-e39a-4504-8f03-fa4040351e0b service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:55.599416 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede95ec-2410-4508-be71-cc8a526131b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:55.600064 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede95ec-2410-4508-be71-cc8a526131b6 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:55.600371 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede95ec-2410-4508-be71-cc8a526131b6 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:55.600649 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede95ec-2410-4508-be71-cc8a526131b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:55.611303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede95ec-2410-4508-be71-cc8a526131b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:55.612564 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede95ec-2410-4508-be71-cc8a526131b6 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:55.622151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1350/2668] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:36:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:36:58.685492 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50625eb1-9e08-4f1c-aff9-2a3d6e20941f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:58.686979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-50625eb1-9e08-4f1c-aff9-2a3d6e20941f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:58.752214 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50625eb1-9e08-4f1c-aff9-2a3d6e20941f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:58.756701 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0da7df-68e7-4310-ace5-9ebd3a3578f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:58.757608 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0da7df-68e7-4310-ace5-9ebd3a3578f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:58.757924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0da7df-68e7-4310-ace5-9ebd3a3578f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:58.758286 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0da7df-68e7-4310-ace5-9ebd3a3578f3 admin admin] PATH_INFO: `/v3/users/b96eb3eb171c4445b98468d4cd1e611a` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:58.760418 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0da7df-68e7-4310-ace5-9ebd3a3578f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96eb3eb171c4445b98468d4cd1e611a)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:58.762751 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0da7df-68e7-4310-ace5-9ebd3a3578f3 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:58.808987 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-fb0da7df-68e7-4310-ace5-9ebd3a3578f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96eb3eb171c4445b98468d4cd1e611a'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:58.816618 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-fb0da7df-68e7-4310-ace5-9ebd3a3578f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96eb3eb171c4445b98468d4cd1e611a'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:58.817320 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-fb0da7df-68e7-4310-ace5-9ebd3a3578f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96eb3eb171c4445b98468d4cd1e611a'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:58.828867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-fb0da7df-68e7-4310-ace5-9ebd3a3578f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96eb3eb171c4445b98468d4cd1e611a'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:58.835771 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-fb0da7df-68e7-4310-ace5-9ebd3a3578f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96eb3eb171c4445b98468d4cd1e611a'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:58.841688 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1319/2669] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:36:58 2022] DELETE /identity/v3/users/b96eb3eb171c4445b98468d4cd1e611a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:36:58.846449 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4ff5b-b35c-49ec-8b57-888fb9c8d21a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:58.846973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4ff5b-b35c-49ec-8b57-888fb9c8d21a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:58.847074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4ff5b-b35c-49ec-8b57-888fb9c8d21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:58.864773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6af4ff5b-b35c-49ec-8b57-888fb9c8d21a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:58.866174 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6af4ff5b-b35c-49ec-8b57-888fb9c8d21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:58.925406 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1351/2670] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:58.935669 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0da7df-68e7-4310-ace5-9ebd3a3578f3 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:58.937093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-fb0da7df-68e7-4310-ace5-9ebd3a3578f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:58.992959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0da7df-68e7-4310-ace5-9ebd3a3578f3 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:58.996605 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe702901-bcb5-4fa7-9d1f-7be7a29f950e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:58.997274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe702901-bcb5-4fa7-9d1f-7be7a29f950e service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:58.997555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe702901-bcb5-4fa7-9d1f-7be7a29f950e service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:58.997828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe702901-bcb5-4fa7-9d1f-7be7a29f950e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:59.006713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe702901-bcb5-4fa7-9d1f-7be7a29f950e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:59.008116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe702901-bcb5-4fa7-9d1f-7be7a29f950e service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:59.017300 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1320/2671] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:36:59.284938 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4ff5b-b35c-49ec-8b57-888fb9c8d21a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:59.286457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6af4ff5b-b35c-49ec-8b57-888fb9c8d21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:59.302156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4ff5b-b35c-49ec-8b57-888fb9c8d21a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:59.307773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad659850-58db-4acd-bc05-85c4dde361e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:59.308667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad659850-58db-4acd-bc05-85c4dde361e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:59.308979 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad659850-58db-4acd-bc05-85c4dde361e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:59.309380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad659850-58db-4acd-bc05-85c4dde361e3 admin admin] PATH_INFO: `/v3/projects/8b967ede448e45919bc48fdc2cce7d0b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:59.310832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad659850-58db-4acd-bc05-85c4dde361e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b967ede448e45919bc48fdc2cce7d0b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:59.313136 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad659850-58db-4acd-bc05-85c4dde361e3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:59.358739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ad659850-58db-4acd-bc05-85c4dde361e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b967ede448e45919bc48fdc2cce7d0b', 'request_id': 'req-ad659850-58db-4acd-bc05-85c4dde361e3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:59.364966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ad659850-58db-4acd-bc05-85c4dde361e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b967ede448e45919bc48fdc2cce7d0b', 'request_id': 'req-ad659850-58db-4acd-bc05-85c4dde361e3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:59.370433 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ad659850-58db-4acd-bc05-85c4dde361e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b967ede448e45919bc48fdc2cce7d0b', 'request_id': 'req-ad659850-58db-4acd-bc05-85c4dde361e3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:59.382250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ad659850-58db-4acd-bc05-85c4dde361e3 admin admin] The token cache is being invalidate because project 8b967ede448e45919bc48fdc2cce7d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:36:59.382539 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ad659850-58db-4acd-bc05-85c4dde361e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:59.383157 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ad659850-58db-4acd-bc05-85c4dde361e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:36:59.384659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1352/2672] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:36:59 2022] DELETE /identity/v3/projects/8b967ede448e45919bc48fdc2cce7d0b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:59.389525 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4428811-7f01-4af3-84b1-37d678aa8e4b None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:59.389814 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4428811-7f01-4af3-84b1-37d678aa8e4b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:59.390119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4428811-7f01-4af3-84b1-37d678aa8e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:59.414119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-f4428811-7f01-4af3-84b1-37d678aa8e4b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:59.415368 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f4428811-7f01-4af3-84b1-37d678aa8e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:59.425085 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:59.474807 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1321/2673] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:36:59.482551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b583967-341c-4a7a-9da4-5ecc24de908c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:59.482844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b583967-341c-4a7a-9da4-5ecc24de908c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:59.483123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b583967-341c-4a7a-9da4-5ecc24de908c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:59.501280 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9b583967-341c-4a7a-9da4-5ecc24de908c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:59.503073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9b583967-341c-4a7a-9da4-5ecc24de908c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:59.510956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1353/2674] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:36:59.514913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4428811-7f01-4af3-84b1-37d678aa8e4b None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:59.524288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4428811-7f01-4af3-84b1-37d678aa8e4b None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:59.529009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f6327-c677-4747-9ab4-1bcb9d1f1f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:59.529655 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f6327-c677-4747-9ab4-1bcb9d1f1f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:59.529934 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f6327-c677-4747-9ab4-1bcb9d1f1f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:59.530204 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f6327-c677-4747-9ab4-1bcb9d1f1f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:59.530920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f6327-c677-4747-9ab4-1bcb9d1f1f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:36:59.531221 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f6327-c677-4747-9ab4-1bcb9d1f1f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:59.532820 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f6327-c677-4747-9ab4-1bcb9d1f1f53 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:59.543874 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1322/2675] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:36:59.547913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b583967-341c-4a7a-9da4-5ecc24de908c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:59.557483 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b583967-341c-4a7a-9da4-5ecc24de908c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:59.562085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef0042-9a00-45be-98cf-a9cde51b2589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:59.562726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef0042-9a00-45be-98cf-a9cde51b2589 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:59.563008 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef0042-9a00-45be-98cf-a9cde51b2589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:59.563276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef0042-9a00-45be-98cf-a9cde51b2589 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:59.564599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef0042-9a00-45be-98cf-a9cde51b2589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:59.566520 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef0042-9a00-45be-98cf-a9cde51b2589 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:59.590905 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1354/2676] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:36:59 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:36:59.594859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f6327-c677-4747-9ab4-1bcb9d1f1f53 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:59.604434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f6327-c677-4747-9ab4-1bcb9d1f1f53 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:59.658839 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af93a5-91d2-4d82-a008-d245738aa2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:59.659454 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af93a5-91d2-4d82-a008-d245738aa2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:59.659738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af93a5-91d2-4d82-a008-d245738aa2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:59.660017 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af93a5-91d2-4d82-a008-d245738aa2c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:59.660738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af93a5-91d2-4d82-a008-d245738aa2c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:59.662669 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af93a5-91d2-4d82-a008-d245738aa2c9 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:59.681456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1323/2677] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:36:59 2022] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:36:59.685429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef0042-9a00-45be-98cf-a9cde51b2589 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:59.696015 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef0042-9a00-45be-98cf-a9cde51b2589 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:59.700565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216a9c4-9dc7-482f-9946-d7cc4f6702e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:59.701254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216a9c4-9dc7-482f-9946-d7cc4f6702e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:59.701541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216a9c4-9dc7-482f-9946-d7cc4f6702e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:59.701820 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216a9c4-9dc7-482f-9946-d7cc4f6702e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:59.702545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216a9c4-9dc7-482f-9946-d7cc4f6702e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:59.704129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216a9c4-9dc7-482f-9946-d7cc4f6702e1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:59.715323 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1355/2678] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:36:59.719722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af93a5-91d2-4d82-a008-d245738aa2c9 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:59.730029 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af93a5-91d2-4d82-a008-d245738aa2c9 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:59.735114 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d43bb-3e39-4e75-826b-e7ad0db07c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:59.735779 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d43bb-3e39-4e75-826b-e7ad0db07c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:59.736610 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d43bb-3e39-4e75-826b-e7ad0db07c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:59.736887 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d43bb-3e39-4e75-826b-e7ad0db07c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:59.737672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d43bb-3e39-4e75-826b-e7ad0db07c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:59.739281 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d43bb-3e39-4e75-826b-e7ad0db07c6d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:59.749812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1324/2679] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:36:59.753838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216a9c4-9dc7-482f-9946-d7cc4f6702e1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:59.763666 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216a9c4-9dc7-482f-9946-d7cc4f6702e1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:59.768187 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df5d57-b84c-4fde-a379-f2642dbd1936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:59.769104 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df5d57-b84c-4fde-a379-f2642dbd1936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:59.769387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df5d57-b84c-4fde-a379-f2642dbd1936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:59.769659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df5d57-b84c-4fde-a379-f2642dbd1936 admin admin] PATH_INFO: `/v3/projects/02a33b43a4ef4bcf94e2155892e74961/users/951c5a2c883b4888812e9bd9079f8507/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:59.785288 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df5d57-b84c-4fde-a379-f2642dbd1936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a33b43a4ef4bcf94e2155892e74961, user_id=951c5a2c883b4888812e9bd9079f8507, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:59.787985 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df5d57-b84c-4fde-a379-f2642dbd1936 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:59.802229 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1356/2680] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:36:59 2022] PUT /identity/v3/projects/02a33b43a4ef4bcf94e2155892e74961/users/951c5a2c883b4888812e9bd9079f8507/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:36:59.807129 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54815439-835a-4be3-87a4-83729eb24f6a None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:59.807418 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54815439-835a-4be3-87a4-83729eb24f6a None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:59.807717 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54815439-835a-4be3-87a4-83729eb24f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:59.825792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-54815439-835a-4be3-87a4-83729eb24f6a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:36:59.826999 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-54815439-835a-4be3-87a4-83729eb24f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:59.892481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1325/2681] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:36:59.898875 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df5d57-b84c-4fde-a379-f2642dbd1936 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:36:59.900599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-88df5d57-b84c-4fde-a379-f2642dbd1936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:36:59.911853 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:59.964119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df5d57-b84c-4fde-a379-f2642dbd1936 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:36:59.968768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43e2d8-0a4a-476b-8bf2-5ff9d320043a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:36:59.969500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43e2d8-0a4a-476b-8bf2-5ff9d320043a service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:36:59.969789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43e2d8-0a4a-476b-8bf2-5ff9d320043a service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:36:59.970064 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43e2d8-0a4a-476b-8bf2-5ff9d320043a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:36:59.980744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43e2d8-0a4a-476b-8bf2-5ff9d320043a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:36:59.982221 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43e2d8-0a4a-476b-8bf2-5ff9d320043a service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:36:59.993576 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1357/2682] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:37:00.742380 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6d9ee-ac89-4212-b0da-568209ae716d None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:00.742909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6d9ee-ac89-4212-b0da-568209ae716d None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:00.743019 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6d9ee-ac89-4212-b0da-568209ae716d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:00.769535 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-29b6d9ee-ac89-4212-b0da-568209ae716d None None] MFA Rules not processed for user `951c5a2c883b4888812e9bd9079f8507`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:00.770745 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-29b6d9ee-ac89-4212-b0da-568209ae716d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:00.780429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:00.838437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1326/2683] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:37:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:37:00.849287 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43e2d8-0a4a-476b-8bf2-5ff9d320043a service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:00.850705 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9c43e2d8-0a4a-476b-8bf2-5ff9d320043a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:00.908948 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43e2d8-0a4a-476b-8bf2-5ff9d320043a service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:00.912700 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f2642-6a8b-457d-95c5-a13c1d27acc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:00.913390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f2642-6a8b-457d-95c5-a13c1d27acc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:00.913677 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f2642-6a8b-457d-95c5-a13c1d27acc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:00.913958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f2642-6a8b-457d-95c5-a13c1d27acc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:00.925332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f2642-6a8b-457d-95c5-a13c1d27acc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:00.926804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f2642-6a8b-457d-95c5-a13c1d27acc9 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:00.935919 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1358/2684] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:37:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:37:02.288254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30044baa-3870-4f18-b5aa-36abc3591507 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:02.289324 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30044baa-3870-4f18-b5aa-36abc3591507 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:02.289648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30044baa-3870-4f18-b5aa-36abc3591507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:02.308497 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-30044baa-3870-4f18-b5aa-36abc3591507 None None] MFA Rules not processed for user `951c5a2c883b4888812e9bd9079f8507`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:02.309747 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-30044baa-3870-4f18-b5aa-36abc3591507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:02.317608 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1327/2685] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:37:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:37:02.893173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fd293-efa0-49f7-a3cf-3a35f3012e24 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:02.893645 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fd293-efa0-49f7-a3cf-3a35f3012e24 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:02.893728 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fd293-efa0-49f7-a3cf-3a35f3012e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:02.913184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e95fd293-efa0-49f7-a3cf-3a35f3012e24 None None] MFA Rules not processed for user `de050afb84fd48d2aaab15ad7dfb819f`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:02.914390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e95fd293-efa0-49f7-a3cf-3a35f3012e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:02.973907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1359/2686] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:37:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:37:12.303440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=25 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:12.966662 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=74 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:19.754534 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2659e80-099f-4464-bbe7-d4cf061f17eb None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:19.755166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2659e80-099f-4464-bbe7-d4cf061f17eb None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:19.755318 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2659e80-099f-4464-bbe7-d4cf061f17eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:19.777008 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-c2659e80-099f-4464-bbe7-d4cf061f17eb None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:19.778478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c2659e80-099f-4464-bbe7-d4cf061f17eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:19.838014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1328/2687] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jul 21 22:37:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:37:19.863695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fd293-efa0-49f7-a3cf-3a35f3012e24 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:19.865194 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e95fd293-efa0-49f7-a3cf-3a35f3012e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:19.940645 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fd293-efa0-49f7-a3cf-3a35f3012e24 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:19.946648 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25259f7d-e195-456b-9c65-cc1b4e2fa2b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:19.947309 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25259f7d-e195-456b-9c65-cc1b4e2fa2b3 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:19.947596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25259f7d-e195-456b-9c65-cc1b4e2fa2b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:19.947939 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25259f7d-e195-456b-9c65-cc1b4e2fa2b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:19.959191 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25259f7d-e195-456b-9c65-cc1b4e2fa2b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:19.960778 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25259f7d-e195-456b-9c65-cc1b4e2fa2b3 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:19.969253 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1360/2688] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:37:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:37:29.827353 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=25 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:29.966202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=32 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:31.662125 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878144dd-1953-4f05-8802-d9e4a47ae51b None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:31.662663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878144dd-1953-4f05-8802-d9e4a47ae51b None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:31.662663 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878144dd-1953-4f05-8802-d9e4a47ae51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:31.682476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-878144dd-1953-4f05-8802-d9e4a47ae51b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:31.683948 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-878144dd-1953-4f05-8802-d9e4a47ae51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:31.692776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1329/2689] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 21 22:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:37:31.711233 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25259f7d-e195-456b-9c65-cc1b4e2fa2b3 service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:31.714192 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-25259f7d-e195-456b-9c65-cc1b4e2fa2b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:31.794503 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25259f7d-e195-456b-9c65-cc1b4e2fa2b3 service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:31.801039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812c39c-95ab-4b84-842e-f1ed270406d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:31.801920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812c39c-95ab-4b84-842e-f1ed270406d5 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:31.802436 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812c39c-95ab-4b84-842e-f1ed270406d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:31.802906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812c39c-95ab-4b84-842e-f1ed270406d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:31.812669 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812c39c-95ab-4b84-842e-f1ed270406d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:31.814391 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812c39c-95ab-4b84-842e-f1ed270406d5 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:31.835766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1361/2690] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:37:34.763367 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406373f-f90b-40e4-a0be-9348118f7177 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:34.763957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406373f-f90b-40e4-a0be-9348118f7177 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:34.763957 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406373f-f90b-40e4-a0be-9348118f7177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:34.789664 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-f406373f-f90b-40e4-a0be-9348118f7177 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:34.791029 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f406373f-f90b-40e4-a0be-9348118f7177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:34.801507 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1330/2691] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 21 22:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:37:34.817465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812c39c-95ab-4b84-842e-f1ed270406d5 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:34.819537 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6812c39c-95ab-4b84-842e-f1ed270406d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:34.837158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812c39c-95ab-4b84-842e-f1ed270406d5 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:34.843366 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a03a2-9fc1-4401-949e-f0d8ffc7ff81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:34.844755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a03a2-9fc1-4401-949e-f0d8ffc7ff81 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:34.845317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a03a2-9fc1-4401-949e-f0d8ffc7ff81 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:34.845841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a03a2-9fc1-4401-949e-f0d8ffc7ff81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:34.855478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a03a2-9fc1-4401-949e-f0d8ffc7ff81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:34.857415 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a03a2-9fc1-4401-949e-f0d8ffc7ff81 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:34.868661 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1362/2692] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:37:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:37:38.001053 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f3fd1-453b-43ee-a54c-ccbc251aa664 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:38.001590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f3fd1-453b-43ee-a54c-ccbc251aa664 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:38.001708 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f3fd1-453b-43ee-a54c-ccbc251aa664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:38.019443 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-c35f3fd1-453b-43ee-a54c-ccbc251aa664 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:38.020626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c35f3fd1-453b-43ee-a54c-ccbc251aa664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:38.028652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1331/2693] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 21 22:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:37:38.043779 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a03a2-9fc1-4401-949e-f0d8ffc7ff81 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:38.055063 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a03a2-9fc1-4401-949e-f0d8ffc7ff81 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:38.060723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd73cf6-c0b2-4abf-93a2-7c0a10843046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:38.061395 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd73cf6-c0b2-4abf-93a2-7c0a10843046 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:38.061683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd73cf6-c0b2-4abf-93a2-7c0a10843046 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:38.061956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd73cf6-c0b2-4abf-93a2-7c0a10843046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:38.071364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd73cf6-c0b2-4abf-93a2-7c0a10843046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:38.072968 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd73cf6-c0b2-4abf-93a2-7c0a10843046 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:38.083388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1363/2694] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:37:38.439965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edf9af-f503-4bed-ba34-567071f16bd2 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:38.440251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edf9af-f503-4bed-ba34-567071f16bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:38.440526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edf9af-f503-4bed-ba34-567071f16bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:38.458232 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-64edf9af-f503-4bed-ba34-567071f16bd2 None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:38.459411 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-64edf9af-f503-4bed-ba34-567071f16bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:38.466518 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1332/2695] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jul 21 22:37:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:37:38.479073 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd73cf6-c0b2-4abf-93a2-7c0a10843046 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:38.490800 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd73cf6-c0b2-4abf-93a2-7c0a10843046 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:38.496256 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c847475-8858-44f6-acc9-f131dfba64ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:38.497200 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c847475-8858-44f6-acc9-f131dfba64ac service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:38.497488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c847475-8858-44f6-acc9-f131dfba64ac service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:38.497766 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c847475-8858-44f6-acc9-f131dfba64ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:38.506361 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c847475-8858-44f6-acc9-f131dfba64ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:38.507922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c847475-8858-44f6-acc9-f131dfba64ac service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:38.515897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1364/2696] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:37:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:37:40.394388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edf9af-f503-4bed-ba34-567071f16bd2 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:40.395774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-64edf9af-f503-4bed-ba34-567071f16bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:40.455127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c847475-8858-44f6-acc9-f131dfba64ac service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:40.456633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2c847475-8858-44f6-acc9-f131dfba64ac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:40.517244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edf9af-f503-4bed-ba34-567071f16bd2 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:40.522426 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f5ea3-4f1d-4215-8ab6-dea6dfc00221 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba75bf6ef954eb59d8db1efa6c73d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:40.523126 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f5ea3-4f1d-4215-8ab6-dea6dfc00221 service placement] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:40.523508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f5ea3-4f1d-4215-8ab6-dea6dfc00221 service placement] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:40.523851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f5ea3-4f1d-4215-8ab6-dea6dfc00221 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:40.525702 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ed5f5ea3-4f1d-4215-8ab6-dea6dfc00221 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:40.526525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c847475-8858-44f6-acc9-f131dfba64ac service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:40.531367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60931e55-f0ae-4d27-b407-5d1fa9b2054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:40.532227 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60931e55-f0ae-4d27-b407-5d1fa9b2054d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:40.532505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60931e55-f0ae-4d27-b407-5d1fa9b2054d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:40.532781 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60931e55-f0ae-4d27-b407-5d1fa9b2054d admin admin] PATH_INFO: `/v3/users/de050afb84fd48d2aaab15ad7dfb819f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:40.533989 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60931e55-f0ae-4d27-b407-5d1fa9b2054d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de050afb84fd48d2aaab15ad7dfb819f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:40.535875 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60931e55-f0ae-4d27-b407-5d1fa9b2054d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:40.537939 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f5ea3-4f1d-4215-8ab6-dea6dfc00221 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:40.539564 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f5ea3-4f1d-4215-8ab6-dea6dfc00221 service placement] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:40.550242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1333/2697] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:37:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:37:40.589736 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-60931e55-f0ae-4d27-b407-5d1fa9b2054d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de050afb84fd48d2aaab15ad7dfb819f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:37:40.590904 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:40.604620 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-60931e55-f0ae-4d27-b407-5d1fa9b2054d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de050afb84fd48d2aaab15ad7dfb819f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:37:40.615692 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-60931e55-f0ae-4d27-b407-5d1fa9b2054d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de050afb84fd48d2aaab15ad7dfb819f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:37:40.616409 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-60931e55-f0ae-4d27-b407-5d1fa9b2054d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de050afb84fd48d2aaab15ad7dfb819f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:37:40.623689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-60931e55-f0ae-4d27-b407-5d1fa9b2054d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de050afb84fd48d2aaab15ad7dfb819f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:37:40.630023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1365/2698] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:37:40 2022] DELETE /identity/v3/users/de050afb84fd48d2aaab15ad7dfb819f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:37:40.805162 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f5ea3-4f1d-4215-8ab6-dea6dfc00221 service placement] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:40.816113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f5ea3-4f1d-4215-8ab6-dea6dfc00221 service placement] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:40.875409 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b0cf0-87e5-4983-b45f-6eed83f09332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:40.876280 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b0cf0-87e5-4983-b45f-6eed83f09332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:40.876561 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b0cf0-87e5-4983-b45f-6eed83f09332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:40.876837 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b0cf0-87e5-4983-b45f-6eed83f09332 admin admin] PATH_INFO: `/v3/projects/604dcf476b1d42478f7d7964d302f2dc` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:40.878059 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b0cf0-87e5-4983-b45f-6eed83f09332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=604dcf476b1d42478f7d7964d302f2dc)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:40.879959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b0cf0-87e5-4983-b45f-6eed83f09332 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:40.906621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:40.931032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d76b0cf0-87e5-4983-b45f-6eed83f09332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '604dcf476b1d42478f7d7964d302f2dc', 'request_id': 'req-d76b0cf0-87e5-4983-b45f-6eed83f09332'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:37:40.937831 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d76b0cf0-87e5-4983-b45f-6eed83f09332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '604dcf476b1d42478f7d7964d302f2dc', 'request_id': 'req-d76b0cf0-87e5-4983-b45f-6eed83f09332'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:37:40.943537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d76b0cf0-87e5-4983-b45f-6eed83f09332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '604dcf476b1d42478f7d7964d302f2dc', 'request_id': 'req-d76b0cf0-87e5-4983-b45f-6eed83f09332'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:37:40.958378 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d76b0cf0-87e5-4983-b45f-6eed83f09332 admin admin] The token cache is being invalidate because project 604dcf476b1d42478f7d7964d302f2dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:37:40.958855 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d76b0cf0-87e5-4983-b45f-6eed83f09332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:37:40.959774 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-d76b0cf0-87e5-4983-b45f-6eed83f09332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:37:40.965526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1334/2699] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:37:40 2022] DELETE /identity/v3/projects/604dcf476b1d42478f7d7964d302f2dc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:37:40.967627 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb215b1-2545-402a-b911-17b75b730768 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:40.967916 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb215b1-2545-402a-b911-17b75b730768 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:40.968194 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb215b1-2545-402a-b911-17b75b730768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:41.037071 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4fb215b1-2545-402a-b911-17b75b730768 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:41.038806 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4fb215b1-2545-402a-b911-17b75b730768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:41.100623 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90610f72-fe07-473c-aeaa-4b07f005a01a None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:41.100915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90610f72-fe07-473c-aeaa-4b07f005a01a None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:41.101544 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90610f72-fe07-473c-aeaa-4b07f005a01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:41.119804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1366/2700] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:37:41.120470 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-90610f72-fe07-473c-aeaa-4b07f005a01a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:41.121418 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20a1f1-c933-4d55-84b3-65150bdfc494 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:41.121710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20a1f1-c933-4d55-84b3-65150bdfc494 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:41.122021 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-90610f72-fe07-473c-aeaa-4b07f005a01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:41.122162 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20a1f1-c933-4d55-84b3-65150bdfc494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:41.130224 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1335/2701] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 21 22:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:37:41.143822 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ac20a1f1-c933-4d55-84b3-65150bdfc494 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:41.145031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ac20a1f1-c933-4d55-84b3-65150bdfc494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:41.146459 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90610f72-fe07-473c-aeaa-4b07f005a01a None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:41.147818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-90610f72-fe07-473c-aeaa-4b07f005a01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:41.154221 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1367/2702] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:37:41.159019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20a1f1-c933-4d55-84b3-65150bdfc494 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:41.167961 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20a1f1-c933-4d55-84b3-65150bdfc494 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:41.172646 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450e072-1e98-4714-b1e6-c581ae4576b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:41.173311 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450e072-1e98-4714-b1e6-c581ae4576b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:41.173596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450e072-1e98-4714-b1e6-c581ae4576b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:41.173865 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450e072-1e98-4714-b1e6-c581ae4576b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:41.174610 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450e072-1e98-4714-b1e6-c581ae4576b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:37:41.174913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450e072-1e98-4714-b1e6-c581ae4576b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:41.176490 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450e072-1e98-4714-b1e6-c581ae4576b7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:41.187838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1368/2703] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 22:37:41.191854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450e072-1e98-4714-b1e6-c581ae4576b7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:41.201368 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450e072-1e98-4714-b1e6-c581ae4576b7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:41.206662 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18efa59-deea-437a-8150-287b017ba2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:41.207279 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18efa59-deea-437a-8150-287b017ba2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:41.207558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18efa59-deea-437a-8150-287b017ba2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:41.207834 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18efa59-deea-437a-8150-287b017ba2e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:41.208526 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18efa59-deea-437a-8150-287b017ba2e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:41.210427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18efa59-deea-437a-8150-287b017ba2e1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:41.236431 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1369/2704] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:37:41 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:37:41.240240 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18efa59-deea-437a-8150-287b017ba2e1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:41.254686 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90610f72-fe07-473c-aeaa-4b07f005a01a None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:41.291899 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:41.303482 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18efa59-deea-437a-8150-287b017ba2e1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:41.309515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc14101-1a9e-4baa-8ff6-6c7ff5543e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:41.310181 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc14101-1a9e-4baa-8ff6-6c7ff5543e5b admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:41.310459 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc14101-1a9e-4baa-8ff6-6c7ff5543e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:41.310733 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc14101-1a9e-4baa-8ff6-6c7ff5543e5b admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:41.311405 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc14101-1a9e-4baa-8ff6-6c7ff5543e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:41.313908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc14101-1a9e-4baa-8ff6-6c7ff5543e5b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:41.320381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d07f58-96b6-4638-82c7-9245fd250b6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:41.321178 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d07f58-96b6-4638-82c7-9245fd250b6d service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:41.321461 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d07f58-96b6-4638-82c7-9245fd250b6d service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:41.321745 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d07f58-96b6-4638-82c7-9245fd250b6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:41.330746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d07f58-96b6-4638-82c7-9245fd250b6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:41.332333 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d07f58-96b6-4638-82c7-9245fd250b6d service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:41.333526 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1370/2705] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:37:41 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:37:41.337571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc14101-1a9e-4baa-8ff6-6c7ff5543e5b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:41.342289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1336/2706] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:37:41.347475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc14101-1a9e-4baa-8ff6-6c7ff5543e5b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:41.352075 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f1a0f-0610-44d5-87d4-78bbd89c9d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:41.352768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f1a0f-0610-44d5-87d4-78bbd89c9d2f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:41.353092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f1a0f-0610-44d5-87d4-78bbd89c9d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:41.353365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f1a0f-0610-44d5-87d4-78bbd89c9d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:41.354087 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f1a0f-0610-44d5-87d4-78bbd89c9d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:41.355654 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f1a0f-0610-44d5-87d4-78bbd89c9d2f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:41.366992 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1371/2707] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:37:41.370993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d07f58-96b6-4638-82c7-9245fd250b6d service nova] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:41.375984 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:41.382160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d07f58-96b6-4638-82c7-9245fd250b6d service nova] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:41.388048 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ea0cc-46ec-43a5-8a5e-d816f2723f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:41.388722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ea0cc-46ec-43a5-8a5e-d816f2723f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:41.389038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ea0cc-46ec-43a5-8a5e-d816f2723f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:41.389316 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ea0cc-46ec-43a5-8a5e-d816f2723f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:41.390032 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ea0cc-46ec-43a5-8a5e-d816f2723f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:41.391634 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ea0cc-46ec-43a5-8a5e-d816f2723f5b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:41.401436 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1337/2708] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:37:41.405941 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f1a0f-0610-44d5-87d4-78bbd89c9d2f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:41.416153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f1a0f-0610-44d5-87d4-78bbd89c9d2f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:41.420596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0648f-e38f-46b1-b2fe-3ce362c0adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:41.421568 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0648f-e38f-46b1-b2fe-3ce362c0adc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:41.422508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0648f-e38f-46b1-b2fe-3ce362c0adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:41.422780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0648f-e38f-46b1-b2fe-3ce362c0adc7 admin admin] PATH_INFO: `/v3/projects/ba2c862ab65f46c0ac8ad2cc02121db6/users/172540596e874221bcbc30bf43eb6370/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:41.437173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0648f-e38f-46b1-b2fe-3ce362c0adc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba2c862ab65f46c0ac8ad2cc02121db6, user_id=172540596e874221bcbc30bf43eb6370, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:41.439823 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0648f-e38f-46b1-b2fe-3ce362c0adc7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:41.452282 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1372/2709] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:37:41 2022] PUT /identity/v3/projects/ba2c862ab65f46c0ac8ad2cc02121db6/users/172540596e874221bcbc30bf43eb6370/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:37:41.462849 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a85cdc-fdeb-432a-ac7b-f13d31a4a88e None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:41.463140 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a85cdc-fdeb-432a-ac7b-f13d31a4a88e None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:41.463422 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a85cdc-fdeb-432a-ac7b-f13d31a4a88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:41.489880 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-69a85cdc-fdeb-432a-ac7b-f13d31a4a88e None None] MFA Rules not processed for user `172540596e874221bcbc30bf43eb6370`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:41.491009 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-69a85cdc-fdeb-432a-ac7b-f13d31a4a88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:41.552386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1338/2710] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:37:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:37:41.562937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0648f-e38f-46b1-b2fe-3ce362c0adc7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:41.564641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-40f0648f-e38f-46b1-b2fe-3ce362c0adc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:41.624105 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0648f-e38f-46b1-b2fe-3ce362c0adc7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:41.627751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354a9c6-58a3-4dd6-bf26-b13a36f9283b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:41.628390 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354a9c6-58a3-4dd6-bf26-b13a36f9283b service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:41.628674 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354a9c6-58a3-4dd6-bf26-b13a36f9283b service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:41.628979 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354a9c6-58a3-4dd6-bf26-b13a36f9283b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:41.637146 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354a9c6-58a3-4dd6-bf26-b13a36f9283b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:41.638549 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354a9c6-58a3-4dd6-bf26-b13a36f9283b service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:41.647332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1373/2711] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:37:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:37:42.975266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62014201-64e2-42aa-82c7-40594dacb734 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:42.975734 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62014201-64e2-42aa-82c7-40594dacb734 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:42.975828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62014201-64e2-42aa-82c7-40594dacb734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:42.993110 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-62014201-64e2-42aa-82c7-40594dacb734 None None] MFA Rules not processed for user `172540596e874221bcbc30bf43eb6370`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:42.994254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-62014201-64e2-42aa-82c7-40594dacb734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:43.001538 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1339/2712] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:37:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:37:45.304320 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170466f-8a58-4bc3-a8f9-197d3ca8d2ff None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:45.305152 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170466f-8a58-4bc3-a8f9-197d3ca8d2ff None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:45.305606 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170466f-8a58-4bc3-a8f9-197d3ca8d2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:45.329995 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a170466f-8a58-4bc3-a8f9-197d3ca8d2ff None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:45.331205 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a170466f-8a58-4bc3-a8f9-197d3ca8d2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:45.411622 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1374/2713] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 21 22:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:37:45.426806 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62014201-64e2-42aa-82c7-40594dacb734 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:45.535218 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62014201-64e2-42aa-82c7-40594dacb734 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:45.544223 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c59614-a5eb-4bd1-9dc0-3850a6ad54c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:45.545280 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c59614-a5eb-4bd1-9dc0-3850a6ad54c0 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:45.545664 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c59614-a5eb-4bd1-9dc0-3850a6ad54c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:45.546316 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c59614-a5eb-4bd1-9dc0-3850a6ad54c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:45.565487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c59614-a5eb-4bd1-9dc0-3850a6ad54c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:45.568570 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c59614-a5eb-4bd1-9dc0-3850a6ad54c0 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:45.581008 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1340/2714] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:37:48.500112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8ab8b-4f6b-4362-93df-fca8b5cdcad1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:48.500747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8ab8b-4f6b-4362-93df-fca8b5cdcad1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:48.501115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd86d48-6bc2-47b4-ae86-d3c542cf9376 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:48.501514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8ab8b-4f6b-4362-93df-fca8b5cdcad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:48.501629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd86d48-6bc2-47b4-ae86-d3c542cf9376 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:48.501724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd86d48-6bc2-47b4-ae86-d3c542cf9376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:48.520466 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-9fd86d48-6bc2-47b4-ae86-d3c542cf9376 None None] MFA Rules not processed for user `67216e70494c4f0296ace1d11600f6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:48.522393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-9fd86d48-6bc2-47b4-ae86-d3c542cf9376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:48.523039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3ab8ab8b-4f6b-4362-93df-fca8b5cdcad1 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:37:48.524969 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3ab8ab8b-4f6b-4362-93df-fca8b5cdcad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:48.534477 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1375/2715] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 21 22:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:37:48.553156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8ab8b-4f6b-4362-93df-fca8b5cdcad1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:37:48.554654 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3ab8ab8b-4f6b-4362-93df-fca8b5cdcad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:37:48.571039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8ab8b-4f6b-4362-93df-fca8b5cdcad1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:37:48.576656 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab704d0b-19d5-41cb-b767-e48172a2698b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:37:48.578095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab704d0b-19d5-41cb-b767-e48172a2698b service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:37:48.578385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab704d0b-19d5-41cb-b767-e48172a2698b service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:37:48.578666 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab704d0b-19d5-41cb-b767-e48172a2698b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:37:48.586643 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1341/2716] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:37:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:37:48.591183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab704d0b-19d5-41cb-b767-e48172a2698b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:37:48.591183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab704d0b-19d5-41cb-b767-e48172a2698b service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:37:48.601267 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1376/2717] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:37:58.579025 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=98 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:58.597114 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=82,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:04.335644 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302efe9-eb12-456c-aee1-b03146f5fd63 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:04.336122 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302efe9-eb12-456c-aee1-b03146f5fd63 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:04.336242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302efe9-eb12-456c-aee1-b03146f5fd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:04.362841 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-7302efe9-eb12-456c-aee1-b03146f5fd63 None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:04.364035 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-7302efe9-eb12-456c-aee1-b03146f5fd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:04.418244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1342/2718] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jul 21 22:38:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:04.430024 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab704d0b-19d5-41cb-b767-e48172a2698b service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:04.431469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ab704d0b-19d5-41cb-b767-e48172a2698b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:04.500896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab704d0b-19d5-41cb-b767-e48172a2698b service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:04.505847 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b150b7a-5fa0-4967-95eb-03de5163a0d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:04.506490 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b150b7a-5fa0-4967-95eb-03de5163a0d4 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:04.506773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b150b7a-5fa0-4967-95eb-03de5163a0d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:04.507051 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b150b7a-5fa0-4967-95eb-03de5163a0d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:04.515583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b150b7a-5fa0-4967-95eb-03de5163a0d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:04.517175 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b150b7a-5fa0-4967-95eb-03de5163a0d4 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:04.525121 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1377/2719] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:38:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:38:05.016099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bca7c-0a18-4573-b729-facc0f97274e None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:05.016389 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bca7c-0a18-4573-b729-facc0f97274e None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:05.016667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bca7c-0a18-4573-b729-facc0f97274e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:05.035269 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-ec6bca7c-0a18-4573-b729-facc0f97274e None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:05.036467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ec6bca7c-0a18-4573-b729-facc0f97274e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:05.043631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1343/2720] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jul 21 22:38:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:05.056376 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b150b7a-5fa0-4967-95eb-03de5163a0d4 service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:05.067398 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b150b7a-5fa0-4967-95eb-03de5163a0d4 service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:05.072443 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837e07f-06cc-4bf3-a182-28f0ae83a926 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:05.073123 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837e07f-06cc-4bf3-a182-28f0ae83a926 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:05.073410 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837e07f-06cc-4bf3-a182-28f0ae83a926 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:05.073689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837e07f-06cc-4bf3-a182-28f0ae83a926 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:05.082259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837e07f-06cc-4bf3-a182-28f0ae83a926 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:05.083852 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837e07f-06cc-4bf3-a182-28f0ae83a926 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:05.092187 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1378/2721] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:38:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:38:05.290607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657bf2f-16ea-446e-af60-f127879783f1 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:05.290912 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657bf2f-16ea-446e-af60-f127879783f1 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:05.291233 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657bf2f-16ea-446e-af60-f127879783f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:05.310487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-c657bf2f-16ea-446e-af60-f127879783f1 None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:05.311711 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c657bf2f-16ea-446e-af60-f127879783f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:05.319083 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1344/2722] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jul 21 22:38:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:05.332053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837e07f-06cc-4bf3-a182-28f0ae83a926 service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:05.342500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837e07f-06cc-4bf3-a182-28f0ae83a926 service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:05.347966 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc96c6a-7e06-4c80-a060-12658a00743d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:05.348597 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc96c6a-7e06-4c80-a060-12658a00743d service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:05.348881 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc96c6a-7e06-4c80-a060-12658a00743d service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:05.349191 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc96c6a-7e06-4c80-a060-12658a00743d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:05.357028 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc96c6a-7e06-4c80-a060-12658a00743d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:05.359169 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc96c6a-7e06-4c80-a060-12658a00743d service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:05.367038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1379/2723] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:38:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:38:05.676862 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a124db-d9dc-4600-8aa4-8848160ab498 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:05.677337 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a124db-d9dc-4600-8aa4-8848160ab498 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:05.677440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a124db-d9dc-4600-8aa4-8848160ab498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:05.694852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-b7a124db-d9dc-4600-8aa4-8848160ab498 None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:05.696015 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b7a124db-d9dc-4600-8aa4-8848160ab498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:05.702913 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1345/2724] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jul 21 22:38:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:05.714706 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc96c6a-7e06-4c80-a060-12658a00743d service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:05.725414 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc96c6a-7e06-4c80-a060-12658a00743d service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:05.730275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c788a3-feec-4cbd-8b14-6f9ddb884a4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:05.730906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c788a3-feec-4cbd-8b14-6f9ddb884a4a service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:05.731186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c788a3-feec-4cbd-8b14-6f9ddb884a4a service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:05.731461 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c788a3-feec-4cbd-8b14-6f9ddb884a4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:05.741769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c788a3-feec-4cbd-8b14-6f9ddb884a4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:05.743347 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c788a3-feec-4cbd-8b14-6f9ddb884a4a service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:05.751887 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1380/2725] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:38:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:38:06.247836 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3d65d-1b63-41f4-8562-ab06cdfdab70 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:06.248194 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3d65d-1b63-41f4-8562-ab06cdfdab70 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:06.248540 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3d65d-1b63-41f4-8562-ab06cdfdab70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:06.267224 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-7aa3d65d-1b63-41f4-8562-ab06cdfdab70 None None] MFA Rules not processed for user `951c5a2c883b4888812e9bd9079f8507`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:06.268537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-7aa3d65d-1b63-41f4-8562-ab06cdfdab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:06.323936 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1346/2726] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:38:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:07.838077 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c788a3-feec-4cbd-8b14-6f9ddb884a4a service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:07.849328 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c788a3-feec-4cbd-8b14-6f9ddb884a4a service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:07.854854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ef86d-f651-412b-933b-dd35e49d4176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:07.855746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ef86d-f651-412b-933b-dd35e49d4176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:07.856028 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ef86d-f651-412b-933b-dd35e49d4176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:07.856303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ef86d-f651-412b-933b-dd35e49d4176 admin admin] PATH_INFO: `/v3/users/172540596e874221bcbc30bf43eb6370` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:07.858769 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ef86d-f651-412b-933b-dd35e49d4176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=172540596e874221bcbc30bf43eb6370)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:07.859565 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ef86d-f651-412b-933b-dd35e49d4176 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:07.917053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c59ef86d-f651-412b-933b-dd35e49d4176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '172540596e874221bcbc30bf43eb6370'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:07.930317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c59ef86d-f651-412b-933b-dd35e49d4176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '172540596e874221bcbc30bf43eb6370'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:07.937107 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c59ef86d-f651-412b-933b-dd35e49d4176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '172540596e874221bcbc30bf43eb6370'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:07.937802 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c59ef86d-f651-412b-933b-dd35e49d4176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '172540596e874221bcbc30bf43eb6370'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:07.945921 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c59ef86d-f651-412b-933b-dd35e49d4176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '172540596e874221bcbc30bf43eb6370'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:07.953226 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1381/2727] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:38:07 2022] DELETE /identity/v3/users/172540596e874221bcbc30bf43eb6370 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:38:07.959379 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee33487-e695-4a46-9a77-61f9042db959 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:07.959940 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee33487-e695-4a46-9a77-61f9042db959 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:07.960142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee33487-e695-4a46-9a77-61f9042db959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:07.981186 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-8ee33487-e695-4a46-9a77-61f9042db959 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:07.982600 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8ee33487-e695-4a46-9a77-61f9042db959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:08.053138 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1347/2728] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:08.063635 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ef86d-f651-412b-933b-dd35e49d4176 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:08.065342 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c59ef86d-f651-412b-933b-dd35e49d4176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:08.092542 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:08.147961 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ef86d-f651-412b-933b-dd35e49d4176 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:08.151689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc092737-212c-421a-b659-2dbfda02a02e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:08.152598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc092737-212c-421a-b659-2dbfda02a02e service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:08.152880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc092737-212c-421a-b659-2dbfda02a02e service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:08.153188 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc092737-212c-421a-b659-2dbfda02a02e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:08.163214 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc092737-212c-421a-b659-2dbfda02a02e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:08.164658 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc092737-212c-421a-b659-2dbfda02a02e service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:08.174759 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1382/2729] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:08.346301 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee33487-e695-4a46-9a77-61f9042db959 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:08.347786 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8ee33487-e695-4a46-9a77-61f9042db959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:08.362920 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee33487-e695-4a46-9a77-61f9042db959 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:08.367670 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f370c7-a51d-46ee-928c-63874dbbc905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:08.368633 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f370c7-a51d-46ee-928c-63874dbbc905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:08.369271 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f370c7-a51d-46ee-928c-63874dbbc905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:08.369641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f370c7-a51d-46ee-928c-63874dbbc905 admin admin] PATH_INFO: `/v3/projects/ba2c862ab65f46c0ac8ad2cc02121db6` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:08.370973 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f370c7-a51d-46ee-928c-63874dbbc905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba2c862ab65f46c0ac8ad2cc02121db6)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:08.373171 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f370c7-a51d-46ee-928c-63874dbbc905 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:08.401656 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=100 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:08.434263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f5f370c7-a51d-46ee-928c-63874dbbc905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba2c862ab65f46c0ac8ad2cc02121db6', 'request_id': 'req-f5f370c7-a51d-46ee-928c-63874dbbc905'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:08.442139 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f5f370c7-a51d-46ee-928c-63874dbbc905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba2c862ab65f46c0ac8ad2cc02121db6', 'request_id': 'req-f5f370c7-a51d-46ee-928c-63874dbbc905'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:08.447827 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f5f370c7-a51d-46ee-928c-63874dbbc905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba2c862ab65f46c0ac8ad2cc02121db6', 'request_id': 'req-f5f370c7-a51d-46ee-928c-63874dbbc905'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:08.459444 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f5f370c7-a51d-46ee-928c-63874dbbc905 admin admin] The token cache is being invalidate because project ba2c862ab65f46c0ac8ad2cc02121db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:38:08.459737 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f5f370c7-a51d-46ee-928c-63874dbbc905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:08.460396 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-f5f370c7-a51d-46ee-928c-63874dbbc905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:38:08.462283 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1348/2730] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:38:08 2022] DELETE /identity/v3/projects/ba2c862ab65f46c0ac8ad2cc02121db6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:38:18.170794 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=25 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:18.456388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=17,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:19.025254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d319c1-4b93-40a8-aabd-423c13295f81 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:19.025476 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d319c1-4b93-40a8-aabd-423c13295f81 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:19.025761 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d319c1-4b93-40a8-aabd-423c13295f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:19.043582 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d1d319c1-4b93-40a8-aabd-423c13295f81 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:19.044773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d1d319c1-4b93-40a8-aabd-423c13295f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:19.105216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1383/2731] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 21 22:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:19.119143 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f370c7-a51d-46ee-928c-63874dbbc905 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:19.120569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f5f370c7-a51d-46ee-928c-63874dbbc905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:19.193290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f370c7-a51d-46ee-928c-63874dbbc905 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:19.198704 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb800f-2d45-4c65-8084-09feddb41308 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:19.199348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb800f-2d45-4c65-8084-09feddb41308 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:19.199630 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb800f-2d45-4c65-8084-09feddb41308 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:19.199905 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb800f-2d45-4c65-8084-09feddb41308 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:19.207928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb800f-2d45-4c65-8084-09feddb41308 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:19.209526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb800f-2d45-4c65-8084-09feddb41308 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:19.218894 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1349/2732] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:22.284432 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c6f6-8a1d-4278-a8ca-e8fa6487fa0e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:22.284989 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c6f6-8a1d-4278-a8ca-e8fa6487fa0e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:22.285102 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c6f6-8a1d-4278-a8ca-e8fa6487fa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:22.303804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ce72c6f6-8a1d-4278-a8ca-e8fa6487fa0e None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:22.305023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ce72c6f6-8a1d-4278-a8ca-e8fa6487fa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:22.313488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1384/2733] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 21 22:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:22.328054 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb800f-2d45-4c65-8084-09feddb41308 service nova] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:22.329471 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a2eb800f-2d45-4c65-8084-09feddb41308 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:22.343660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb800f-2d45-4c65-8084-09feddb41308 service nova] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:22.349072 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8529a45-aa67-41e4-bfcc-d43f01aad8d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:22.349705 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8529a45-aa67-41e4-bfcc-d43f01aad8d9 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:22.349988 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8529a45-aa67-41e4-bfcc-d43f01aad8d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:22.350264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8529a45-aa67-41e4-bfcc-d43f01aad8d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:22.358217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8529a45-aa67-41e4-bfcc-d43f01aad8d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:22.359770 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8529a45-aa67-41e4-bfcc-d43f01aad8d9 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:22.369051 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1350/2734] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:25.363188 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c82428-5df4-4285-935c-2295828466dd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:25.363701 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c82428-5df4-4285-935c-2295828466dd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:25.363807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c82428-5df4-4285-935c-2295828466dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:25.381054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-04c82428-5df4-4285-935c-2295828466dd None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:25.382260 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-04c82428-5df4-4285-935c-2295828466dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:25.389937 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1385/2735] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 21 22:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:25.404853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8529a45-aa67-41e4-bfcc-d43f01aad8d9 service nova] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:25.416042 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8529a45-aa67-41e4-bfcc-d43f01aad8d9 service nova] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:25.422039 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348c12-7a79-4c6c-93cf-de00089971d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:25.422720 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348c12-7a79-4c6c-93cf-de00089971d6 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:25.423000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348c12-7a79-4c6c-93cf-de00089971d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:25.423278 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348c12-7a79-4c6c-93cf-de00089971d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:25.431274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff348c12-7a79-4c6c-93cf-de00089971d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:25.432839 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff348c12-7a79-4c6c-93cf-de00089971d6 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:25.441997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1351/2736] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:28.517559 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce5596-9444-44da-8cb7-60bbea456abb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:28.518127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce5596-9444-44da-8cb7-60bbea456abb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:28.518127 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce5596-9444-44da-8cb7-60bbea456abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:28.535635 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4fce5596-9444-44da-8cb7-60bbea456abb None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:28.536795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4fce5596-9444-44da-8cb7-60bbea456abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:28.544347 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1386/2737] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 21 22:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:28.561090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348c12-7a79-4c6c-93cf-de00089971d6 service nova] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:28.572434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348c12-7a79-4c6c-93cf-de00089971d6 service nova] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:28.578048 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc57ab7-e14d-4918-ae8a-bb45e9678876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:28.578681 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc57ab7-e14d-4918-ae8a-bb45e9678876 service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:28.578968 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc57ab7-e14d-4918-ae8a-bb45e9678876 service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:28.579249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc57ab7-e14d-4918-ae8a-bb45e9678876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:28.587347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc57ab7-e14d-4918-ae8a-bb45e9678876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:28.588949 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc57ab7-e14d-4918-ae8a-bb45e9678876 service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:28.598755 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1352/2738] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:31.673963 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41ca5d-f4cf-4c4d-86da-d872b1e62400 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:31.674440 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41ca5d-f4cf-4c4d-86da-d872b1e62400 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:31.674553 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41ca5d-f4cf-4c4d-86da-d872b1e62400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:31.692735 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7e41ca5d-f4cf-4c4d-86da-d872b1e62400 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:31.694039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7e41ca5d-f4cf-4c4d-86da-d872b1e62400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:31.702380 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1387/2739] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Jul 21 22:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:31.740857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc57ab7-e14d-4918-ae8a-bb45e9678876 service nova] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:31.751832 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc57ab7-e14d-4918-ae8a-bb45e9678876 service nova] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:31.757226 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e210d0-37c1-45f4-8494-cc38923aa2be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c04dc3ee4484afaab388cbb306974af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:31.757856 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e210d0-37c1-45f4-8494-cc38923aa2be service nova] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:31.758155 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e210d0-37c1-45f4-8494-cc38923aa2be service nova] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:31.758415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e210d0-37c1-45f4-8494-cc38923aa2be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:31.766893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e210d0-37c1-45f4-8494-cc38923aa2be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:31.768453 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e210d0-37c1-45f4-8494-cc38923aa2be service nova] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:31.778130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1353/2740] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:41.687424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=39 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:41.773740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=58 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:42.593496 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41ca5d-f4cf-4c4d-86da-d872b1e62400 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:42.594895 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7e41ca5d-f4cf-4c4d-86da-d872b1e62400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:42.682488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41ca5d-f4cf-4c4d-86da-d872b1e62400 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:42.688054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6e136-2a40-481e-aa42-fe6921718326 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba75bf6ef954eb59d8db1efa6c73d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:42.688704 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6e136-2a40-481e-aa42-fe6921718326 service placement] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:42.689009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6e136-2a40-481e-aa42-fe6921718326 service placement] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:42.689320 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6e136-2a40-481e-aa42-fe6921718326 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:42.691052 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b4b6e136-2a40-481e-aa42-fe6921718326 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:42.703190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6e136-2a40-481e-aa42-fe6921718326 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:42.704773 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6e136-2a40-481e-aa42-fe6921718326 service placement] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:42.714950 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1388/2741] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:38:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:38:52.710387 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=41 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:54.455517 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd7ff3-07af-4ec6-8d6f-7cfdbf2bbb15 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:54.455996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd7ff3-07af-4ec6-8d6f-7cfdbf2bbb15 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:54.456099 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd7ff3-07af-4ec6-8d6f-7cfdbf2bbb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:54.474141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-a2fd7ff3-07af-4ec6-8d6f-7cfdbf2bbb15 None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:38:54.475326 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a2fd7ff3-07af-4ec6-8d6f-7cfdbf2bbb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:54.528995 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1354/2742] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jul 21 22:38:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:38:54.550363 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6e136-2a40-481e-aa42-fe6921718326 service placement] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:38:54.551742 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b4b6e136-2a40-481e-aa42-fe6921718326 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:38:54.620301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6e136-2a40-481e-aa42-fe6921718326 service placement] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:38:54.625920 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f8e0c-b0d8-460a-a402-5157db112c26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:38:54.626592 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f8e0c-b0d8-460a-a402-5157db112c26 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:38:54.626854 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f8e0c-b0d8-460a-a402-5157db112c26 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:38:54.627134 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f8e0c-b0d8-460a-a402-5157db112c26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:38:54.636632 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f8e0c-b0d8-460a-a402-5157db112c26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:38:54.638302 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f8e0c-b0d8-460a-a402-5157db112c26 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:38:54.649114 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1389/2743] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:38:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:39:01.414349 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd7ff3-07af-4ec6-8d6f-7cfdbf2bbb15 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:01.416345 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-a2fd7ff3-07af-4ec6-8d6f-7cfdbf2bbb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:01.432675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd7ff3-07af-4ec6-8d6f-7cfdbf2bbb15 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.438208 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d1c02-068d-41fc-acca-2834725f359d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.439443 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d1c02-068d-41fc-acca-2834725f359d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.439738 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d1c02-068d-41fc-acca-2834725f359d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.440018 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d1c02-068d-41fc-acca-2834725f359d admin admin] PATH_INFO: `/v3/users/951c5a2c883b4888812e9bd9079f8507` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.441305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d1c02-068d-41fc-acca-2834725f359d admin admin] RBAC: Authorizing `identity:delete_user(user_id=951c5a2c883b4888812e9bd9079f8507)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:01.443250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d1c02-068d-41fc-acca-2834725f359d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:01.500243 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ae9d1c02-068d-41fc-acca-2834725f359d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951c5a2c883b4888812e9bd9079f8507'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.508568 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ae9d1c02-068d-41fc-acca-2834725f359d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951c5a2c883b4888812e9bd9079f8507'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.509360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ae9d1c02-068d-41fc-acca-2834725f359d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951c5a2c883b4888812e9bd9079f8507'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.524471 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ae9d1c02-068d-41fc-acca-2834725f359d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951c5a2c883b4888812e9bd9079f8507'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.534544 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ae9d1c02-068d-41fc-acca-2834725f359d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951c5a2c883b4888812e9bd9079f8507'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.541869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1355/2744] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:01 2022] DELETE /identity/v3/users/951c5a2c883b4888812e9bd9079f8507 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:01.735065 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f8e0c-b0d8-460a-a402-5157db112c26 service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:01.749754 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f8e0c-b0d8-460a-a402-5157db112c26 service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:01.824551 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876b4a2-dd11-4014-84e2-d681f6adc98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:01.826689 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876b4a2-dd11-4014-84e2-d681f6adc98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.827332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876b4a2-dd11-4014-84e2-d681f6adc98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.827845 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876b4a2-dd11-4014-84e2-d681f6adc98c admin admin] PATH_INFO: `/v3/projects/02a33b43a4ef4bcf94e2155892e74961` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.830664 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876b4a2-dd11-4014-84e2-d681f6adc98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a33b43a4ef4bcf94e2155892e74961)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:01.835101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876b4a2-dd11-4014-84e2-d681f6adc98c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:01.898505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d876b4a2-dd11-4014-84e2-d681f6adc98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a33b43a4ef4bcf94e2155892e74961', 'request_id': 'req-d876b4a2-dd11-4014-84e2-d681f6adc98c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.906558 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d876b4a2-dd11-4014-84e2-d681f6adc98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a33b43a4ef4bcf94e2155892e74961', 'request_id': 'req-d876b4a2-dd11-4014-84e2-d681f6adc98c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.913333 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d876b4a2-dd11-4014-84e2-d681f6adc98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a33b43a4ef4bcf94e2155892e74961', 'request_id': 'req-d876b4a2-dd11-4014-84e2-d681f6adc98c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.930909 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d876b4a2-dd11-4014-84e2-d681f6adc98c admin admin] The token cache is being invalidate because project 02a33b43a4ef4bcf94e2155892e74961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:01.931220 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d876b4a2-dd11-4014-84e2-d681f6adc98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.931859 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d876b4a2-dd11-4014-84e2-d681f6adc98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:01.933843 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1390/2745] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:01 2022] DELETE /identity/v3/projects/02a33b43a4ef4bcf94e2155892e74961 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:01.938468 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a918238-af71-4c45-bcdf-f6fc1cfae845 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:01.938768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a918238-af71-4c45-bcdf-f6fc1cfae845 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:01.939052 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a918238-af71-4c45-bcdf-f6fc1cfae845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:01.961865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-5a918238-af71-4c45-bcdf-f6fc1cfae845 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:01.963282 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-5a918238-af71-4c45-bcdf-f6fc1cfae845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:02.029052 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1356/2746] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:02.037430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b5719-104b-46e6-b8cd-5d8730852767 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.037839 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b5719-104b-46e6-b8cd-5d8730852767 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.038781 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b5719-104b-46e6-b8cd-5d8730852767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.064501 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-170b5719-104b-46e6-b8cd-5d8730852767 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:02.067069 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-170b5719-104b-46e6-b8cd-5d8730852767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:02.083998 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1391/2747] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:02.088475 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a918238-af71-4c45-bcdf-f6fc1cfae845 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:02.099057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a918238-af71-4c45-bcdf-f6fc1cfae845 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:02.105159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7e763-1914-4308-b718-adffb0721f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:02.105851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7e763-1914-4308-b718-adffb0721f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.106200 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7e763-1914-4308-b718-adffb0721f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.106484 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7e763-1914-4308-b718-adffb0721f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.107721 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7e763-1914-4308-b718-adffb0721f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:39:02.108034 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7e763-1914-4308-b718-adffb0721f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.109679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7e763-1914-4308-b718-adffb0721f43 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:02.123267 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1357/2748] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:39:02.127734 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b5719-104b-46e6-b8cd-5d8730852767 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:02.146009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b5719-104b-46e6-b8cd-5d8730852767 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:02.151194 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c92219-9985-4687-b581-3b6d11bd9165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:02.152190 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c92219-9985-4687-b581-3b6d11bd9165 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.152541 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c92219-9985-4687-b581-3b6d11bd9165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.153601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c92219-9985-4687-b581-3b6d11bd9165 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.154408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c92219-9985-4687-b581-3b6d11bd9165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.156778 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c92219-9985-4687-b581-3b6d11bd9165 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:02.176804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:02.230473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1392/2749] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:39:02 2022] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:39:02.232132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7e763-1914-4308-b718-adffb0721f43 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:02.258319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:02.263496 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7e763-1914-4308-b718-adffb0721f43 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:02.330662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be9e37-22fc-4a24-9f35-6e6c69f25772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:02.331312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be9e37-22fc-4a24-9f35-6e6c69f25772 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.331599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be9e37-22fc-4a24-9f35-6e6c69f25772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.331876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be9e37-22fc-4a24-9f35-6e6c69f25772 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.332587 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be9e37-22fc-4a24-9f35-6e6c69f25772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.334595 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be9e37-22fc-4a24-9f35-6e6c69f25772 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:02.359191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1358/2750] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:39:02 2022] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:39:02.363789 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c92219-9985-4687-b581-3b6d11bd9165 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:02.374991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c92219-9985-4687-b581-3b6d11bd9165 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:02.380214 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee8e79-0ad0-4a91-957c-9ffa6a0977be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:02.381106 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee8e79-0ad0-4a91-957c-9ffa6a0977be admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.381408 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee8e79-0ad0-4a91-957c-9ffa6a0977be admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.381690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee8e79-0ad0-4a91-957c-9ffa6a0977be admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.382478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee8e79-0ad0-4a91-957c-9ffa6a0977be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.384150 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee8e79-0ad0-4a91-957c-9ffa6a0977be admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:02.397587 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1393/2751] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:02.402326 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be9e37-22fc-4a24-9f35-6e6c69f25772 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:02.413759 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be9e37-22fc-4a24-9f35-6e6c69f25772 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:02.418836 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bf75b-4f62-458d-a04e-27755092a033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:02.419584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bf75b-4f62-458d-a04e-27755092a033 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.419813 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bf75b-4f62-458d-a04e-27755092a033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.420092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bf75b-4f62-458d-a04e-27755092a033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.420858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bf75b-4f62-458d-a04e-27755092a033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.422551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bf75b-4f62-458d-a04e-27755092a033 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:02.434297 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1359/2752] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:39:02.438706 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee8e79-0ad0-4a91-957c-9ffa6a0977be admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:02.449339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee8e79-0ad0-4a91-957c-9ffa6a0977be admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:02.456579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103459f-8cff-4672-95c3-cd8635522da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:02.457489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103459f-8cff-4672-95c3-cd8635522da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.457774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103459f-8cff-4672-95c3-cd8635522da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.458053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103459f-8cff-4672-95c3-cd8635522da7 admin admin] PATH_INFO: `/v3/projects/6be22486d5024ccca84349deb0fd76f4/users/6f43a3f7aa984945b7beb57a5dc4926a/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.475482 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103459f-8cff-4672-95c3-cd8635522da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be22486d5024ccca84349deb0fd76f4, user_id=6f43a3f7aa984945b7beb57a5dc4926a, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.482019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103459f-8cff-4672-95c3-cd8635522da7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:02.521248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1394/2753] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:39:02 2022] PUT /identity/v3/projects/6be22486d5024ccca84349deb0fd76f4/users/6f43a3f7aa984945b7beb57a5dc4926a/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:39:02.594829 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879bc90-5e20-4a88-acdd-fc359965a22c None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.595061 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879bc90-5e20-4a88-acdd-fc359965a22c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.595297 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879bc90-5e20-4a88-acdd-fc359965a22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.627021 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-1879bc90-5e20-4a88-acdd-fc359965a22c None None] MFA Rules not processed for user `6f43a3f7aa984945b7beb57a5dc4926a`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:02.628247 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-1879bc90-5e20-4a88-acdd-fc359965a22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:02.700853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1360/2754] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:39:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:02.712110 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103459f-8cff-4672-95c3-cd8635522da7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:02.713954 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f103459f-8cff-4672-95c3-cd8635522da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:02.821692 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103459f-8cff-4672-95c3-cd8635522da7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:02.826285 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46905db7-a06a-46c7-ac63-66108059e2de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:02.827152 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46905db7-a06a-46c7-ac63-66108059e2de service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:02.827515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46905db7-a06a-46c7-ac63-66108059e2de service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:02.827866 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46905db7-a06a-46c7-ac63-66108059e2de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:02.838154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46905db7-a06a-46c7-ac63-66108059e2de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:02.839928 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46905db7-a06a-46c7-ac63-66108059e2de service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:02.849522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1395/2755] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:07.759115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a391eee-51c5-45f6-bd04-c47abf61cdec None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:07.759747 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a391eee-51c5-45f6-bd04-c47abf61cdec None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:07.760006 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a391eee-51c5-45f6-bd04-c47abf61cdec None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:07.761795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1361/2756] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jul 21 22:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:39:07.768301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e9e1e-e557-48bc-80cb-98f4a556d44d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:07.768770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e9e1e-e557-48bc-80cb-98f4a556d44d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:07.768865 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e9e1e-e557-48bc-80cb-98f4a556d44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:07.815923 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3f2e9e1e-e557-48bc-80cb-98f4a556d44d None None] MFA Rules not processed for user `2c04dc3ee4484afaab388cbb306974af`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:07.824605 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3f2e9e1e-e557-48bc-80cb-98f4a556d44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:07.927841 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1396/2757] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jul 21 22:39:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:07.940569 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a391eee-51c5-45f6-bd04-c47abf61cdec None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:07.942415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-1a391eee-51c5-45f6-bd04-c47abf61cdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:08.003899 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a391eee-51c5-45f6-bd04-c47abf61cdec None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:08.007360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cbf4b-bc7c-4c4c-b53b-25496105dc54 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aefb0fe4d09b451a861510508bb9cf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:08.008004 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cbf4b-bc7c-4c4c-b53b-25496105dc54 service glance] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:08.008291 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cbf4b-bc7c-4c4c-b53b-25496105dc54 service glance] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:08.008567 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cbf4b-bc7c-4c4c-b53b-25496105dc54 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.019321 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cbf4b-bc7c-4c4c-b53b-25496105dc54 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:08.020749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cbf4b-bc7c-4c4c-b53b-25496105dc54 service glance] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:08.032055 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1362/2758] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:39:08.101162 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d18b1-f727-4806-be75-b726fe62dd0d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:08.101524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d18b1-f727-4806-be75-b726fe62dd0d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:08.101882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d18b1-f727-4806-be75-b726fe62dd0d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.103450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1397/2759] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jul 21 22:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:39:08.108108 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c426b0-e481-4f91-ad03-fae99c6e5fd9 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:08.108421 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c426b0-e481-4f91-ad03-fae99c6e5fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:08.108699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c426b0-e481-4f91-ad03-fae99c6e5fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.127637 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-08c426b0-e481-4f91-ad03-fae99c6e5fd9 None None] MFA Rules not processed for user `23aaef489c0948fe8bc10acb8e76c84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:08.128824 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-08c426b0-e481-4f91-ad03-fae99c6e5fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:08.139703 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:08.184746 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1363/2760] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jul 21 22:39:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:08.198244 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d18b1-f727-4806-be75-b726fe62dd0d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:08.200049 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e24d18b1-f727-4806-be75-b726fe62dd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:08.213463 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d18b1-f727-4806-be75-b726fe62dd0d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:08.218059 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff1a26-d4ca-4220-8375-506a1e11fd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:08.218705 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1a26-d4ca-4220-8375-506a1e11fd23 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:08.218989 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1a26-d4ca-4220-8375-506a1e11fd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:08.219265 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1a26-d4ca-4220-8375-506a1e11fd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.226977 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff1a26-d4ca-4220-8375-506a1e11fd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:08.228406 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff1a26-d4ca-4220-8375-506a1e11fd23 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:08.236844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1398/2761] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:08.323826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220197f-ccb4-40ea-9110-526cd5dc2af5 None None] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:08.324115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220197f-ccb4-40ea-9110-526cd5dc2af5 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:08.324393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220197f-ccb4-40ea-9110-526cd5dc2af5 None None] PATH_INFO: `/` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.325830 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1364/2762] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jul 21 22:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 22:39:08.333124 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca636-fc92-4a63-aef4-51a4edfc7dfa None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:08.333487 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca636-fc92-4a63-aef4-51a4edfc7dfa None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:08.333774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ca636-fc92-4a63-aef4-51a4edfc7dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.352230 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-687ca636-fc92-4a63-aef4-51a4edfc7dfa None None] MFA Rules not processed for user `2c04dc3ee4484afaab388cbb306974af`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:08.353467 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-687ca636-fc92-4a63-aef4-51a4edfc7dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:08.363634 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1399/2763] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jul 21 22:39:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:08.374239 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220197f-ccb4-40ea-9110-526cd5dc2af5 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:08.376014 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-5220197f-ccb4-40ea-9110-526cd5dc2af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:08.389778 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220197f-ccb4-40ea-9110-526cd5dc2af5 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:08.393603 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d73b5-b9fd-4111-b270-70b6ababb57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:08.394296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d73b5-b9fd-4111-b270-70b6ababb57d service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:08.394524 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d73b5-b9fd-4111-b270-70b6ababb57d service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:08.394801 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d73b5-b9fd-4111-b270-70b6ababb57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:08.406627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d73b5-b9fd-4111-b270-70b6ababb57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:08.408058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d73b5-b9fd-4111-b270-70b6ababb57d service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:08.419093 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1365/2764] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:09.942216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ab910-b731-4747-beed-6c525d0e55cb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:09.942711 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ab910-b731-4747-beed-6c525d0e55cb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:09.942814 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ab910-b731-4747-beed-6c525d0e55cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:09.960859 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-923ab910-b731-4747-beed-6c525d0e55cb None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:09.962074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-923ab910-b731-4747-beed-6c525d0e55cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:09.967886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:10.017038 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1400/2765] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jul 21 22:39:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:10.029727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d73b5-b9fd-4111-b270-70b6ababb57d service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:10.031074 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f51d73b5-b9fd-4111-b270-70b6ababb57d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:10.098795 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d73b5-b9fd-4111-b270-70b6ababb57d service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:10.103811 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0b4b1-2cb3-4686-91ff-ec44635d4ad1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:10.104463 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0b4b1-2cb3-4686-91ff-ec44635d4ad1 service swift] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:10.104747 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0b4b1-2cb3-4686-91ff-ec44635d4ad1 service swift] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:10.105058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0b4b1-2cb3-4686-91ff-ec44635d4ad1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:10.113623 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0b4b1-2cb3-4686-91ff-ec44635d4ad1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:10.120847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0b4b1-2cb3-4686-91ff-ec44635d4ad1 service swift] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:10.129667 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1366/2766] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:39:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 22:39:12.929955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ab910-b731-4747-beed-6c525d0e55cb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:13.005502 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ab910-b731-4747-beed-6c525d0e55cb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:13.011923 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e30c15-33f7-47cd-8fe0-8934642795cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:13.013081 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e30c15-33f7-47cd-8fe0-8934642795cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:13.013686 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e30c15-33f7-47cd-8fe0-8934642795cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:13.014144 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e30c15-33f7-47cd-8fe0-8934642795cc admin admin] PATH_INFO: `/v3/users/6f43a3f7aa984945b7beb57a5dc4926a` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:13.015832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e30c15-33f7-47cd-8fe0-8934642795cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f43a3f7aa984945b7beb57a5dc4926a)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:13.018198 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e30c15-33f7-47cd-8fe0-8934642795cc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:13.105115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a7e30c15-33f7-47cd-8fe0-8934642795cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f43a3f7aa984945b7beb57a5dc4926a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:13.120514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a7e30c15-33f7-47cd-8fe0-8934642795cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f43a3f7aa984945b7beb57a5dc4926a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:13.129262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a7e30c15-33f7-47cd-8fe0-8934642795cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f43a3f7aa984945b7beb57a5dc4926a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:13.130005 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a7e30c15-33f7-47cd-8fe0-8934642795cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f43a3f7aa984945b7beb57a5dc4926a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:13.139242 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a7e30c15-33f7-47cd-8fe0-8934642795cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f43a3f7aa984945b7beb57a5dc4926a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:13.149435 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1401/2767] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:39:12 2022] DELETE /identity/v3/users/6f43a3f7aa984945b7beb57a5dc4926a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:13.151437 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b69039-4f36-4aca-ad21-27c85a975520 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:13.152237 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b69039-4f36-4aca-ad21-27c85a975520 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:13.152469 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b69039-4f36-4aca-ad21-27c85a975520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:13.171416 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-89b69039-4f36-4aca-ad21-27c85a975520 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:13.172696 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-89b69039-4f36-4aca-ad21-27c85a975520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:13.241416 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1367/2768] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:13.248853 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e30c15-33f7-47cd-8fe0-8934642795cc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:13.250738 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a7e30c15-33f7-47cd-8fe0-8934642795cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:13.294087 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:13.318441 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e30c15-33f7-47cd-8fe0-8934642795cc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:13.322703 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6596aac-5019-4fc9-916b-b509367e88c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:13.323350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6596aac-5019-4fc9-916b-b509367e88c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:13.323635 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6596aac-5019-4fc9-916b-b509367e88c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:13.323907 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6596aac-5019-4fc9-916b-b509367e88c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:13.333848 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6596aac-5019-4fc9-916b-b509367e88c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:13.335285 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6596aac-5019-4fc9-916b-b509367e88c3 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:13.345598 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1402/2769] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:39:13.678777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b69039-4f36-4aca-ad21-27c85a975520 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:13.685727 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-89b69039-4f36-4aca-ad21-27c85a975520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:13.713796 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b69039-4f36-4aca-ad21-27c85a975520 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:13.722391 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccd114-0fb7-4508-aa25-2de43f15a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:13.725499 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccd114-0fb7-4508-aa25-2de43f15a720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:13.725867 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccd114-0fb7-4508-aa25-2de43f15a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:13.726145 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccd114-0fb7-4508-aa25-2de43f15a720 admin admin] PATH_INFO: `/v3/projects/6be22486d5024ccca84349deb0fd76f4` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:13.728090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccd114-0fb7-4508-aa25-2de43f15a720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be22486d5024ccca84349deb0fd76f4)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:13.732457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccd114-0fb7-4508-aa25-2de43f15a720 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:13.803132 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:13.823044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e2ccd114-0fb7-4508-aa25-2de43f15a720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be22486d5024ccca84349deb0fd76f4', 'request_id': 'req-e2ccd114-0fb7-4508-aa25-2de43f15a720'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:13.833263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e2ccd114-0fb7-4508-aa25-2de43f15a720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be22486d5024ccca84349deb0fd76f4', 'request_id': 'req-e2ccd114-0fb7-4508-aa25-2de43f15a720'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:13.853782 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e2ccd114-0fb7-4508-aa25-2de43f15a720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be22486d5024ccca84349deb0fd76f4', 'request_id': 'req-e2ccd114-0fb7-4508-aa25-2de43f15a720'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:13.872484 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e2ccd114-0fb7-4508-aa25-2de43f15a720 admin admin] The token cache is being invalidate because project 6be22486d5024ccca84349deb0fd76f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:39:13.873173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e2ccd114-0fb7-4508-aa25-2de43f15a720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:13.874242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-e2ccd114-0fb7-4508-aa25-2de43f15a720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:39:13.875956 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1368/2770] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:39:13 2022] DELETE /identity/v3/projects/6be22486d5024ccca84349deb0fd76f4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:39:23.340498 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=10 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:23.867254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=11,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:25.625153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f97fc-cfe7-4c71-8eea-9245c960a72c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:25.625545 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f97fc-cfe7-4c71-8eea-9245c960a72c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:25.625844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f97fc-cfe7-4c71-8eea-9245c960a72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:25.644262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-842f97fc-cfe7-4c71-8eea-9245c960a72c None None] MFA Rules not processed for user `9fd7af9bcff947afad3e7de1fe204472`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:39:25.645557 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-842f97fc-cfe7-4c71-8eea-9245c960a72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:25.705151 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1403/2771] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jul 21 22:39:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:39:25.717713 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccd114-0fb7-4508-aa25-2de43f15a720 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:25.719119 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-e2ccd114-0fb7-4508-aa25-2de43f15a720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:25.786817 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccd114-0fb7-4508-aa25-2de43f15a720 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:25.791865 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f63b2-063f-4a33-b109-cf53746caba8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a38d4a306748aa8f2e72ceb7f629e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:25.792455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f63b2-063f-4a33-b109-cf53746caba8 service swift] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:25.792742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f63b2-063f-4a33-b109-cf53746caba8 service swift] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:25.793057 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f63b2-063f-4a33-b109-cf53746caba8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:25.801023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f63b2-063f-4a33-b109-cf53746caba8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:25.802602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f63b2-063f-4a33-b109-cf53746caba8 service swift] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:25.810614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1369/2772] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jul 21 22:39:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 22:39:35.697851 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=25 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:35.807264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=32 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:59.622457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f97fc-cfe7-4c71-8eea-9245c960a72c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:39:59.623884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-842f97fc-cfe7-4c71-8eea-9245c960a72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:59.681637 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f97fc-cfe7-4c71-8eea-9245c960a72c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:39:59.685250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f1626-8ccb-4a10-8665-89d5fa52fa17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:39:59.685891 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f1626-8ccb-4a10-8665-89d5fa52fa17 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:39:59.686173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f1626-8ccb-4a10-8665-89d5fa52fa17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:39:59.686446 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f1626-8ccb-4a10-8665-89d5fa52fa17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:39:59.688169 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d55f1626-8ccb-4a10-8665-89d5fa52fa17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:39:59.744680 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f1626-8ccb-4a10-8665-89d5fa52fa17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:39:59.746141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f1626-8ccb-4a10-8665-89d5fa52fa17 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:39:59.755449 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1404/2773] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:39:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:00.071003 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f63b2-063f-4a33-b109-cf53746caba8 service swift] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:00.072556 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c66f63b2-063f-4a33-b109-cf53746caba8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:00.129922 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f63b2-063f-4a33-b109-cf53746caba8 service swift] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:00.133537 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c11ece-46c7-4668-8e27-68c78014ee2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:00.134185 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c11ece-46c7-4668-8e27-68c78014ee2a service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:00.134470 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c11ece-46c7-4668-8e27-68c78014ee2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:00.134752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c11ece-46c7-4668-8e27-68c78014ee2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:00.136495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-83c11ece-46c7-4668-8e27-68c78014ee2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:00.205877 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c11ece-46c7-4668-8e27-68c78014ee2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:00.207290 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c11ece-46c7-4668-8e27-68c78014ee2a service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:00.218078 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1370/2774] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:40:01.394354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f1626-8ccb-4a10-8665-89d5fa52fa17 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:01.404013 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f1626-8ccb-4a10-8665-89d5fa52fa17 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:01.408072 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44343e73-7640-49a3-9914-39f7d50684f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:01.408707 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44343e73-7640-49a3-9914-39f7d50684f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:01.409017 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44343e73-7640-49a3-9914-39f7d50684f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:01.409296 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44343e73-7640-49a3-9914-39f7d50684f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:01.411031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-44343e73-7640-49a3-9914-39f7d50684f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:01.425250 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44343e73-7640-49a3-9914-39f7d50684f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:01.426690 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44343e73-7640-49a3-9914-39f7d50684f3 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:01.437815 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1405/2775] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 22:40:06.742181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c11ece-46c7-4668-8e27-68c78014ee2a service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:06.743603 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-83c11ece-46c7-4668-8e27-68c78014ee2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:06.754163 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c11ece-46c7-4668-8e27-68c78014ee2a service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:06.757763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d38fd-d9dd-45df-9acf-499915c21748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:06.758450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d38fd-d9dd-45df-9acf-499915c21748 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:06.758680 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d38fd-d9dd-45df-9acf-499915c21748 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:06.758951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d38fd-d9dd-45df-9acf-499915c21748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:06.760629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c02d38fd-d9dd-45df-9acf-499915c21748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:06.822228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d38fd-d9dd-45df-9acf-499915c21748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:06.823656 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d38fd-d9dd-45df-9acf-499915c21748 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:06.833932 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1371/2776] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:09.851085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44343e73-7640-49a3-9914-39f7d50684f3 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:09.852631 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-44343e73-7640-49a3-9914-39f7d50684f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:09.918720 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d38fd-d9dd-45df-9acf-499915c21748 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:09.920303 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c02d38fd-d9dd-45df-9acf-499915c21748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:09.932148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d38fd-d9dd-45df-9acf-499915c21748 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:09.935951 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44343e73-7640-49a3-9914-39f7d50684f3 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:09.937513 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fe1d0-b72f-41a9-867f-b3bd1abbfa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:09.938619 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fe1d0-b72f-41a9-867f-b3bd1abbfa08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:09.938905 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fe1d0-b72f-41a9-867f-b3bd1abbfa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:09.939184 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fe1d0-b72f-41a9-867f-b3bd1abbfa08 admin admin] PATH_INFO: `/v3/users/67216e70494c4f0296ace1d11600f6ab` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:09.940381 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fe1d0-b72f-41a9-867f-b3bd1abbfa08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67216e70494c4f0296ace1d11600f6ab)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:09.942253 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1490a0-3ab3-49ed-b4f6-079a3a565a73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba75bf6ef954eb59d8db1efa6c73d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:09.942412 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fe1d0-b72f-41a9-867f-b3bd1abbfa08 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:09.943032 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1490a0-3ab3-49ed-b4f6-079a3a565a73 service placement] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:09.943388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1490a0-3ab3-49ed-b4f6-079a3a565a73 service placement] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:09.943739 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1490a0-3ab3-49ed-b4f6-079a3a565a73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:09.945581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1a1490a0-3ab3-49ed-b4f6-079a3a565a73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:09.958355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1490a0-3ab3-49ed-b4f6-079a3a565a73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:09.959949 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1490a0-3ab3-49ed-b4f6-079a3a565a73 service placement] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:09.973867 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1406/2777] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:09.979267 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:09.993706 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-9f8fe1d0-b72f-41a9-867f-b3bd1abbfa08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67216e70494c4f0296ace1d11600f6ab'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:10.000979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-9f8fe1d0-b72f-41a9-867f-b3bd1abbfa08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67216e70494c4f0296ace1d11600f6ab'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:10.001668 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-9f8fe1d0-b72f-41a9-867f-b3bd1abbfa08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67216e70494c4f0296ace1d11600f6ab'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:10.013575 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-9f8fe1d0-b72f-41a9-867f-b3bd1abbfa08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67216e70494c4f0296ace1d11600f6ab'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:10.021533 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-9f8fe1d0-b72f-41a9-867f-b3bd1abbfa08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67216e70494c4f0296ace1d11600f6ab'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:10.027415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1372/2778] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:09 2022] DELETE /identity/v3/users/67216e70494c4f0296ace1d11600f6ab => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:40:10.199750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1490a0-3ab3-49ed-b4f6-079a3a565a73 service placement] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:10.218402 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1490a0-3ab3-49ed-b4f6-079a3a565a73 service placement] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:10.249067 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:10.277497 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be73226-ba55-410b-9431-72df52c09630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:10.278291 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be73226-ba55-410b-9431-72df52c09630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:10.278821 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be73226-ba55-410b-9431-72df52c09630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:10.279257 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be73226-ba55-410b-9431-72df52c09630 admin admin] PATH_INFO: `/v3/projects/e7941c09b25f4a4dac6c8b040b14fddc` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:10.280439 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be73226-ba55-410b-9431-72df52c09630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7941c09b25f4a4dac6c8b040b14fddc)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:10.282411 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be73226-ba55-410b-9431-72df52c09630 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:10.327012 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5be73226-ba55-410b-9431-72df52c09630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7941c09b25f4a4dac6c8b040b14fddc', 'request_id': 'req-5be73226-ba55-410b-9431-72df52c09630'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:10.333589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5be73226-ba55-410b-9431-72df52c09630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7941c09b25f4a4dac6c8b040b14fddc', 'request_id': 'req-5be73226-ba55-410b-9431-72df52c09630'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:10.338915 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5be73226-ba55-410b-9431-72df52c09630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7941c09b25f4a4dac6c8b040b14fddc', 'request_id': 'req-5be73226-ba55-410b-9431-72df52c09630'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:10.350465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5be73226-ba55-410b-9431-72df52c09630 admin admin] The token cache is being invalidate because project e7941c09b25f4a4dac6c8b040b14fddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:10.350750 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5be73226-ba55-410b-9431-72df52c09630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:10.351365 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5be73226-ba55-410b-9431-72df52c09630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:10.352945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1407/2779] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:10 2022] DELETE /identity/v3/projects/e7941c09b25f4a4dac6c8b040b14fddc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:10.358127 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b32ba-0444-42d1-af54-1c599a59080a None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:10.358490 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b32ba-0444-42d1-af54-1c599a59080a None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:10.358781 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b32ba-0444-42d1-af54-1c599a59080a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:10.377509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-503b32ba-0444-42d1-af54-1c599a59080a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:10.378718 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-503b32ba-0444-42d1-af54-1c599a59080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:10.436945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1373/2780] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:40:10.445844 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f5b8-43b2-458d-ac7b-80f771d81a49 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:10.446129 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f5b8-43b2-458d-ac7b-80f771d81a49 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:10.446404 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f5b8-43b2-458d-ac7b-80f771d81a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:10.465707 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-bd08f5b8-43b2-458d-ac7b-80f771d81a49 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:10.466917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bd08f5b8-43b2-458d-ac7b-80f771d81a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:10.474839 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1408/2781] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:10.478936 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b32ba-0444-42d1-af54-1c599a59080a None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:10.488685 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b32ba-0444-42d1-af54-1c599a59080a None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:10.493445 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f9558-dd24-41e8-ae62-3bcf81a54b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:10.494158 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f9558-dd24-41e8-ae62-3bcf81a54b3c admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:10.494443 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f9558-dd24-41e8-ae62-3bcf81a54b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:10.494724 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f9558-dd24-41e8-ae62-3bcf81a54b3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:10.495456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f9558-dd24-41e8-ae62-3bcf81a54b3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:40:10.495790 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f9558-dd24-41e8-ae62-3bcf81a54b3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:10.497429 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f9558-dd24-41e8-ae62-3bcf81a54b3c admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:10.509648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1374/2782] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:40:10.513838 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08f5b8-43b2-458d-ac7b-80f771d81a49 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:10.523819 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08f5b8-43b2-458d-ac7b-80f771d81a49 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:10.528552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48de9c-9ebe-4085-b4f1-01c2d3b3b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:10.529448 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48de9c-9ebe-4085-b4f1-01c2d3b3b4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:10.529731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48de9c-9ebe-4085-b4f1-01c2d3b3b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:10.530009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48de9c-9ebe-4085-b4f1-01c2d3b3b4e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:10.530705 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48de9c-9ebe-4085-b4f1-01c2d3b3b4e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:10.532633 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48de9c-9ebe-4085-b4f1-01c2d3b3b4e4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:10.567883 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1409/2783] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:10 2022] POST /identity/v3/projects => generated 357 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:10.572000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f9558-dd24-41e8-ae62-3bcf81a54b3c admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:10.581828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f9558-dd24-41e8-ae62-3bcf81a54b3c admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:10.636356 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec074c-ecca-4fc0-b957-42a8aae1733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:10.637059 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec074c-ecca-4fc0-b957-42a8aae1733e admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:10.637352 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec074c-ecca-4fc0-b957-42a8aae1733e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:10.637629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec074c-ecca-4fc0-b957-42a8aae1733e admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:10.638319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec074c-ecca-4fc0-b957-42a8aae1733e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:10.640252 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec074c-ecca-4fc0-b957-42a8aae1733e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:10.658893 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1375/2784] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:10 2022] POST /identity/v3/users => generated 279 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:10.663002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48de9c-9ebe-4085-b4f1-01c2d3b3b4e4 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:10.673781 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48de9c-9ebe-4085-b4f1-01c2d3b3b4e4 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:10.678611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda5acd-4df2-4653-b3a1-baabb716a757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:10.679275 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5acd-4df2-4653-b3a1-baabb716a757 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:10.679561 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5acd-4df2-4653-b3a1-baabb716a757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:10.679840 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5acd-4df2-4653-b3a1-baabb716a757 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:10.680566 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda5acd-4df2-4653-b3a1-baabb716a757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:10.682281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda5acd-4df2-4653-b3a1-baabb716a757 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:10.693034 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1410/2785] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:10.696915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec074c-ecca-4fc0-b957-42a8aae1733e admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:10.706777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec074c-ecca-4fc0-b957-42a8aae1733e admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:10.711337 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464605d-931c-4b2a-8e37-0ef54931374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:10.711988 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464605d-931c-4b2a-8e37-0ef54931374f admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:10.712274 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464605d-931c-4b2a-8e37-0ef54931374f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:10.712552 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464605d-931c-4b2a-8e37-0ef54931374f admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:10.713309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464605d-931c-4b2a-8e37-0ef54931374f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:10.714884 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464605d-931c-4b2a-8e37-0ef54931374f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:10.724614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1376/2786] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:10.728507 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda5acd-4df2-4653-b3a1-baabb716a757 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:10.739165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda5acd-4df2-4653-b3a1-baabb716a757 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:10.743991 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c4736-a3ff-476c-93be-3fa75ed8632c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:10.744866 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c4736-a3ff-476c-93be-3fa75ed8632c admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:10.745197 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c4736-a3ff-476c-93be-3fa75ed8632c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:10.745505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c4736-a3ff-476c-93be-3fa75ed8632c admin admin] PATH_INFO: `/v3/projects/ed54babfd20c44dbb8a6e2cab27c1669/users/8fafa112c3774971911bfd33d0edb227/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:10.760370 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c4736-a3ff-476c-93be-3fa75ed8632c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed54babfd20c44dbb8a6e2cab27c1669, user_id=8fafa112c3774971911bfd33d0edb227, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:10.763035 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c4736-a3ff-476c-93be-3fa75ed8632c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:10.775540 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1411/2787] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:10 2022] PUT /identity/v3/projects/ed54babfd20c44dbb8a6e2cab27c1669/users/8fafa112c3774971911bfd33d0edb227/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:10.785864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a075c47-cfae-457d-be31-4a8ec6b02b47 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:10.786196 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a075c47-cfae-457d-be31-4a8ec6b02b47 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:10.786551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a075c47-cfae-457d-be31-4a8ec6b02b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:10.810593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:10.814362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-7a075c47-cfae-457d-be31-4a8ec6b02b47 None None] MFA Rules not processed for user `8fafa112c3774971911bfd33d0edb227`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:10.816346 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-7a075c47-cfae-457d-be31-4a8ec6b02b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:10.886303 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1377/2788] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:10 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:10.890897 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c4736-a3ff-476c-93be-3fa75ed8632c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:10.940474 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:10.955280 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c4736-a3ff-476c-93be-3fa75ed8632c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:10.959846 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7aa85-4a23-45de-90b6-17713360b2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:10.960525 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7aa85-4a23-45de-90b6-17713360b2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:10.960809 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7aa85-4a23-45de-90b6-17713360b2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:10.961115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7aa85-4a23-45de-90b6-17713360b2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:10.961801 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7aa85-4a23-45de-90b6-17713360b2f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:10.963938 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7aa85-4a23-45de-90b6-17713360b2f6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:10.989030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1412/2789] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:10 2022] POST /identity/v3/projects => generated 355 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:10.993261 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a075c47-cfae-457d-be31-4a8ec6b02b47 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:11.003885 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a075c47-cfae-457d-be31-4a8ec6b02b47 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:11.059675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ce43c-d612-4656-a75a-1e088a1bf6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:11.060263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ce43c-d612-4656-a75a-1e088a1bf6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:11.060547 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ce43c-d612-4656-a75a-1e088a1bf6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:11.060821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ce43c-d612-4656-a75a-1e088a1bf6f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:11.061531 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ce43c-d612-4656-a75a-1e088a1bf6f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:11.063439 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ce43c-d612-4656-a75a-1e088a1bf6f8 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:11.088197 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1378/2790] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:10 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:11.089385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7aa85-4a23-45de-90b6-17713360b2f6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:11.099998 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7aa85-4a23-45de-90b6-17713360b2f6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:11.104616 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e8844-96d7-4df0-8d92-a9cbdc33d697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:11.105301 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e8844-96d7-4df0-8d92-a9cbdc33d697 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:11.105584 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e8844-96d7-4df0-8d92-a9cbdc33d697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:11.105862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e8844-96d7-4df0-8d92-a9cbdc33d697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:11.106581 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e8844-96d7-4df0-8d92-a9cbdc33d697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:11.108191 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e8844-96d7-4df0-8d92-a9cbdc33d697 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:11.119121 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1413/2791] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:40:11.123423 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ce43c-d612-4656-a75a-1e088a1bf6f8 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:11.133506 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ce43c-d612-4656-a75a-1e088a1bf6f8 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:11.138112 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270182b-1ddf-4da7-8538-ba573e35ed2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:11.138991 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270182b-1ddf-4da7-8538-ba573e35ed2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:11.139279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270182b-1ddf-4da7-8538-ba573e35ed2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:11.139560 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270182b-1ddf-4da7-8538-ba573e35ed2f admin admin] PATH_INFO: `/v3/projects/12e1dacde7cc4c0882e653fc3da16c01/users/9553f4413cca4bdc8814e63b9409d34d/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:11.154209 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270182b-1ddf-4da7-8538-ba573e35ed2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e1dacde7cc4c0882e653fc3da16c01, user_id=9553f4413cca4bdc8814e63b9409d34d, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:11.156869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270182b-1ddf-4da7-8538-ba573e35ed2f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:11.169699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1379/2792] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:11 2022] PUT /identity/v3/projects/12e1dacde7cc4c0882e653fc3da16c01/users/9553f4413cca4bdc8814e63b9409d34d/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:11.174198 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e8844-96d7-4df0-8d92-a9cbdc33d697 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:11.183993 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e8844-96d7-4df0-8d92-a9cbdc33d697 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:11.239053 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f768f7-645d-45b4-9642-f5c26215caef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:11.239714 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f768f7-645d-45b4-9642-f5c26215caef admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:11.240001 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f768f7-645d-45b4-9642-f5c26215caef admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:11.240282 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f768f7-645d-45b4-9642-f5c26215caef admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:11.241034 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f768f7-645d-45b4-9642-f5c26215caef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:11.242635 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f768f7-645d-45b4-9642-f5c26215caef admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:11.252300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1414/2793] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:11.256462 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270182b-1ddf-4da7-8538-ba573e35ed2f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:11.266652 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270182b-1ddf-4da7-8538-ba573e35ed2f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:11.271204 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd73f82-5f56-4e76-999a-7d689f5fa0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:11.272087 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73f82-5f56-4e76-999a-7d689f5fa0aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:11.272375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73f82-5f56-4e76-999a-7d689f5fa0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:11.272658 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73f82-5f56-4e76-999a-7d689f5fa0aa admin admin] PATH_INFO: `/v3/projects/12e1dacde7cc4c0882e653fc3da16c01/users/9553f4413cca4bdc8814e63b9409d34d/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:11.274670 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd73f82-5f56-4e76-999a-7d689f5fa0aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e1dacde7cc4c0882e653fc3da16c01, user_id=9553f4413cca4bdc8814e63b9409d34d, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:11.277343 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd73f82-5f56-4e76-999a-7d689f5fa0aa admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:11.288130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1380/2794] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:11 2022] PUT /identity/v3/projects/12e1dacde7cc4c0882e653fc3da16c01/users/9553f4413cca4bdc8814e63b9409d34d/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:11.298762 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c12d2-0a15-426e-b66f-039bbafd4113 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:11.299059 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c12d2-0a15-426e-b66f-039bbafd4113 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:11.299370 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c12d2-0a15-426e-b66f-039bbafd4113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:11.325030 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c07c12d2-0a15-426e-b66f-039bbafd4113 None None] MFA Rules not processed for user `9553f4413cca4bdc8814e63b9409d34d`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:11.326177 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c07c12d2-0a15-426e-b66f-039bbafd4113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:11.393922 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1415/2795] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:11 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:40:11.405305 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd73f82-5f56-4e76-999a-7d689f5fa0aa admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:11.407116 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-3bd73f82-5f56-4e76-999a-7d689f5fa0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:11.464791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd73f82-5f56-4e76-999a-7d689f5fa0aa admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:11.468430 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582f2a4-b929-475f-b1fa-a520627635b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:11.469106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582f2a4-b929-475f-b1fa-a520627635b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:11.469392 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582f2a4-b929-475f-b1fa-a520627635b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:11.470289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582f2a4-b929-475f-b1fa-a520627635b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:11.479791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582f2a4-b929-475f-b1fa-a520627635b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:11.481250 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582f2a4-b929-475f-b1fa-a520627635b3 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:11.485240 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:11.492361 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1381/2796] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:11 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:11.562193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c12d2-0a15-426e-b66f-039bbafd4113 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:11.571862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c12d2-0a15-426e-b66f-039bbafd4113 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:11.575530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca7a24-2043-4cac-84e8-503225ed96f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:11.576137 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca7a24-2043-4cac-84e8-503225ed96f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:11.576429 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca7a24-2043-4cac-84e8-503225ed96f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:11.576710 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca7a24-2043-4cac-84e8-503225ed96f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:11.618453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:11.634193 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca7a24-2043-4cac-84e8-503225ed96f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:11.635641 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca7a24-2043-4cac-84e8-503225ed96f8 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:11.644911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1416/2797] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:11 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:21.492932 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:21.640427 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=8 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:26.227133 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582f2a4-b929-475f-b1fa-a520627635b3 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:26.288538 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582f2a4-b929-475f-b1fa-a520627635b3 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:26.293106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b2773-de65-485b-9043-1204e65b3dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:26.293958 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b2773-de65-485b-9043-1204e65b3dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:26.294242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b2773-de65-485b-9043-1204e65b3dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:26.294520 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b2773-de65-485b-9043-1204e65b3dfb admin admin] PATH_INFO: `/v3/users/8fafa112c3774971911bfd33d0edb227` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:26.295687 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b2773-de65-485b-9043-1204e65b3dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fafa112c3774971911bfd33d0edb227)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:26.297640 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b2773-de65-485b-9043-1204e65b3dfb admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:26.342907 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b84b2773-de65-485b-9043-1204e65b3dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fafa112c3774971911bfd33d0edb227'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:26.349509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b84b2773-de65-485b-9043-1204e65b3dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fafa112c3774971911bfd33d0edb227'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:26.350149 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b84b2773-de65-485b-9043-1204e65b3dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fafa112c3774971911bfd33d0edb227'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:26.361545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b84b2773-de65-485b-9043-1204e65b3dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fafa112c3774971911bfd33d0edb227'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:26.368363 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-b84b2773-de65-485b-9043-1204e65b3dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fafa112c3774971911bfd33d0edb227'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:26.374228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1382/2798] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:26 2022] DELETE /identity/v3/users/8fafa112c3774971911bfd33d0edb227 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:26.379247 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b6799-37cf-41d8-af3a-7da76e95b96c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:26.379725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b6799-37cf-41d8-af3a-7da76e95b96c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:26.379832 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b6799-37cf-41d8-af3a-7da76e95b96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:26.397509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f59b6799-37cf-41d8-af3a-7da76e95b96c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:26.398711 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f59b6799-37cf-41d8-af3a-7da76e95b96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:26.457964 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1417/2799] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:26.467639 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b2773-de65-485b-9043-1204e65b3dfb admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:26.468999 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-b84b2773-de65-485b-9043-1204e65b3dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:26.525962 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b2773-de65-485b-9043-1204e65b3dfb admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:26.530266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf742bb-af0d-4b4c-b242-ef69d748a1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:26.530924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf742bb-af0d-4b4c-b242-ef69d748a1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:26.531209 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf742bb-af0d-4b4c-b242-ef69d748a1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:26.531489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf742bb-af0d-4b4c-b242-ef69d748a1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:26.540997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf742bb-af0d-4b4c-b242-ef69d748a1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:26.542491 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf742bb-af0d-4b4c-b242-ef69d748a1e1 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:26.552097 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1383/2800] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:26.832877 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b6799-37cf-41d8-af3a-7da76e95b96c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:26.834749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f59b6799-37cf-41d8-af3a-7da76e95b96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:26.847054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b6799-37cf-41d8-af3a-7da76e95b96c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:26.853154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dca400-31e3-4c12-b662-4e61e3462c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:26.854144 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dca400-31e3-4c12-b662-4e61e3462c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:26.854519 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dca400-31e3-4c12-b662-4e61e3462c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:26.854860 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dca400-31e3-4c12-b662-4e61e3462c8b admin admin] PATH_INFO: `/v3/projects/ed54babfd20c44dbb8a6e2cab27c1669` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:26.856196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dca400-31e3-4c12-b662-4e61e3462c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed54babfd20c44dbb8a6e2cab27c1669)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:26.858612 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dca400-31e3-4c12-b662-4e61e3462c8b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:26.912186 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-44dca400-31e3-4c12-b662-4e61e3462c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed54babfd20c44dbb8a6e2cab27c1669', 'request_id': 'req-44dca400-31e3-4c12-b662-4e61e3462c8b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:26.918299 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-44dca400-31e3-4c12-b662-4e61e3462c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed54babfd20c44dbb8a6e2cab27c1669', 'request_id': 'req-44dca400-31e3-4c12-b662-4e61e3462c8b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:26.923699 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-44dca400-31e3-4c12-b662-4e61e3462c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed54babfd20c44dbb8a6e2cab27c1669', 'request_id': 'req-44dca400-31e3-4c12-b662-4e61e3462c8b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:26.937180 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-44dca400-31e3-4c12-b662-4e61e3462c8b admin admin] The token cache is being invalidate because project ed54babfd20c44dbb8a6e2cab27c1669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:26.937489 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-44dca400-31e3-4c12-b662-4e61e3462c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:26.938087 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-44dca400-31e3-4c12-b662-4e61e3462c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:26.939624 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1418/2801] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:26 2022] DELETE /identity/v3/projects/ed54babfd20c44dbb8a6e2cab27c1669 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:26.944413 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf742bb-af0d-4b4c-b242-ef69d748a1e1 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:26.954001 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf742bb-af0d-4b4c-b242-ef69d748a1e1 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:26.972258 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:27.011390 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1143a00-dbc3-4d77-a859-2d6060cd7eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:27.012187 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1143a00-dbc3-4d77-a859-2d6060cd7eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:27.012467 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1143a00-dbc3-4d77-a859-2d6060cd7eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:27.012742 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1143a00-dbc3-4d77-a859-2d6060cd7eb2 admin admin] PATH_INFO: `/v3/users/9553f4413cca4bdc8814e63b9409d34d` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:27.013942 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1143a00-dbc3-4d77-a859-2d6060cd7eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9553f4413cca4bdc8814e63b9409d34d)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:27.015853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1143a00-dbc3-4d77-a859-2d6060cd7eb2 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:27.060581 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c1143a00-dbc3-4d77-a859-2d6060cd7eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9553f4413cca4bdc8814e63b9409d34d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:27.067451 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c1143a00-dbc3-4d77-a859-2d6060cd7eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9553f4413cca4bdc8814e63b9409d34d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:27.068131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c1143a00-dbc3-4d77-a859-2d6060cd7eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9553f4413cca4bdc8814e63b9409d34d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:27.079793 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c1143a00-dbc3-4d77-a859-2d6060cd7eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9553f4413cca4bdc8814e63b9409d34d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:27.087319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c1143a00-dbc3-4d77-a859-2d6060cd7eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9553f4413cca4bdc8814e63b9409d34d'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:27.093263 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1384/2802] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:26 2022] DELETE /identity/v3/users/9553f4413cca4bdc8814e63b9409d34d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:40:27.360018 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dca400-31e3-4c12-b662-4e61e3462c8b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:27.361513 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-44dca400-31e3-4c12-b662-4e61e3462c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:27.376608 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dca400-31e3-4c12-b662-4e61e3462c8b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:27.433386 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62200f6b-4bbe-44a7-bca6-d809ac063dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:27.434244 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62200f6b-4bbe-44a7-bca6-d809ac063dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:27.434529 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62200f6b-4bbe-44a7-bca6-d809ac063dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:27.434806 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62200f6b-4bbe-44a7-bca6-d809ac063dbd admin admin] PATH_INFO: `/v3/projects/12e1dacde7cc4c0882e653fc3da16c01` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:27.435996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62200f6b-4bbe-44a7-bca6-d809ac063dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e1dacde7cc4c0882e653fc3da16c01)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:27.437975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62200f6b-4bbe-44a7-bca6-d809ac063dbd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:27.467421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:27.485484 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-62200f6b-4bbe-44a7-bca6-d809ac063dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e1dacde7cc4c0882e653fc3da16c01', 'request_id': 'req-62200f6b-4bbe-44a7-bca6-d809ac063dbd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:27.491494 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-62200f6b-4bbe-44a7-bca6-d809ac063dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e1dacde7cc4c0882e653fc3da16c01', 'request_id': 'req-62200f6b-4bbe-44a7-bca6-d809ac063dbd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:27.496901 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-62200f6b-4bbe-44a7-bca6-d809ac063dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e1dacde7cc4c0882e653fc3da16c01', 'request_id': 'req-62200f6b-4bbe-44a7-bca6-d809ac063dbd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:27.508975 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-62200f6b-4bbe-44a7-bca6-d809ac063dbd admin admin] The token cache is being invalidate because project 12e1dacde7cc4c0882e653fc3da16c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:27.509266 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-62200f6b-4bbe-44a7-bca6-d809ac063dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:27.509879 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-62200f6b-4bbe-44a7-bca6-d809ac063dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:27.511385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1419/2803] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:27 2022] DELETE /identity/v3/projects/12e1dacde7cc4c0882e653fc3da16c01 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:27.516312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342797-cd65-4276-a7a4-35977c716c8a None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:27.516804 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342797-cd65-4276-a7a4-35977c716c8a None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:27.516909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342797-cd65-4276-a7a4-35977c716c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:27.536108 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-39342797-cd65-4276-a7a4-35977c716c8a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:27.537269 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-39342797-cd65-4276-a7a4-35977c716c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:27.593314 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1385/2804] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:27.603460 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c757b0-963b-4724-8bf0-85699c7355a2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:27.603749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c757b0-963b-4724-8bf0-85699c7355a2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:27.604027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c757b0-963b-4724-8bf0-85699c7355a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:27.621716 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f9c757b0-963b-4724-8bf0-85699c7355a2 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:27.622894 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f9c757b0-963b-4724-8bf0-85699c7355a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:27.630625 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1420/2805] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:27.634676 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39342797-cd65-4276-a7a4-35977c716c8a None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:27.644113 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39342797-cd65-4276-a7a4-35977c716c8a None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:27.649152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00ea6d-647f-4d6d-8c27-5c9496323a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:27.649821 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00ea6d-647f-4d6d-8c27-5c9496323a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:27.650075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00ea6d-647f-4d6d-8c27-5c9496323a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:27.650347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00ea6d-647f-4d6d-8c27-5c9496323a89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:27.651067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00ea6d-647f-4d6d-8c27-5c9496323a89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:40:27.651370 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00ea6d-647f-4d6d-8c27-5c9496323a89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:27.652959 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00ea6d-647f-4d6d-8c27-5c9496323a89 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:27.664909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1386/2806] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:40:27.669027 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c757b0-963b-4724-8bf0-85699c7355a2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:27.678101 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c757b0-963b-4724-8bf0-85699c7355a2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:27.682685 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adac26-d652-4cfe-ad79-184a29d4819e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:27.683326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adac26-d652-4cfe-ad79-184a29d4819e admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:27.683611 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adac26-d652-4cfe-ad79-184a29d4819e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:27.683890 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adac26-d652-4cfe-ad79-184a29d4819e admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:27.684580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adac26-d652-4cfe-ad79-184a29d4819e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:27.686590 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adac26-d652-4cfe-ad79-184a29d4819e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:27.711019 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1421/2807] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:27 2022] POST /identity/v3/projects => generated 367 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:40:27.715360 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00ea6d-647f-4d6d-8c27-5c9496323a89 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:27.725882 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00ea6d-647f-4d6d-8c27-5c9496323a89 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:27.751007 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:27.783217 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215f464-fb10-4b3f-a606-6f5ebeb8969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:27.783878 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215f464-fb10-4b3f-a606-6f5ebeb8969d admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:27.784160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215f464-fb10-4b3f-a606-6f5ebeb8969d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:27.784434 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215f464-fb10-4b3f-a606-6f5ebeb8969d admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:27.785749 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215f464-fb10-4b3f-a606-6f5ebeb8969d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:27.787679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215f464-fb10-4b3f-a606-6f5ebeb8969d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:27.806606 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1387/2808] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:27 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:27.810770 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adac26-d652-4cfe-ad79-184a29d4819e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:27.821725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adac26-d652-4cfe-ad79-184a29d4819e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:27.826350 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94813e6-6b77-467e-805f-2872845954cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:27.827002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94813e6-6b77-467e-805f-2872845954cb admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:27.827282 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94813e6-6b77-467e-805f-2872845954cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:27.827556 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94813e6-6b77-467e-805f-2872845954cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:27.828271 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94813e6-6b77-467e-805f-2872845954cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:27.829882 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94813e6-6b77-467e-805f-2872845954cb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:27.840782 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1422/2809] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:27.844678 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215f464-fb10-4b3f-a606-6f5ebeb8969d admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:27.854754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215f464-fb10-4b3f-a606-6f5ebeb8969d admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:27.859354 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef3e26-9e6f-4e6f-a4bc-17ee3bee9efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:27.860005 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef3e26-9e6f-4e6f-a4bc-17ee3bee9efd admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:27.860289 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef3e26-9e6f-4e6f-a4bc-17ee3bee9efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:27.860565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef3e26-9e6f-4e6f-a4bc-17ee3bee9efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:27.861321 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef3e26-9e6f-4e6f-a4bc-17ee3bee9efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:27.862901 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef3e26-9e6f-4e6f-a4bc-17ee3bee9efd admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:27.872543 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1388/2810] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:27.876515 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94813e6-6b77-467e-805f-2872845954cb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:27.886651 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94813e6-6b77-467e-805f-2872845954cb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:27.891145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a9d13-4bd1-4df1-bac3-a3e6c9441963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:27.892043 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a9d13-4bd1-4df1-bac3-a3e6c9441963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:27.892326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a9d13-4bd1-4df1-bac3-a3e6c9441963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:27.892601 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a9d13-4bd1-4df1-bac3-a3e6c9441963 admin admin] PATH_INFO: `/v3/projects/9670dc0bf01442358bd936bc7af8d7d8/users/2563a0b17efc4f78a11be347f6b4a430/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:27.907430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a9d13-4bd1-4df1-bac3-a3e6c9441963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9670dc0bf01442358bd936bc7af8d7d8, user_id=2563a0b17efc4f78a11be347f6b4a430, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:27.910105 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a9d13-4bd1-4df1-bac3-a3e6c9441963 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:27.922434 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1423/2811] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:27 2022] PUT /identity/v3/projects/9670dc0bf01442358bd936bc7af8d7d8/users/2563a0b17efc4f78a11be347f6b4a430/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:27.932659 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df3fa3-84ad-4fdd-9efb-4ebe4d87e29f None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:27.933027 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df3fa3-84ad-4fdd-9efb-4ebe4d87e29f None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:27.933314 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df3fa3-84ad-4fdd-9efb-4ebe4d87e29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:27.961048 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-f6df3fa3-84ad-4fdd-9efb-4ebe4d87e29f None None] MFA Rules not processed for user `2563a0b17efc4f78a11be347f6b4a430`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:27.962297 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-f6df3fa3-84ad-4fdd-9efb-4ebe4d87e29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:28.025399 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1389/2812] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:28.030290 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a9d13-4bd1-4df1-bac3-a3e6c9441963 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:28.094358 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a9d13-4bd1-4df1-bac3-a3e6c9441963 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:28.099086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e29222-993b-4778-85cc-28518a07534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:28.099740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e29222-993b-4778-85cc-28518a07534b admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:28.100022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e29222-993b-4778-85cc-28518a07534b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:28.100297 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e29222-993b-4778-85cc-28518a07534b admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:28.101031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e29222-993b-4778-85cc-28518a07534b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:28.102924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e29222-993b-4778-85cc-28518a07534b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:28.126988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1424/2813] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:28 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:28.131818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df3fa3-84ad-4fdd-9efb-4ebe4d87e29f None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:28.142809 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df3fa3-84ad-4fdd-9efb-4ebe4d87e29f None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:28.198602 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2794ad-a323-48a0-aa93-681813fd324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:28.199267 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2794ad-a323-48a0-aa93-681813fd324c admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:28.199551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2794ad-a323-48a0-aa93-681813fd324c admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:28.199830 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2794ad-a323-48a0-aa93-681813fd324c admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:28.200515 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2794ad-a323-48a0-aa93-681813fd324c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:28.202440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2794ad-a323-48a0-aa93-681813fd324c admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:28.221509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1390/2814] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:28 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:28.229553 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e29222-993b-4778-85cc-28518a07534b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:28.241473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e29222-993b-4778-85cc-28518a07534b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:28.246316 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3036-3fa7-457a-bacd-da85d7c9955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:28.255999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3036-3fa7-457a-bacd-da85d7c9955e admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:28.255999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3036-3fa7-457a-bacd-da85d7c9955e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:28.255999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3036-3fa7-457a-bacd-da85d7c9955e admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:28.255999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e3036-3fa7-457a-bacd-da85d7c9955e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:28.255999 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e3036-3fa7-457a-bacd-da85d7c9955e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:28.261237 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1425/2815] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:28.265452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2794ad-a323-48a0-aa93-681813fd324c admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:28.277046 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2794ad-a323-48a0-aa93-681813fd324c admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:28.282888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cda18-97ac-4b70-ae8d-69bbaf7fadfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:28.284203 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cda18-97ac-4b70-ae8d-69bbaf7fadfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:28.284580 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cda18-97ac-4b70-ae8d-69bbaf7fadfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:28.284857 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cda18-97ac-4b70-ae8d-69bbaf7fadfb admin admin] PATH_INFO: `/v3/projects/9887c1e9934941a3bc40b69cb0813488/users/5231e84ee84545319c05753fa6d5acf5/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:28.304283 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cda18-97ac-4b70-ae8d-69bbaf7fadfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9887c1e9934941a3bc40b69cb0813488, user_id=5231e84ee84545319c05753fa6d5acf5, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:28.306949 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cda18-97ac-4b70-ae8d-69bbaf7fadfb admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:28.319835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1391/2816] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:28 2022] PUT /identity/v3/projects/9887c1e9934941a3bc40b69cb0813488/users/5231e84ee84545319c05753fa6d5acf5/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:28.323783 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3036-3fa7-457a-bacd-da85d7c9955e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:28.333723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3036-3fa7-457a-bacd-da85d7c9955e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:28.353281 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:28.391254 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f92f51-f3f0-4dae-b9d7-7d022615a279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:28.391914 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f92f51-f3f0-4dae-b9d7-7d022615a279 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:28.392196 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f92f51-f3f0-4dae-b9d7-7d022615a279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:28.392469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f92f51-f3f0-4dae-b9d7-7d022615a279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:28.393241 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f92f51-f3f0-4dae-b9d7-7d022615a279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:28.394924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f92f51-f3f0-4dae-b9d7-7d022615a279 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:28.405395 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1426/2817] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:28.409518 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cda18-97ac-4b70-ae8d-69bbaf7fadfb admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:28.414926 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:28.421148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cda18-97ac-4b70-ae8d-69bbaf7fadfb admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:28.426582 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799cc61-6469-4b22-9ff2-167af0cf48e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:28.427481 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799cc61-6469-4b22-9ff2-167af0cf48e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:28.427786 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799cc61-6469-4b22-9ff2-167af0cf48e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:28.428058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799cc61-6469-4b22-9ff2-167af0cf48e3 admin admin] PATH_INFO: `/v3/projects/9887c1e9934941a3bc40b69cb0813488/users/5231e84ee84545319c05753fa6d5acf5/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:28.430037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799cc61-6469-4b22-9ff2-167af0cf48e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9887c1e9934941a3bc40b69cb0813488, user_id=5231e84ee84545319c05753fa6d5acf5, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:28.432627 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799cc61-6469-4b22-9ff2-167af0cf48e3 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:28.443264 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1392/2818] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:28 2022] PUT /identity/v3/projects/9887c1e9934941a3bc40b69cb0813488/users/5231e84ee84545319c05753fa6d5acf5/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:28.454477 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b98322-5c19-43b7-baa9-ef5c60df3617 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:28.454971 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b98322-5c19-43b7-baa9-ef5c60df3617 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:28.455086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b98322-5c19-43b7-baa9-ef5c60df3617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:28.480721 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d7b98322-5c19-43b7-baa9-ef5c60df3617 None None] MFA Rules not processed for user `5231e84ee84545319c05753fa6d5acf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:28.481953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d7b98322-5c19-43b7-baa9-ef5c60df3617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:28.549453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1427/2819] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:28.561191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799cc61-6469-4b22-9ff2-167af0cf48e3 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:28.562928 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-6799cc61-6469-4b22-9ff2-167af0cf48e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:28.638103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799cc61-6469-4b22-9ff2-167af0cf48e3 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:28.641608 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8850f-7e94-4db3-aa93-a00bf99d95c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:28.642244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8850f-7e94-4db3-aa93-a00bf99d95c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:28.642525 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8850f-7e94-4db3-aa93-a00bf99d95c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:28.642800 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8850f-7e94-4db3-aa93-a00bf99d95c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:28.651457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8850f-7e94-4db3-aa93-a00bf99d95c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:28.652869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8850f-7e94-4db3-aa93-a00bf99d95c3 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:28.662823 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1393/2820] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:28.741421 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b98322-5c19-43b7-baa9-ef5c60df3617 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:28.751305 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b98322-5c19-43b7-baa9-ef5c60df3617 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:28.755058 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8288fb-563e-460b-a506-11a166543d27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:28.755706 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8288fb-563e-460b-a506-11a166543d27 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:28.755993 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8288fb-563e-460b-a506-11a166543d27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:28.756274 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8288fb-563e-460b-a506-11a166543d27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:28.811367 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8288fb-563e-460b-a506-11a166543d27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:28.812780 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8288fb-563e-460b-a506-11a166543d27 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:28.821748 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1428/2821] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:33.644271 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8850f-7e94-4db3-aa93-a00bf99d95c3 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:33.705704 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8850f-7e94-4db3-aa93-a00bf99d95c3 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:33.710181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78df47-7269-4389-9261-b664a7be633f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:33.711045 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78df47-7269-4389-9261-b664a7be633f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:33.711328 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78df47-7269-4389-9261-b664a7be633f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:33.711605 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78df47-7269-4389-9261-b664a7be633f admin admin] PATH_INFO: `/v3/users/2563a0b17efc4f78a11be347f6b4a430` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:33.712772 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78df47-7269-4389-9261-b664a7be633f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2563a0b17efc4f78a11be347f6b4a430)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:33.714798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78df47-7269-4389-9261-b664a7be633f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:33.759635 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0e78df47-7269-4389-9261-b664a7be633f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2563a0b17efc4f78a11be347f6b4a430'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:33.766231 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0e78df47-7269-4389-9261-b664a7be633f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2563a0b17efc4f78a11be347f6b4a430'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:33.766873 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0e78df47-7269-4389-9261-b664a7be633f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2563a0b17efc4f78a11be347f6b4a430'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:33.778288 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0e78df47-7269-4389-9261-b664a7be633f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2563a0b17efc4f78a11be347f6b4a430'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:33.786757 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-0e78df47-7269-4389-9261-b664a7be633f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2563a0b17efc4f78a11be347f6b4a430'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:33.792457 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1394/2822] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:33 2022] DELETE /identity/v3/users/2563a0b17efc4f78a11be347f6b4a430 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:33.796953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7bf9c-b6ed-42a0-b077-6c2b9f9d7346 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:33.797418 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7bf9c-b6ed-42a0-b077-6c2b9f9d7346 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:33.797562 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7bf9c-b6ed-42a0-b077-6c2b9f9d7346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:33.814872 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e7f7bf9c-b6ed-42a0-b077-6c2b9f9d7346 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:33.816046 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e7f7bf9c-b6ed-42a0-b077-6c2b9f9d7346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:33.854358 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:33.875887 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1429/2823] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:33.885776 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78df47-7269-4389-9261-b664a7be633f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:33.887186 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-0e78df47-7269-4389-9261-b664a7be633f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:33.900545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:33.945662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78df47-7269-4389-9261-b664a7be633f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:33.949304 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231b5f3-6766-40c3-b8b6-30729a67f0b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:33.949945 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231b5f3-6766-40c3-b8b6-30729a67f0b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:33.950226 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231b5f3-6766-40c3-b8b6-30729a67f0b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:33.950502 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231b5f3-6766-40c3-b8b6-30729a67f0b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:33.959415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231b5f3-6766-40c3-b8b6-30729a67f0b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:33.960834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231b5f3-6766-40c3-b8b6-30729a67f0b5 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:33.970872 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1395/2824] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:34.234203 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7bf9c-b6ed-42a0-b077-6c2b9f9d7346 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:34.235650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e7f7bf9c-b6ed-42a0-b077-6c2b9f9d7346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:34.247752 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7bf9c-b6ed-42a0-b077-6c2b9f9d7346 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:34.252488 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:34.253389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:34.253673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:34.253956 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2 admin admin] PATH_INFO: `/v3/projects/9670dc0bf01442358bd936bc7af8d7d8` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:34.255165 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9670dc0bf01442358bd936bc7af8d7d8)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:34.257229 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:34.303112 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9670dc0bf01442358bd936bc7af8d7d8', 'request_id': 'req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:34.309061 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9670dc0bf01442358bd936bc7af8d7d8', 'request_id': 'req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:34.314561 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9670dc0bf01442358bd936bc7af8d7d8', 'request_id': 'req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:34.326456 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2 admin admin] The token cache is being invalidate because project 9670dc0bf01442358bd936bc7af8d7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:34.326742 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:34.327346 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:34.328859 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1430/2825] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:34 2022] DELETE /identity/v3/projects/9670dc0bf01442358bd936bc7af8d7d8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:34.333505 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231b5f3-6766-40c3-b8b6-30729a67f0b5 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:34.343273 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231b5f3-6766-40c3-b8b6-30729a67f0b5 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:34.398607 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41d0ad-617e-44c0-acb7-cb2612b9cf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:34.399476 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41d0ad-617e-44c0-acb7-cb2612b9cf79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:34.399760 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41d0ad-617e-44c0-acb7-cb2612b9cf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:34.400037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41d0ad-617e-44c0-acb7-cb2612b9cf79 admin admin] PATH_INFO: `/v3/users/5231e84ee84545319c05753fa6d5acf5` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:34.401236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41d0ad-617e-44c0-acb7-cb2612b9cf79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5231e84ee84545319c05753fa6d5acf5)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:34.403142 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41d0ad-617e-44c0-acb7-cb2612b9cf79 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:34.448000 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-1d41d0ad-617e-44c0-acb7-cb2612b9cf79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5231e84ee84545319c05753fa6d5acf5'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:34.454752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-1d41d0ad-617e-44c0-acb7-cb2612b9cf79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5231e84ee84545319c05753fa6d5acf5'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:34.455440 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-1d41d0ad-617e-44c0-acb7-cb2612b9cf79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5231e84ee84545319c05753fa6d5acf5'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:34.467500 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-1d41d0ad-617e-44c0-acb7-cb2612b9cf79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5231e84ee84545319c05753fa6d5acf5'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:34.475584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-1d41d0ad-617e-44c0-acb7-cb2612b9cf79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5231e84ee84545319c05753fa6d5acf5'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:34.481553 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1396/2826] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:34 2022] DELETE /identity/v3/users/5231e84ee84545319c05753fa6d5acf5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:34.750463 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:34.751912 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:34.767199 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a42a15-c3b9-4ade-bdd9-0ee33f4e29c2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:34.822723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e06f6-59af-43ce-af4c-9f2b23cb43ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:34.823577 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e06f6-59af-43ce-af4c-9f2b23cb43ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:34.823862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e06f6-59af-43ce-af4c-9f2b23cb43ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:34.824139 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e06f6-59af-43ce-af4c-9f2b23cb43ad admin admin] PATH_INFO: `/v3/projects/9887c1e9934941a3bc40b69cb0813488` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:34.825338 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e06f6-59af-43ce-af4c-9f2b23cb43ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=9887c1e9934941a3bc40b69cb0813488)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:34.827238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e06f6-59af-43ce-af4c-9f2b23cb43ad admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:34.871119 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-392e06f6-59af-43ce-af4c-9f2b23cb43ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9887c1e9934941a3bc40b69cb0813488', 'request_id': 'req-392e06f6-59af-43ce-af4c-9f2b23cb43ad'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:34.876994 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-392e06f6-59af-43ce-af4c-9f2b23cb43ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9887c1e9934941a3bc40b69cb0813488', 'request_id': 'req-392e06f6-59af-43ce-af4c-9f2b23cb43ad'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:34.882912 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-392e06f6-59af-43ce-af4c-9f2b23cb43ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9887c1e9934941a3bc40b69cb0813488', 'request_id': 'req-392e06f6-59af-43ce-af4c-9f2b23cb43ad'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:34.890807 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:34.896244 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-392e06f6-59af-43ce-af4c-9f2b23cb43ad admin admin] The token cache is being invalidate because project 9887c1e9934941a3bc40b69cb0813488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:34.896733 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-392e06f6-59af-43ce-af4c-9f2b23cb43ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:34.897802 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-392e06f6-59af-43ce-af4c-9f2b23cb43ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:34.899438 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1431/2827] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:34 2022] DELETE /identity/v3/projects/9887c1e9934941a3bc40b69cb0813488 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:34.904679 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e054a-3f65-4532-abcd-25988f537881 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:34.905191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e054a-3f65-4532-abcd-25988f537881 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:34.905294 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e054a-3f65-4532-abcd-25988f537881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:34.923238 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-c30e054a-3f65-4532-abcd-25988f537881 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:34.924444 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c30e054a-3f65-4532-abcd-25988f537881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:34.954065 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:34.985012 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1397/2828] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:40:34.993666 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ef516-8085-48b7-b243-e99a506a1da3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:34.993961 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ef516-8085-48b7-b243-e99a506a1da3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:34.994270 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ef516-8085-48b7-b243-e99a506a1da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:35.012667 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-bd2ef516-8085-48b7-b243-e99a506a1da3 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:35.013884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bd2ef516-8085-48b7-b243-e99a506a1da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:35.021687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1432/2829] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:35.025783 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e054a-3f65-4532-abcd-25988f537881 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:35.035348 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e054a-3f65-4532-abcd-25988f537881 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:35.039764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18eac66-7341-4693-9088-7fbe7a94d009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:35.040405 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18eac66-7341-4693-9088-7fbe7a94d009 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:35.040688 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18eac66-7341-4693-9088-7fbe7a94d009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:35.040988 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18eac66-7341-4693-9088-7fbe7a94d009 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:35.041707 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18eac66-7341-4693-9088-7fbe7a94d009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:40:35.042035 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18eac66-7341-4693-9088-7fbe7a94d009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:35.043614 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18eac66-7341-4693-9088-7fbe7a94d009 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:35.055246 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1398/2830] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:40:35.059453 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ef516-8085-48b7-b243-e99a506a1da3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:35.069383 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ef516-8085-48b7-b243-e99a506a1da3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:35.074009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ca8a6-5738-4485-beb0-53f9443dd3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:35.074661 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ca8a6-5738-4485-beb0-53f9443dd3dc admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:35.074945 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ca8a6-5738-4485-beb0-53f9443dd3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:35.075221 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ca8a6-5738-4485-beb0-53f9443dd3dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:35.075981 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ca8a6-5738-4485-beb0-53f9443dd3dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:35.078232 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ca8a6-5738-4485-beb0-53f9443dd3dc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:35.102764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1433/2831] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:35 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:35.106736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18eac66-7341-4693-9088-7fbe7a94d009 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:35.116860 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18eac66-7341-4693-9088-7fbe7a94d009 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:35.171915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa24b6-6a05-4151-b841-2f3f45015339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:35.172572 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa24b6-6a05-4151-b841-2f3f45015339 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:35.172853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa24b6-6a05-4151-b841-2f3f45015339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:35.173156 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa24b6-6a05-4151-b841-2f3f45015339 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:35.173839 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa24b6-6a05-4151-b841-2f3f45015339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:35.175720 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa24b6-6a05-4151-b841-2f3f45015339 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:35.195854 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1399/2832] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:35 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:40:35.199988 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ca8a6-5738-4485-beb0-53f9443dd3dc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:35.210059 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ca8a6-5738-4485-beb0-53f9443dd3dc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:35.214596 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adc0a4-7368-4288-9999-af8fdf4c4f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:35.215248 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adc0a4-7368-4288-9999-af8fdf4c4f2f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:35.215528 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adc0a4-7368-4288-9999-af8fdf4c4f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:35.215803 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adc0a4-7368-4288-9999-af8fdf4c4f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:35.216524 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adc0a4-7368-4288-9999-af8fdf4c4f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:35.218135 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adc0a4-7368-4288-9999-af8fdf4c4f2f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:35.228240 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1434/2833] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:35.231850 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa24b6-6a05-4151-b841-2f3f45015339 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:35.242165 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa24b6-6a05-4151-b841-2f3f45015339 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:35.246808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67402379-3f18-461d-a43c-796a087c5f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:35.247452 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67402379-3f18-461d-a43c-796a087c5f5d admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:35.247736 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67402379-3f18-461d-a43c-796a087c5f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:35.248013 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67402379-3f18-461d-a43c-796a087c5f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:35.248752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67402379-3f18-461d-a43c-796a087c5f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:35.250754 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67402379-3f18-461d-a43c-796a087c5f5d admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:35.260985 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1400/2834] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 22:40:35.264917 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adc0a4-7368-4288-9999-af8fdf4c4f2f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:35.274539 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adc0a4-7368-4288-9999-af8fdf4c4f2f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:35.279033 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009becf-ccd4-4ae2-918b-03cf3cc438d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:35.280149 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009becf-ccd4-4ae2-918b-03cf3cc438d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:35.280425 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009becf-ccd4-4ae2-918b-03cf3cc438d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:35.280695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009becf-ccd4-4ae2-918b-03cf3cc438d0 admin admin] PATH_INFO: `/v3/projects/67da9d07fc51429bbcf6ba60f5c2ebc6/users/ef74eaa3c19c40a4b08397414d6a59ad/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:35.295144 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009becf-ccd4-4ae2-918b-03cf3cc438d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67da9d07fc51429bbcf6ba60f5c2ebc6, user_id=ef74eaa3c19c40a4b08397414d6a59ad, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:35.297792 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009becf-ccd4-4ae2-918b-03cf3cc438d0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:35.310799 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1435/2835] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:35 2022] PUT /identity/v3/projects/67da9d07fc51429bbcf6ba60f5c2ebc6/users/ef74eaa3c19c40a4b08397414d6a59ad/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:40:35.320886 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5acd83-2114-4c8d-af5e-a0bc888ca9fe None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:35.321205 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5acd83-2114-4c8d-af5e-a0bc888ca9fe None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:35.321508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5acd83-2114-4c8d-af5e-a0bc888ca9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:35.346777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-df5acd83-2114-4c8d-af5e-a0bc888ca9fe None None] MFA Rules not processed for user `ef74eaa3c19c40a4b08397414d6a59ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:35.348455 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-df5acd83-2114-4c8d-af5e-a0bc888ca9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:35.411847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1401/2836] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:35.416253 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009becf-ccd4-4ae2-918b-03cf3cc438d0 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:35.476878 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009becf-ccd4-4ae2-918b-03cf3cc438d0 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:35.481457 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf975e2-db5d-4be9-896e-64e73f323d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:35.482103 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf975e2-db5d-4be9-896e-64e73f323d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:35.482386 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf975e2-db5d-4be9-896e-64e73f323d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:35.482663 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf975e2-db5d-4be9-896e-64e73f323d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:35.483351 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf975e2-db5d-4be9-896e-64e73f323d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:35.485263 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf975e2-db5d-4be9-896e-64e73f323d96 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:35.510675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1436/2837] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:35 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:35.514768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5acd83-2114-4c8d-af5e-a0bc888ca9fe None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:35.525325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5acd83-2114-4c8d-af5e-a0bc888ca9fe None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:35.553375 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:35.584061 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c919a4-3a9d-4ea9-bb44-be4be8997d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:35.584722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c919a4-3a9d-4ea9-bb44-be4be8997d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:35.585037 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c919a4-3a9d-4ea9-bb44-be4be8997d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:35.585312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c919a4-3a9d-4ea9-bb44-be4be8997d4b admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:35.585998 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c919a4-3a9d-4ea9-bb44-be4be8997d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:35.587890 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c919a4-3a9d-4ea9-bb44-be4be8997d4b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:35.607143 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1402/2838] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:35 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:40:35.611185 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf975e2-db5d-4be9-896e-64e73f323d96 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:35.622202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf975e2-db5d-4be9-896e-64e73f323d96 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:35.626795 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abab717-90ec-4353-8f18-e749b28e5d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:35.627447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abab717-90ec-4353-8f18-e749b28e5d4f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:35.627731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abab717-90ec-4353-8f18-e749b28e5d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:35.628009 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abab717-90ec-4353-8f18-e749b28e5d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:35.628726 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abab717-90ec-4353-8f18-e749b28e5d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:35.630389 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abab717-90ec-4353-8f18-e749b28e5d4f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:35.640758 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1437/2839] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:35.645160 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c919a4-3a9d-4ea9-bb44-be4be8997d4b admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:35.655159 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c919a4-3a9d-4ea9-bb44-be4be8997d4b admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:35.659702 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8453dfa-3be3-4c6f-945a-7415084adda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:35.661216 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8453dfa-3be3-4c6f-945a-7415084adda8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:35.661495 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8453dfa-3be3-4c6f-945a-7415084adda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:35.661766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8453dfa-3be3-4c6f-945a-7415084adda8 admin admin] PATH_INFO: `/v3/projects/45e689228c3449d4b7032a45a7ea59d6/users/7961e94be5a345fe905f596a1a5a67b0/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:35.676319 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8453dfa-3be3-4c6f-945a-7415084adda8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e689228c3449d4b7032a45a7ea59d6, user_id=7961e94be5a345fe905f596a1a5a67b0, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:35.678915 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8453dfa-3be3-4c6f-945a-7415084adda8 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:35.690922 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1403/2840] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:35 2022] PUT /identity/v3/projects/45e689228c3449d4b7032a45a7ea59d6/users/7961e94be5a345fe905f596a1a5a67b0/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:40:35.694763 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abab717-90ec-4353-8f18-e749b28e5d4f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:35.704913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abab717-90ec-4353-8f18-e749b28e5d4f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:35.759495 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedaa8fb-050a-49f0-bc9c-2c7d618ed469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:35.760154 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedaa8fb-050a-49f0-bc9c-2c7d618ed469 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:35.760437 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedaa8fb-050a-49f0-bc9c-2c7d618ed469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:35.760714 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedaa8fb-050a-49f0-bc9c-2c7d618ed469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:35.761503 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedaa8fb-050a-49f0-bc9c-2c7d618ed469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:35.763092 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedaa8fb-050a-49f0-bc9c-2c7d618ed469 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:35.773215 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1438/2841] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:35.777326 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8453dfa-3be3-4c6f-945a-7415084adda8 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:35.788127 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8453dfa-3be3-4c6f-945a-7415084adda8 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:35.792657 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764d57e-5d7c-4493-826d-c0914b2a2d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:35.793559 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764d57e-5d7c-4493-826d-c0914b2a2d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:35.793846 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764d57e-5d7c-4493-826d-c0914b2a2d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:35.794124 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764d57e-5d7c-4493-826d-c0914b2a2d11 admin admin] PATH_INFO: `/v3/projects/45e689228c3449d4b7032a45a7ea59d6/users/7961e94be5a345fe905f596a1a5a67b0/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:35.796115 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764d57e-5d7c-4493-826d-c0914b2a2d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e689228c3449d4b7032a45a7ea59d6, user_id=7961e94be5a345fe905f596a1a5a67b0, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:35.798769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764d57e-5d7c-4493-826d-c0914b2a2d11 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:35.808778 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1404/2842] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:35 2022] PUT /identity/v3/projects/45e689228c3449d4b7032a45a7ea59d6/users/7961e94be5a345fe905f596a1a5a67b0/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:35.870234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41bbf2-a781-40fe-aef4-40ecf42a81fc None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:35.870812 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41bbf2-a781-40fe-aef4-40ecf42a81fc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:35.870812 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41bbf2-a781-40fe-aef4-40ecf42a81fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:35.877787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:35.897804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8b41bbf2-a781-40fe-aef4-40ecf42a81fc None None] MFA Rules not processed for user `7961e94be5a345fe905f596a1a5a67b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:35.899022 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8b41bbf2-a781-40fe-aef4-40ecf42a81fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:35.964430 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1439/2843] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:35.977098 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764d57e-5d7c-4493-826d-c0914b2a2d11 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:35.978851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-8764d57e-5d7c-4493-826d-c0914b2a2d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:36.036651 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764d57e-5d7c-4493-826d-c0914b2a2d11 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:36.040331 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892ac63-6958-486d-8008-5b9c0655eb4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:36.040978 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892ac63-6958-486d-8008-5b9c0655eb4c service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:36.041269 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892ac63-6958-486d-8008-5b9c0655eb4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:36.041551 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892ac63-6958-486d-8008-5b9c0655eb4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:36.050480 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892ac63-6958-486d-8008-5b9c0655eb4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:36.051951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892ac63-6958-486d-8008-5b9c0655eb4c service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:36.061545 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1405/2844] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:36.130317 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41bbf2-a781-40fe-aef4-40ecf42a81fc None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:36.139774 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41bbf2-a781-40fe-aef4-40ecf42a81fc None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:36.143330 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016fe66-9a62-4138-8b4d-a0afc1215a0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:36.143964 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016fe66-9a62-4138-8b4d-a0afc1215a0d service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:36.144262 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016fe66-9a62-4138-8b4d-a0afc1215a0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:36.144534 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016fe66-9a62-4138-8b4d-a0afc1215a0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:36.200303 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016fe66-9a62-4138-8b4d-a0afc1215a0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:36.201764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016fe66-9a62-4138-8b4d-a0afc1215a0d service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:36.210906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1440/2845] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:36.463161 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892ac63-6958-486d-8008-5b9c0655eb4c service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:36.524539 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892ac63-6958-486d-8008-5b9c0655eb4c service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:36.529102 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27a5c5-91a4-4986-831f-17a8a6a4b7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:36.530229 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27a5c5-91a4-4986-831f-17a8a6a4b7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:36.530510 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27a5c5-91a4-4986-831f-17a8a6a4b7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:36.530785 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27a5c5-91a4-4986-831f-17a8a6a4b7b6 admin admin] PATH_INFO: `/v3/users/ef74eaa3c19c40a4b08397414d6a59ad` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:36.531993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27a5c5-91a4-4986-831f-17a8a6a4b7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef74eaa3c19c40a4b08397414d6a59ad)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:36.533935 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27a5c5-91a4-4986-831f-17a8a6a4b7b6 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:36.561197 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:36.580769 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-aa27a5c5-91a4-4986-831f-17a8a6a4b7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef74eaa3c19c40a4b08397414d6a59ad'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:36.587478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-aa27a5c5-91a4-4986-831f-17a8a6a4b7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef74eaa3c19c40a4b08397414d6a59ad'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:36.588121 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-aa27a5c5-91a4-4986-831f-17a8a6a4b7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef74eaa3c19c40a4b08397414d6a59ad'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:36.599808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-aa27a5c5-91a4-4986-831f-17a8a6a4b7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef74eaa3c19c40a4b08397414d6a59ad'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:36.606848 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-aa27a5c5-91a4-4986-831f-17a8a6a4b7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef74eaa3c19c40a4b08397414d6a59ad'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:36.612544 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1406/2846] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:36 2022] DELETE /identity/v3/users/ef74eaa3c19c40a4b08397414d6a59ad => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:36.617681 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f0de4-3f24-4598-9c1d-e89ead44dc4c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:36.618044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f0de4-3f24-4598-9c1d-e89ead44dc4c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:36.618332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f0de4-3f24-4598-9c1d-e89ead44dc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:36.636130 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a47f0de4-3f24-4598-9c1d-e89ead44dc4c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:36.637357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a47f0de4-3f24-4598-9c1d-e89ead44dc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:36.694676 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1441/2847] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:36.704206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27a5c5-91a4-4986-831f-17a8a6a4b7b6 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:36.705629 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-aa27a5c5-91a4-4986-831f-17a8a6a4b7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:36.763927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27a5c5-91a4-4986-831f-17a8a6a4b7b6 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:36.767631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb7ae6-ac35-43b8-bd33-d3e70ae7cf44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:36.768224 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb7ae6-ac35-43b8-bd33-d3e70ae7cf44 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:36.768508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb7ae6-ac35-43b8-bd33-d3e70ae7cf44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:36.768786 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb7ae6-ac35-43b8-bd33-d3e70ae7cf44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:36.777644 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb7ae6-ac35-43b8-bd33-d3e70ae7cf44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:36.779075 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb7ae6-ac35-43b8-bd33-d3e70ae7cf44 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:36.789166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1407/2848] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:37.064414 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f0de4-3f24-4598-9c1d-e89ead44dc4c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:37.065140 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a47f0de4-3f24-4598-9c1d-e89ead44dc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:37.083222 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f0de4-3f24-4598-9c1d-e89ead44dc4c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:37.088567 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727973c9-5b3b-4d0c-82e0-230d0308fed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:37.089478 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727973c9-5b3b-4d0c-82e0-230d0308fed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:37.089764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727973c9-5b3b-4d0c-82e0-230d0308fed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:37.090044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727973c9-5b3b-4d0c-82e0-230d0308fed7 admin admin] PATH_INFO: `/v3/projects/67da9d07fc51429bbcf6ba60f5c2ebc6` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:37.091247 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727973c9-5b3b-4d0c-82e0-230d0308fed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67da9d07fc51429bbcf6ba60f5c2ebc6)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:37.093272 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727973c9-5b3b-4d0c-82e0-230d0308fed7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:37.118095 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:37.142561 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-727973c9-5b3b-4d0c-82e0-230d0308fed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67da9d07fc51429bbcf6ba60f5c2ebc6', 'request_id': 'req-727973c9-5b3b-4d0c-82e0-230d0308fed7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:37.149252 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-727973c9-5b3b-4d0c-82e0-230d0308fed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67da9d07fc51429bbcf6ba60f5c2ebc6', 'request_id': 'req-727973c9-5b3b-4d0c-82e0-230d0308fed7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:37.155299 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-727973c9-5b3b-4d0c-82e0-230d0308fed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67da9d07fc51429bbcf6ba60f5c2ebc6', 'request_id': 'req-727973c9-5b3b-4d0c-82e0-230d0308fed7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:37.167589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-727973c9-5b3b-4d0c-82e0-230d0308fed7 admin admin] The token cache is being invalidate because project 67da9d07fc51429bbcf6ba60f5c2ebc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:37.167903 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-727973c9-5b3b-4d0c-82e0-230d0308fed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:37.168530 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-727973c9-5b3b-4d0c-82e0-230d0308fed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:37.170103 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1442/2849] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:37 2022] DELETE /identity/v3/projects/67da9d07fc51429bbcf6ba60f5c2ebc6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:37.174077 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb7ae6-ac35-43b8-bd33-d3e70ae7cf44 service neutron] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:37.184044 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb7ae6-ac35-43b8-bd33-d3e70ae7cf44 service neutron] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:37.237342 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447fd00-b96e-439a-bc37-f4eb7e6dbf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:37.238206 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447fd00-b96e-439a-bc37-f4eb7e6dbf54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:37.238989 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447fd00-b96e-439a-bc37-f4eb7e6dbf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:37.239249 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447fd00-b96e-439a-bc37-f4eb7e6dbf54 admin admin] PATH_INFO: `/v3/users/7961e94be5a345fe905f596a1a5a67b0` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:37.240410 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447fd00-b96e-439a-bc37-f4eb7e6dbf54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7961e94be5a345fe905f596a1a5a67b0)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:37.242336 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447fd00-b96e-439a-bc37-f4eb7e6dbf54 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:37.286954 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5447fd00-b96e-439a-bc37-f4eb7e6dbf54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7961e94be5a345fe905f596a1a5a67b0'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:37.288038 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:37.296859 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5447fd00-b96e-439a-bc37-f4eb7e6dbf54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7961e94be5a345fe905f596a1a5a67b0'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:37.297543 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5447fd00-b96e-439a-bc37-f4eb7e6dbf54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7961e94be5a345fe905f596a1a5a67b0'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:37.309616 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5447fd00-b96e-439a-bc37-f4eb7e6dbf54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7961e94be5a345fe905f596a1a5a67b0'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:37.317316 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-5447fd00-b96e-439a-bc37-f4eb7e6dbf54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7961e94be5a345fe905f596a1a5a67b0'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:37.323089 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1408/2850] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:37 2022] DELETE /identity/v3/users/7961e94be5a345fe905f596a1a5a67b0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:37.600482 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727973c9-5b3b-4d0c-82e0-230d0308fed7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:37.601953 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-727973c9-5b3b-4d0c-82e0-230d0308fed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:37.617508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727973c9-5b3b-4d0c-82e0-230d0308fed7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:37.674908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2a2b7-c28e-42f5-9490-aa30203f8a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:37.675768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2a2b7-c28e-42f5-9490-aa30203f8a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:37.676613 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2a2b7-c28e-42f5-9490-aa30203f8a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:37.676892 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2a2b7-c28e-42f5-9490-aa30203f8a0a admin admin] PATH_INFO: `/v3/projects/45e689228c3449d4b7032a45a7ea59d6` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:37.678100 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2a2b7-c28e-42f5-9490-aa30203f8a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e689228c3449d4b7032a45a7ea59d6)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:37.680023 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2a2b7-c28e-42f5-9490-aa30203f8a0a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:37.726327 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c8e2a2b7-c28e-42f5-9490-aa30203f8a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e689228c3449d4b7032a45a7ea59d6', 'request_id': 'req-c8e2a2b7-c28e-42f5-9490-aa30203f8a0a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:37.733734 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c8e2a2b7-c28e-42f5-9490-aa30203f8a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e689228c3449d4b7032a45a7ea59d6', 'request_id': 'req-c8e2a2b7-c28e-42f5-9490-aa30203f8a0a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:37.739892 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c8e2a2b7-c28e-42f5-9490-aa30203f8a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e689228c3449d4b7032a45a7ea59d6', 'request_id': 'req-c8e2a2b7-c28e-42f5-9490-aa30203f8a0a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:37.753246 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c8e2a2b7-c28e-42f5-9490-aa30203f8a0a admin admin] The token cache is being invalidate because project 45e689228c3449d4b7032a45a7ea59d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:37.753531 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c8e2a2b7-c28e-42f5-9490-aa30203f8a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:37.754181 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c8e2a2b7-c28e-42f5-9490-aa30203f8a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:37.755695 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1443/2851] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:37 2022] DELETE /identity/v3/projects/45e689228c3449d4b7032a45a7ea59d6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:37.760634 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86547d-0e3c-4a94-9c02-5c3bc2115c7c None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:37.760951 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86547d-0e3c-4a94-9c02-5c3bc2115c7c None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:37.761228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86547d-0e3c-4a94-9c02-5c3bc2115c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:37.779148 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-4c86547d-0e3c-4a94-9c02-5c3bc2115c7c None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:37.780595 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4c86547d-0e3c-4a94-9c02-5c3bc2115c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:37.838528 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1409/2852] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:37.846377 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f8108-48a8-407c-8689-9b5c948ff85b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:37.846662 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f8108-48a8-407c-8689-9b5c948ff85b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:37.846941 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f8108-48a8-407c-8689-9b5c948ff85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:37.865683 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-605f8108-48a8-407c-8689-9b5c948ff85b None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:37.866861 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-605f8108-48a8-407c-8689-9b5c948ff85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:37.874584 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1444/2853] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:37.878509 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86547d-0e3c-4a94-9c02-5c3bc2115c7c None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:37.887937 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86547d-0e3c-4a94-9c02-5c3bc2115c7c None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:37.892558 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851393a-1000-4674-ac54-f2b1827ac6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:37.893248 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851393a-1000-4674-ac54-f2b1827ac6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:37.893530 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851393a-1000-4674-ac54-f2b1827ac6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:37.893810 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851393a-1000-4674-ac54-f2b1827ac6c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:37.894536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851393a-1000-4674-ac54-f2b1827ac6c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:40:37.895327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851393a-1000-4674-ac54-f2b1827ac6c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:37.896901 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851393a-1000-4674-ac54-f2b1827ac6c9 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:37.908451 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1410/2854] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:40:37.913221 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f8108-48a8-407c-8689-9b5c948ff85b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:37.922308 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f8108-48a8-407c-8689-9b5c948ff85b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:37.926930 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18296a7-1b56-484c-9441-946eca956702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:37.927568 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18296a7-1b56-484c-9441-946eca956702 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:37.927852 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18296a7-1b56-484c-9441-946eca956702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:37.928130 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18296a7-1b56-484c-9441-946eca956702 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:37.928812 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18296a7-1b56-484c-9441-946eca956702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:37.930731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18296a7-1b56-484c-9441-946eca956702 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:37.955407 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1445/2855] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:37 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:37.959675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851393a-1000-4674-ac54-f2b1827ac6c9 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:37.971090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851393a-1000-4674-ac54-f2b1827ac6c9 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:38.027411 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e1da2-7133-4cd9-aa7f-340a4ad8cef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:38.028079 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e1da2-7133-4cd9-aa7f-340a4ad8cef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:38.028362 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e1da2-7133-4cd9-aa7f-340a4ad8cef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:38.028638 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e1da2-7133-4cd9-aa7f-340a4ad8cef0 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:38.029347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e1da2-7133-4cd9-aa7f-340a4ad8cef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:38.031497 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e1da2-7133-4cd9-aa7f-340a4ad8cef0 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:38.051035 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1411/2856] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:37 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:38.055332 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18296a7-1b56-484c-9441-946eca956702 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:38.065768 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18296a7-1b56-484c-9441-946eca956702 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:38.070447 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec89b4c-4693-42a0-9c1a-ef6b275ec288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:38.071117 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec89b4c-4693-42a0-9c1a-ef6b275ec288 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:38.071401 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec89b4c-4693-42a0-9c1a-ef6b275ec288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:38.071679 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec89b4c-4693-42a0-9c1a-ef6b275ec288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:38.072438 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec89b4c-4693-42a0-9c1a-ef6b275ec288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:38.074085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec89b4c-4693-42a0-9c1a-ef6b275ec288 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:38.087115 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1446/2857] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:38.091141 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e1da2-7133-4cd9-aa7f-340a4ad8cef0 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:38.101501 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e1da2-7133-4cd9-aa7f-340a4ad8cef0 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:38.106238 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda363b-e5e0-467d-9b5c-14c796fd75f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:38.106925 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda363b-e5e0-467d-9b5c-14c796fd75f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:38.107213 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda363b-e5e0-467d-9b5c-14c796fd75f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:38.107486 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda363b-e5e0-467d-9b5c-14c796fd75f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:38.108216 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda363b-e5e0-467d-9b5c-14c796fd75f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:38.109858 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda363b-e5e0-467d-9b5c-14c796fd75f4 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:38.119704 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1412/2858] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:38.123755 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec89b4c-4693-42a0-9c1a-ef6b275ec288 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:38.128817 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:38.135526 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec89b4c-4693-42a0-9c1a-ef6b275ec288 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:38.141475 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04821ea0-7550-4818-88dc-675b7be2b2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:38.142354 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04821ea0-7550-4818-88dc-675b7be2b2e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:38.142642 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04821ea0-7550-4818-88dc-675b7be2b2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:38.142924 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04821ea0-7550-4818-88dc-675b7be2b2e5 admin admin] PATH_INFO: `/v3/projects/2bb9ce8cf8c442cfa6effa49a4cfe114/users/ba44d87af1fa43f58d1cb6b4f28941ad/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:38.158552 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04821ea0-7550-4818-88dc-675b7be2b2e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb9ce8cf8c442cfa6effa49a4cfe114, user_id=ba44d87af1fa43f58d1cb6b4f28941ad, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:38.161923 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04821ea0-7550-4818-88dc-675b7be2b2e5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:38.174543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1447/2859] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:38 2022] PUT /identity/v3/projects/2bb9ce8cf8c442cfa6effa49a4cfe114/users/ba44d87af1fa43f58d1cb6b4f28941ad/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:38.186236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58930e9b-5323-41c6-bb54-d8bba3357c45 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:38.186725 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58930e9b-5323-41c6-bb54-d8bba3357c45 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:38.186835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58930e9b-5323-41c6-bb54-d8bba3357c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:38.212279 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-58930e9b-5323-41c6-bb54-d8bba3357c45 None None] MFA Rules not processed for user `ba44d87af1fa43f58d1cb6b4f28941ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:38.213525 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-58930e9b-5323-41c6-bb54-d8bba3357c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:38.231818 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:38.279321 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1413/2860] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:40:38.290604 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04821ea0-7550-4818-88dc-675b7be2b2e5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:38.292310 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-04821ea0-7550-4818-88dc-675b7be2b2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:38.347675 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04821ea0-7550-4818-88dc-675b7be2b2e5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:38.351204 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fefea-68e2-40fa-9948-30eb7b8cdcc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:38.351835 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fefea-68e2-40fa-9948-30eb7b8cdcc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:38.352113 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fefea-68e2-40fa-9948-30eb7b8cdcc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:38.352385 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fefea-68e2-40fa-9948-30eb7b8cdcc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:38.360723 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fefea-68e2-40fa-9948-30eb7b8cdcc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:38.362210 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fefea-68e2-40fa-9948-30eb7b8cdcc3 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:38.370940 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1448/2861] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:38.390610 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58930e9b-5323-41c6-bb54-d8bba3357c45 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:38.452766 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58930e9b-5323-41c6-bb54-d8bba3357c45 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:38.457905 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd1fcd-7260-4223-91ec-59acf3227a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:38.458777 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd1fcd-7260-4223-91ec-59acf3227a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:38.459058 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd1fcd-7260-4223-91ec-59acf3227a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:38.459330 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd1fcd-7260-4223-91ec-59acf3227a04 admin admin] PATH_INFO: `/v3/users/ba44d87af1fa43f58d1cb6b4f28941ad` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:38.460521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd1fcd-7260-4223-91ec-59acf3227a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba44d87af1fa43f58d1cb6b4f28941ad)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:38.462470 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd1fcd-7260-4223-91ec-59acf3227a04 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:38.506993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c2cd1fcd-7260-4223-91ec-59acf3227a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba44d87af1fa43f58d1cb6b4f28941ad'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:38.513669 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c2cd1fcd-7260-4223-91ec-59acf3227a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba44d87af1fa43f58d1cb6b4f28941ad'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:38.514339 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c2cd1fcd-7260-4223-91ec-59acf3227a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba44d87af1fa43f58d1cb6b4f28941ad'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:38.526464 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c2cd1fcd-7260-4223-91ec-59acf3227a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba44d87af1fa43f58d1cb6b4f28941ad'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:38.534130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-c2cd1fcd-7260-4223-91ec-59acf3227a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba44d87af1fa43f58d1cb6b4f28941ad'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:38.540076 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1414/2862] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:38 2022] DELETE /identity/v3/users/ba44d87af1fa43f58d1cb6b4f28941ad => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:38.544685 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60571ee-4eea-4179-9c2e-618067185369 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:38.544997 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60571ee-4eea-4179-9c2e-618067185369 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:38.545283 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60571ee-4eea-4179-9c2e-618067185369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:38.563405 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f60571ee-4eea-4179-9c2e-618067185369 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:38.564595 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f60571ee-4eea-4179-9c2e-618067185369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:38.621660 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1449/2863] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:38.631680 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd1fcd-7260-4223-91ec-59acf3227a04 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:38.633090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-c2cd1fcd-7260-4223-91ec-59acf3227a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:38.676888 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:38.694660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd1fcd-7260-4223-91ec-59acf3227a04 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:38.698450 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97251dc-c29e-49b6-b321-e944614b7126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:38.699103 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97251dc-c29e-49b6-b321-e944614b7126 service neutron] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:38.699393 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97251dc-c29e-49b6-b321-e944614b7126 service neutron] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:38.699673 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97251dc-c29e-49b6-b321-e944614b7126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:38.708782 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97251dc-c29e-49b6-b321-e944614b7126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:38.710255 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97251dc-c29e-49b6-b321-e944614b7126 service neutron] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:38.719791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1415/2864] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:38.987763 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60571ee-4eea-4179-9c2e-618067185369 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:38.989725 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f60571ee-4eea-4179-9c2e-618067185369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:39.002746 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60571ee-4eea-4179-9c2e-618067185369 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:39.008340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2443c-b643-463a-a6b3-90133dbaad23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:39.009238 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2443c-b643-463a-a6b3-90133dbaad23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.009522 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2443c-b643-463a-a6b3-90133dbaad23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.009802 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2443c-b643-463a-a6b3-90133dbaad23 admin admin] PATH_INFO: `/v3/projects/2bb9ce8cf8c442cfa6effa49a4cfe114` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.010987 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2443c-b643-463a-a6b3-90133dbaad23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb9ce8cf8c442cfa6effa49a4cfe114)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:39.012898 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2443c-b643-463a-a6b3-90133dbaad23 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:39.062201 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-86b2443c-b643-463a-a6b3-90133dbaad23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb9ce8cf8c442cfa6effa49a4cfe114', 'request_id': 'req-86b2443c-b643-463a-a6b3-90133dbaad23'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:39.068624 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-86b2443c-b643-463a-a6b3-90133dbaad23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb9ce8cf8c442cfa6effa49a4cfe114', 'request_id': 'req-86b2443c-b643-463a-a6b3-90133dbaad23'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:39.075638 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-86b2443c-b643-463a-a6b3-90133dbaad23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb9ce8cf8c442cfa6effa49a4cfe114', 'request_id': 'req-86b2443c-b643-463a-a6b3-90133dbaad23'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:39.088936 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-86b2443c-b643-463a-a6b3-90133dbaad23 admin admin] The token cache is being invalidate because project 2bb9ce8cf8c442cfa6effa49a4cfe114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:39.089255 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-86b2443c-b643-463a-a6b3-90133dbaad23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:39.089911 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-86b2443c-b643-463a-a6b3-90133dbaad23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:39.091490 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1450/2865] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:38 2022] DELETE /identity/v3/projects/2bb9ce8cf8c442cfa6effa49a4cfe114 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:39.096494 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab340d41-00c6-4b14-a4d6-2313c5e61d8a None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.096785 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab340d41-00c6-4b14-a4d6-2313c5e61d8a None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.097166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab340d41-00c6-4b14-a4d6-2313c5e61d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.115852 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-ab340d41-00c6-4b14-a4d6-2313c5e61d8a None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:39.117325 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-ab340d41-00c6-4b14-a4d6-2313c5e61d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:39.175394 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1416/2866] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:39.183658 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765c104-d1c9-4b36-bfc4-3657871308da None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.183943 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765c104-d1c9-4b36-bfc4-3657871308da None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.184222 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765c104-d1c9-4b36-bfc4-3657871308da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.191538 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:39.203358 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3765c104-d1c9-4b36-bfc4-3657871308da None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:39.204730 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3765c104-d1c9-4b36-bfc4-3657871308da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:39.212618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1451/2867] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:39.216886 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab340d41-00c6-4b14-a4d6-2313c5e61d8a None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:39.227122 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab340d41-00c6-4b14-a4d6-2313c5e61d8a None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:39.231698 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3a5ab-de88-4463-8709-26361ef4189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:39.232354 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3a5ab-de88-4463-8709-26361ef4189b admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.232641 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3a5ab-de88-4463-8709-26361ef4189b admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.232944 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3a5ab-de88-4463-8709-26361ef4189b admin admin] PATH_INFO: `/v3/domains` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.233683 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3a5ab-de88-4463-8709-26361ef4189b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80107) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:40:39.233992 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3a5ab-de88-4463-8709-26361ef4189b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:39.235593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3a5ab-de88-4463-8709-26361ef4189b admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:39.247764 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1417/2868] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:40:39.252028 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765c104-d1c9-4b36-bfc4-3657871308da None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:39.261900 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765c104-d1c9-4b36-bfc4-3657871308da None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:39.266567 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf3b51-70f1-4aa5-a6e9-f8299e07e57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:39.267220 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf3b51-70f1-4aa5-a6e9-f8299e07e57f admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.267505 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf3b51-70f1-4aa5-a6e9-f8299e07e57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.267785 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf3b51-70f1-4aa5-a6e9-f8299e07e57f admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.268476 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf3b51-70f1-4aa5-a6e9-f8299e07e57f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:39.271039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf3b51-70f1-4aa5-a6e9-f8299e07e57f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:39.300559 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1452/2869] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:39 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:39.301791 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3a5ab-de88-4463-8709-26361ef4189b admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:39.311808 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3a5ab-de88-4463-8709-26361ef4189b admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:39.369069 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446451a2-334c-4c55-a95e-6e7e5b1d934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:39.369735 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446451a2-334c-4c55-a95e-6e7e5b1d934f admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.370020 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446451a2-334c-4c55-a95e-6e7e5b1d934f admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.370296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446451a2-334c-4c55-a95e-6e7e5b1d934f admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.370975 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446451a2-334c-4c55-a95e-6e7e5b1d934f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:39.372877 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446451a2-334c-4c55-a95e-6e7e5b1d934f admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:39.393699 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1418/2870] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:39 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:40:39.398314 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf3b51-70f1-4aa5-a6e9-f8299e07e57f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:39.410158 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf3b51-70f1-4aa5-a6e9-f8299e07e57f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:39.414934 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03063a-8ead-4716-a620-2215e0d5bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:39.415597 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03063a-8ead-4716-a620-2215e0d5bae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.415906 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03063a-8ead-4716-a620-2215e0d5bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.416184 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03063a-8ead-4716-a620-2215e0d5bae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.416986 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03063a-8ead-4716-a620-2215e0d5bae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:39.418571 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03063a-8ead-4716-a620-2215e0d5bae2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:39.429751 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1453/2871] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:39.433701 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446451a2-334c-4c55-a95e-6e7e5b1d934f admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:39.445191 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446451a2-334c-4c55-a95e-6e7e5b1d934f admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:39.449768 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b1a6e-28ff-4866-80de-de2b2de325e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:39.450426 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b1a6e-28ff-4866-80de-de2b2de325e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.450717 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b1a6e-28ff-4866-80de-de2b2de325e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.450997 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b1a6e-28ff-4866-80de-de2b2de325e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.451722 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b1a6e-28ff-4866-80de-de2b2de325e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:39.453347 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b1a6e-28ff-4866-80de-de2b2de325e8 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:39.464593 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1419/2872] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:39.468983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03063a-8ead-4716-a620-2215e0d5bae2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:39.478870 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03063a-8ead-4716-a620-2215e0d5bae2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:39.483532 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117e087-305e-4822-a2ac-794a09ac9bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:39.484517 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117e087-305e-4822-a2ac-794a09ac9bab admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.484784 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117e087-305e-4822-a2ac-794a09ac9bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.485100 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117e087-305e-4822-a2ac-794a09ac9bab admin admin] PATH_INFO: `/v3/projects/afaef5b04e644f47870885b2ea2d58ca/users/ef2a628e45434267ab89680b82e29306/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.500020 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117e087-305e-4822-a2ac-794a09ac9bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=afaef5b04e644f47870885b2ea2d58ca, user_id=ef2a628e45434267ab89680b82e29306, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:39.502686 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117e087-305e-4822-a2ac-794a09ac9bab admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:39.516414 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1454/2873] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:39 2022] PUT /identity/v3/projects/afaef5b04e644f47870885b2ea2d58ca/users/ef2a628e45434267ab89680b82e29306/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:39.526674 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a510d-565e-43b3-98e3-9c04218e19b4 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.526970 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a510d-565e-43b3-98e3-9c04218e19b4 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.527254 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a510d-565e-43b3-98e3-9c04218e19b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.556386 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-085a510d-565e-43b3-98e3-9c04218e19b4 None None] MFA Rules not processed for user `ef2a628e45434267ab89680b82e29306`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:39.557662 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-085a510d-565e-43b3-98e3-9c04218e19b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:39.595420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:39.622026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1420/2874] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:39.626508 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117e087-305e-4822-a2ac-794a09ac9bab admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:39.688612 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117e087-305e-4822-a2ac-794a09ac9bab admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:39.694002 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ded800-938c-40a9-a507-6cd4528fe0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:39.694687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ded800-938c-40a9-a507-6cd4528fe0df admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.694973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ded800-938c-40a9-a507-6cd4528fe0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.695251 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ded800-938c-40a9-a507-6cd4528fe0df admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.696054 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ded800-938c-40a9-a507-6cd4528fe0df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:39.699603 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ded800-938c-40a9-a507-6cd4528fe0df admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:39.724450 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1455/2875] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:39 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:40:39.728508 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a510d-565e-43b3-98e3-9c04218e19b4 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:39.739657 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a510d-565e-43b3-98e3-9c04218e19b4 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:39.798219 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc448d3c-aea3-493d-aaa0-f7f88c983d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:39.798891 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc448d3c-aea3-493d-aaa0-f7f88c983d31 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.799181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc448d3c-aea3-493d-aaa0-f7f88c983d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.799463 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc448d3c-aea3-493d-aaa0-f7f88c983d31 admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.800166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc448d3c-aea3-493d-aaa0-f7f88c983d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:39.802763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc448d3c-aea3-493d-aaa0-f7f88c983d31 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:39.822023 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1421/2876] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:39 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:39.826117 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ded800-938c-40a9-a507-6cd4528fe0df admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:39.836543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ded800-938c-40a9-a507-6cd4528fe0df admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:39.841230 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b72887-6b03-4af3-861a-8ab84b47da04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:39.841967 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b72887-6b03-4af3-861a-8ab84b47da04 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.842259 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b72887-6b03-4af3-861a-8ab84b47da04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.842543 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b72887-6b03-4af3-861a-8ab84b47da04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.843269 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b72887-6b03-4af3-861a-8ab84b47da04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:39.844860 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b72887-6b03-4af3-861a-8ab84b47da04 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:39.856173 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1456/2877] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:39.860095 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc448d3c-aea3-493d-aaa0-f7f88c983d31 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:39.870579 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc448d3c-aea3-493d-aaa0-f7f88c983d31 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:39.875164 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cff1d-d0a8-4bba-a877-ccf3c1560981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:39.875819 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cff1d-d0a8-4bba-a877-ccf3c1560981 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.876111 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cff1d-d0a8-4bba-a877-ccf3c1560981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.876392 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cff1d-d0a8-4bba-a877-ccf3c1560981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.877153 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cff1d-d0a8-4bba-a877-ccf3c1560981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:39.878740 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cff1d-d0a8-4bba-a877-ccf3c1560981 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:39.888489 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1422/2878] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:39.892361 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b72887-6b03-4af3-861a-8ab84b47da04 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:39.901936 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b72887-6b03-4af3-861a-8ab84b47da04 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:39.906688 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bec590-6b91-416c-935a-0774ca4b3ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:39.907544 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bec590-6b91-416c-935a-0774ca4b3ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.907823 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bec590-6b91-416c-935a-0774ca4b3ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.908093 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bec590-6b91-416c-935a-0774ca4b3ab3 admin admin] PATH_INFO: `/v3/projects/952fa7a26a554b9c9e4f09cacd870df4/users/6046f015e2b34aa6a8c0a7da09ff1a98/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.922539 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bec590-6b91-416c-935a-0774ca4b3ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=952fa7a26a554b9c9e4f09cacd870df4, user_id=6046f015e2b34aa6a8c0a7da09ff1a98, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:39.925171 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bec590-6b91-416c-935a-0774ca4b3ab3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:39.938425 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1457/2879] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:39 2022] PUT /identity/v3/projects/952fa7a26a554b9c9e4f09cacd870df4/users/6046f015e2b34aa6a8c0a7da09ff1a98/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:39.949773 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de055e42-047a-4a9b-adfa-fe08fbb85796 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:39.950067 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de055e42-047a-4a9b-adfa-fe08fbb85796 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:39.950351 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de055e42-047a-4a9b-adfa-fe08fbb85796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:39.977916 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-de055e42-047a-4a9b-adfa-fe08fbb85796 None None] MFA Rules not processed for user `6046f015e2b34aa6a8c0a7da09ff1a98`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:39.979134 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-de055e42-047a-4a9b-adfa-fe08fbb85796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:40.047487 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1423/2880] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:40.052713 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bec590-6b91-416c-935a-0774ca4b3ab3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:40.104465 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:40.117088 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bec590-6b91-416c-935a-0774ca4b3ab3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:40.121791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d81d74-9983-4f57-aab3-8b292be32a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:40.122446 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d81d74-9983-4f57-aab3-8b292be32a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:40.122740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d81d74-9983-4f57-aab3-8b292be32a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:40.123021 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d81d74-9983-4f57-aab3-8b292be32a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:40.123714 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d81d74-9983-4f57-aab3-8b292be32a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:40.125672 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d81d74-9983-4f57-aab3-8b292be32a83 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:40.149899 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1458/2881] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:40 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:40.154130 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de055e42-047a-4a9b-adfa-fe08fbb85796 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:40.165819 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de055e42-047a-4a9b-adfa-fe08fbb85796 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:40.208428 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:40.221990 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c803e4a-e3f0-40e6-920b-d28486afad4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:40.222714 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c803e4a-e3f0-40e6-920b-d28486afad4e admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:40.223574 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c803e4a-e3f0-40e6-920b-d28486afad4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:40.223853 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c803e4a-e3f0-40e6-920b-d28486afad4e admin admin] PATH_INFO: `/v3/users` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:40.224543 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c803e4a-e3f0-40e6-920b-d28486afad4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:40.226483 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c803e4a-e3f0-40e6-920b-d28486afad4e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:40.245933 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1424/2882] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:40 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 22:40:40.249842 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d81d74-9983-4f57-aab3-8b292be32a83 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:40.260181 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d81d74-9983-4f57-aab3-8b292be32a83 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:40.264744 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf274785-8e89-47ca-a4f6-f2970afd5cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:40.265439 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf274785-8e89-47ca-a4f6-f2970afd5cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:40.265720 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf274785-8e89-47ca-a4f6-f2970afd5cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:40.265996 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf274785-8e89-47ca-a4f6-f2970afd5cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:40.266749 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf274785-8e89-47ca-a4f6-f2970afd5cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:40.268321 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf274785-8e89-47ca-a4f6-f2970afd5cc0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:40.279128 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1459/2883] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:40.283479 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c803e4a-e3f0-40e6-920b-d28486afad4e admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:40.293792 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c803e4a-e3f0-40e6-920b-d28486afad4e admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:40.298415 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eee153-a8a8-41e0-b54a-5e82b1d850b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:40.299296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eee153-a8a8-41e0-b54a-5e82b1d850b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:40.299584 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eee153-a8a8-41e0-b54a-5e82b1d850b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:40.299866 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eee153-a8a8-41e0-b54a-5e82b1d850b6 admin admin] PATH_INFO: `/v3/projects/535f189a6678451fb0a2054250ac0653/users/0d42af214d0b4a00a35610514b2d36e2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:40.314262 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eee153-a8a8-41e0-b54a-5e82b1d850b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535f189a6678451fb0a2054250ac0653, user_id=0d42af214d0b4a00a35610514b2d36e2, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:40.316971 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eee153-a8a8-41e0-b54a-5e82b1d850b6 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:40.329510 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1425/2884] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:40 2022] PUT /identity/v3/projects/535f189a6678451fb0a2054250ac0653/users/0d42af214d0b4a00a35610514b2d36e2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:40.334771 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf274785-8e89-47ca-a4f6-f2970afd5cc0 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:40.344644 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf274785-8e89-47ca-a4f6-f2970afd5cc0 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:40.400357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838064cd-8447-4178-8fb4-67986e013805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:40.401045 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838064cd-8447-4178-8fb4-67986e013805 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:40.401335 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838064cd-8447-4178-8fb4-67986e013805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:40.401615 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838064cd-8447-4178-8fb4-67986e013805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:40.402340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838064cd-8447-4178-8fb4-67986e013805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:40.403930 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838064cd-8447-4178-8fb4-67986e013805 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:40.414357 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1460/2885] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:40.418762 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eee153-a8a8-41e0-b54a-5e82b1d850b6 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:40.428864 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eee153-a8a8-41e0-b54a-5e82b1d850b6 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:40.434343 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af366fab-7bb5-4de2-a52b-ad2fd9ad3b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:40.435256 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af366fab-7bb5-4de2-a52b-ad2fd9ad3b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:40.435536 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af366fab-7bb5-4de2-a52b-ad2fd9ad3b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:40.435812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af366fab-7bb5-4de2-a52b-ad2fd9ad3b01 admin admin] PATH_INFO: `/v3/projects/535f189a6678451fb0a2054250ac0653/users/0d42af214d0b4a00a35610514b2d36e2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:40.437837 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af366fab-7bb5-4de2-a52b-ad2fd9ad3b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535f189a6678451fb0a2054250ac0653, user_id=0d42af214d0b4a00a35610514b2d36e2, role_id=5261a67f0a3d4275bd9bc9c9ba1f763f)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:40.440651 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af366fab-7bb5-4de2-a52b-ad2fd9ad3b01 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:40.450886 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1426/2886] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:40 2022] PUT /identity/v3/projects/535f189a6678451fb0a2054250ac0653/users/0d42af214d0b4a00a35610514b2d36e2/roles/5261a67f0a3d4275bd9bc9c9ba1f763f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:40.461800 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebe61d-0cc3-4b1a-b8c4-db1e5282e78c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:40.462020 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebe61d-0cc3-4b1a-b8c4-db1e5282e78c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:40.462294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebe61d-0cc3-4b1a-b8c4-db1e5282e78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:40.487983 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-47ebe61d-0cc3-4b1a-b8c4-db1e5282e78c None None] MFA Rules not processed for user `0d42af214d0b4a00a35610514b2d36e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:40.489202 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-47ebe61d-0cc3-4b1a-b8c4-db1e5282e78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:40.553753 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1461/2887] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:40.564835 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af366fab-7bb5-4de2-a52b-ad2fd9ad3b01 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:40.567070 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-af366fab-7bb5-4de2-a52b-ad2fd9ad3b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:40.621996 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af366fab-7bb5-4de2-a52b-ad2fd9ad3b01 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:40.625555 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fedb99-33e4-4b5a-b421-49477d7aa487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:40.626177 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fedb99-33e4-4b5a-b421-49477d7aa487 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:40.626456 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fedb99-33e4-4b5a-b421-49477d7aa487 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:40.626728 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fedb99-33e4-4b5a-b421-49477d7aa487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:40.680869 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fedb99-33e4-4b5a-b421-49477d7aa487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:40.682309 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fedb99-33e4-4b5a-b421-49477d7aa487 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:40.690890 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1427/2888] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:42.162869 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebe61d-0cc3-4b1a-b8c4-db1e5282e78c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:42.164322 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-47ebe61d-0cc3-4b1a-b8c4-db1e5282e78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:42.176360 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebe61d-0cc3-4b1a-b8c4-db1e5282e78c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:42.179859 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3222f6-076a-4da7-9691-f0734bb31dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:42.180500 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3222f6-076a-4da7-9691-f0734bb31dcc service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:42.180787 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3222f6-076a-4da7-9691-f0734bb31dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:42.181104 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3222f6-076a-4da7-9691-f0734bb31dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:42.224659 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:42.238017 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3222f6-076a-4da7-9691-f0734bb31dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:42.239386 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3222f6-076a-4da7-9691-f0734bb31dcc service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:42.248109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1462/2889] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:42.750596 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fedb99-33e4-4b5a-b421-49477d7aa487 service cinder] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:42.759061 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fedb99-33e4-4b5a-b421-49477d7aa487 service cinder] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:42.762599 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecef91-8e5d-4e9f-acee-3aa3211ab2aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:42.763236 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecef91-8e5d-4e9f-acee-3aa3211ab2aa service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:42.763521 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecef91-8e5d-4e9f-acee-3aa3211ab2aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:42.763798 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecef91-8e5d-4e9f-acee-3aa3211ab2aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:42.772787 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecef91-8e5d-4e9f-acee-3aa3211ab2aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:42.774269 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecef91-8e5d-4e9f-acee-3aa3211ab2aa service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:42.784131 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1428/2890] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:46.611339 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3222f6-076a-4da7-9691-f0734bb31dcc service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:46.671899 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3222f6-076a-4da7-9691-f0734bb31dcc service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:46.676402 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013b133-1672-4961-b891-cb2b7acfd3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:46.677294 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013b133-1672-4961-b891-cb2b7acfd3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:46.677580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013b133-1672-4961-b891-cb2b7acfd3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:46.677862 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013b133-1672-4961-b891-cb2b7acfd3e3 admin admin] PATH_INFO: `/v3/users/ef2a628e45434267ab89680b82e29306` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:46.679037 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013b133-1672-4961-b891-cb2b7acfd3e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef2a628e45434267ab89680b82e29306)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:46.681514 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013b133-1672-4961-b891-cb2b7acfd3e3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:46.724141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7013b133-1672-4961-b891-cb2b7acfd3e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef2a628e45434267ab89680b82e29306'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:46.736153 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7013b133-1672-4961-b891-cb2b7acfd3e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef2a628e45434267ab89680b82e29306'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:46.744039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7013b133-1672-4961-b891-cb2b7acfd3e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef2a628e45434267ab89680b82e29306'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:46.744694 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7013b133-1672-4961-b891-cb2b7acfd3e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef2a628e45434267ab89680b82e29306'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:46.751829 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7013b133-1672-4961-b891-cb2b7acfd3e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef2a628e45434267ab89680b82e29306'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:46.757802 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1463/2891] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:46 2022] DELETE /identity/v3/users/ef2a628e45434267ab89680b82e29306 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:46.762616 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc9113-32c2-4d62-b80a-d0ec63b2d7b8 None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:46.763106 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc9113-32c2-4d62-b80a-d0ec63b2d7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:46.763207 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc9113-32c2-4d62-b80a-d0ec63b2d7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:46.781026 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-36dc9113-32c2-4d62-b80a-d0ec63b2d7b8 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:46.782220 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-36dc9113-32c2-4d62-b80a-d0ec63b2d7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:46.814658 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:46.840979 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1429/2892] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:46.850311 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013b133-1672-4961-b891-cb2b7acfd3e3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:46.851674 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7013b133-1672-4961-b891-cb2b7acfd3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:46.907626 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013b133-1672-4961-b891-cb2b7acfd3e3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:46.911146 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eec591-6e79-4f93-b55d-b735704e77a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:46.911776 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eec591-6e79-4f93-b55d-b735704e77a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:46.912057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eec591-6e79-4f93-b55d-b735704e77a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:46.912333 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eec591-6e79-4f93-b55d-b735704e77a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:46.921171 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eec591-6e79-4f93-b55d-b735704e77a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:46.922579 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eec591-6e79-4f93-b55d-b735704e77a6 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:46.932355 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1464/2893] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:47.202118 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc9113-32c2-4d62-b80a-d0ec63b2d7b8 None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:47.203677 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-36dc9113-32c2-4d62-b80a-d0ec63b2d7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:47.216327 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc9113-32c2-4d62-b80a-d0ec63b2d7b8 None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:47.221081 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52c857-07e4-4032-9964-85e4aaae8afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:47.221950 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c857-07e4-4032-9964-85e4aaae8afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:47.222234 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c857-07e4-4032-9964-85e4aaae8afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:47.222512 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c857-07e4-4032-9964-85e4aaae8afa admin admin] PATH_INFO: `/v3/projects/afaef5b04e644f47870885b2ea2d58ca` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:47.223712 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52c857-07e4-4032-9964-85e4aaae8afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=afaef5b04e644f47870885b2ea2d58ca)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:47.225952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52c857-07e4-4032-9964-85e4aaae8afa admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:47.272090 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4f52c857-07e4-4032-9964-85e4aaae8afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afaef5b04e644f47870885b2ea2d58ca', 'request_id': 'req-4f52c857-07e4-4032-9964-85e4aaae8afa'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:47.279228 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4f52c857-07e4-4032-9964-85e4aaae8afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afaef5b04e644f47870885b2ea2d58ca', 'request_id': 'req-4f52c857-07e4-4032-9964-85e4aaae8afa'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:47.285257 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4f52c857-07e4-4032-9964-85e4aaae8afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afaef5b04e644f47870885b2ea2d58ca', 'request_id': 'req-4f52c857-07e4-4032-9964-85e4aaae8afa'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:47.295924 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4f52c857-07e4-4032-9964-85e4aaae8afa admin admin] The token cache is being invalidate because project afaef5b04e644f47870885b2ea2d58ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:47.296209 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4f52c857-07e4-4032-9964-85e4aaae8afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:47.296828 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-4f52c857-07e4-4032-9964-85e4aaae8afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:47.298398 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1430/2894] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:47 2022] DELETE /identity/v3/projects/afaef5b04e644f47870885b2ea2d58ca => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:47.302473 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eec591-6e79-4f93-b55d-b735704e77a6 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:47.311908 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eec591-6e79-4f93-b55d-b735704e77a6 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:47.315424 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:47.373039 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b88ccb-faf8-4f7d-9689-70abbbeda1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:47.373842 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b88ccb-faf8-4f7d-9689-70abbbeda1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:47.374145 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b88ccb-faf8-4f7d-9689-70abbbeda1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:47.374405 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b88ccb-faf8-4f7d-9689-70abbbeda1d1 admin admin] PATH_INFO: `/v3/users/6046f015e2b34aa6a8c0a7da09ff1a98` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:47.375589 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b88ccb-faf8-4f7d-9689-70abbbeda1d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6046f015e2b34aa6a8c0a7da09ff1a98)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:47.377618 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b88ccb-faf8-4f7d-9689-70abbbeda1d1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:47.422469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-53b88ccb-faf8-4f7d-9689-70abbbeda1d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6046f015e2b34aa6a8c0a7da09ff1a98'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:47.434208 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-53b88ccb-faf8-4f7d-9689-70abbbeda1d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6046f015e2b34aa6a8c0a7da09ff1a98'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:47.440973 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-53b88ccb-faf8-4f7d-9689-70abbbeda1d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6046f015e2b34aa6a8c0a7da09ff1a98'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:47.441650 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-53b88ccb-faf8-4f7d-9689-70abbbeda1d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6046f015e2b34aa6a8c0a7da09ff1a98'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:47.449396 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-53b88ccb-faf8-4f7d-9689-70abbbeda1d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6046f015e2b34aa6a8c0a7da09ff1a98'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:47.455297 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1465/2895] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:47 2022] DELETE /identity/v3/users/6046f015e2b34aa6a8c0a7da09ff1a98 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:47.722307 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52c857-07e4-4032-9964-85e4aaae8afa admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:47.723965 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-4f52c857-07e4-4032-9964-85e4aaae8afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:47.742709 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52c857-07e4-4032-9964-85e4aaae8afa admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:47.799976 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:47.800833 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:47.801152 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:47.801431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9 admin admin] PATH_INFO: `/v3/projects/952fa7a26a554b9c9e4f09cacd870df4` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:47.802763 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=952fa7a26a554b9c9e4f09cacd870df4)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:47.804650 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:47.851621 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952fa7a26a554b9c9e4f09cacd870df4', 'request_id': 'req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:47.859358 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952fa7a26a554b9c9e4f09cacd870df4', 'request_id': 'req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:47.864851 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952fa7a26a554b9c9e4f09cacd870df4', 'request_id': 'req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:47.865955 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:47.878034 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9 admin admin] The token cache is being invalidate because project 952fa7a26a554b9c9e4f09cacd870df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:47.878321 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:47.878952 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:47.880524 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1431/2896] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:47 2022] DELETE /identity/v3/projects/952fa7a26a554b9c9e4f09cacd870df4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:47.885168 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b88ccb-faf8-4f7d-9689-70abbbeda1d1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:47.886546 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-53b88ccb-faf8-4f7d-9689-70abbbeda1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:47.899884 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b88ccb-faf8-4f7d-9689-70abbbeda1d1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:47.954276 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11985d-31a6-4276-9e95-3093bd1be90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:47.955141 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11985d-31a6-4276-9e95-3093bd1be90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:47.955428 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11985d-31a6-4276-9e95-3093bd1be90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:47.955708 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11985d-31a6-4276-9e95-3093bd1be90d admin admin] PATH_INFO: `/v3/users/0d42af214d0b4a00a35610514b2d36e2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:47.956866 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11985d-31a6-4276-9e95-3093bd1be90d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d42af214d0b4a00a35610514b2d36e2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:47.958808 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11985d-31a6-4276-9e95-3093bd1be90d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:47.987074 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:48.005777 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fd11985d-31a6-4276-9e95-3093bd1be90d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d42af214d0b4a00a35610514b2d36e2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:48.018220 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fd11985d-31a6-4276-9e95-3093bd1be90d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d42af214d0b4a00a35610514b2d36e2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:48.025599 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fd11985d-31a6-4276-9e95-3093bd1be90d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d42af214d0b4a00a35610514b2d36e2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:48.026272 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fd11985d-31a6-4276-9e95-3093bd1be90d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d42af214d0b4a00a35610514b2d36e2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:48.033555 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fd11985d-31a6-4276-9e95-3093bd1be90d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d42af214d0b4a00a35610514b2d36e2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:48.039329 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1466/2897] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:47 2022] DELETE /identity/v3/users/0d42af214d0b4a00a35610514b2d36e2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:40:48.322181 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:48.323648 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:48.336096 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57326e-f1bf-4edb-b8af-435d5b91e9f9 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:48.393850 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179989b-1c49-41d2-8590-b777cb1421b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:48.394710 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179989b-1c49-41d2-8590-b777cb1421b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:48.394993 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179989b-1c49-41d2-8590-b777cb1421b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:48.395478 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179989b-1c49-41d2-8590-b777cb1421b0 admin admin] PATH_INFO: `/v3/projects/535f189a6678451fb0a2054250ac0653` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:48.396659 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179989b-1c49-41d2-8590-b777cb1421b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=535f189a6678451fb0a2054250ac0653)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:48.398590 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179989b-1c49-41d2-8590-b777cb1421b0 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:48.446147 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-3179989b-1c49-41d2-8590-b777cb1421b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535f189a6678451fb0a2054250ac0653', 'request_id': 'req-3179989b-1c49-41d2-8590-b777cb1421b0'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:48.453895 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-3179989b-1c49-41d2-8590-b777cb1421b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535f189a6678451fb0a2054250ac0653', 'request_id': 'req-3179989b-1c49-41d2-8590-b777cb1421b0'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:48.459604 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-3179989b-1c49-41d2-8590-b777cb1421b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535f189a6678451fb0a2054250ac0653', 'request_id': 'req-3179989b-1c49-41d2-8590-b777cb1421b0'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:48.470761 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-3179989b-1c49-41d2-8590-b777cb1421b0 admin admin] The token cache is being invalidate because project 535f189a6678451fb0a2054250ac0653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:48.471045 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-3179989b-1c49-41d2-8590-b777cb1421b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:48.471672 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-3179989b-1c49-41d2-8590-b777cb1421b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:48.473266 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1432/2898] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:48 2022] DELETE /identity/v3/projects/535f189a6678451fb0a2054250ac0653 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:48.479217 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb7f48-77ad-47fa-b0e2-60ec6c41bfd8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:48.479509 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb7f48-77ad-47fa-b0e2-60ec6c41bfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:48.479791 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb7f48-77ad-47fa-b0e2-60ec6c41bfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:48.497913 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7acb7f48-77ad-47fa-b0e2-60ec6c41bfd8 None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:48.499133 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7acb7f48-77ad-47fa-b0e2-60ec6c41bfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:48.556855 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1467/2899] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:48.564565 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a1b5e-1d3d-4ddf-84bd-60129d425dca None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:48.564876 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a1b5e-1d3d-4ddf-84bd-60129d425dca None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:48.565173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a1b5e-1d3d-4ddf-84bd-60129d425dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:48.583636 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-1f3a1b5e-1d3d-4ddf-84bd-60129d425dca None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:48.584826 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-1f3a1b5e-1d3d-4ddf-84bd-60129d425dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:48.592603 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1433/2900] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:48.596740 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb7f48-77ad-47fa-b0e2-60ec6c41bfd8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:48.606312 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb7f48-77ad-47fa-b0e2-60ec6c41bfd8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:48.610764 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd4dcc-d2f4-4543-961e-81c83f37fc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:48.611406 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd4dcc-d2f4-4543-961e-81c83f37fc24 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:48.611687 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd4dcc-d2f4-4543-961e-81c83f37fc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:48.611957 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd4dcc-d2f4-4543-961e-81c83f37fc24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:48.612673 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd4dcc-d2f4-4543-961e-81c83f37fc24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 22:40:48.613007 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd4dcc-d2f4-4543-961e-81c83f37fc24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:48.614580 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd4dcc-d2f4-4543-961e-81c83f37fc24 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:48.626195 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1468/2901] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jul 21 22:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 22:40:48.630431 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a1b5e-1d3d-4ddf-84bd-60129d425dca None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:48.640284 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a1b5e-1d3d-4ddf-84bd-60129d425dca None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:48.644834 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcea482-bbb8-417a-989c-36c564ad0863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:48.645526 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcea482-bbb8-417a-989c-36c564ad0863 admin admin] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:48.645812 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcea482-bbb8-417a-989c-36c564ad0863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:48.646092 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcea482-bbb8-417a-989c-36c564ad0863 admin admin] PATH_INFO: `/v3/projects` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:48.646784 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcea482-bbb8-417a-989c-36c564ad0863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:48.648660 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcea482-bbb8-417a-989c-36c564ad0863 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:48.674861 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1434/2902] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jul 21 22:40:48 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:48.678824 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd4dcc-d2f4-4543-961e-81c83f37fc24 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:48.689685 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd4dcc-d2f4-4543-961e-81c83f37fc24 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:48.751137 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658c9d0-f369-45f9-83bb-cf72390af84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:48.751804 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c9d0-f369-45f9-83bb-cf72390af84d admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:48.752086 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c9d0-f369-45f9-83bb-cf72390af84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:48.752364 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c9d0-f369-45f9-83bb-cf72390af84d admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:48.753216 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658c9d0-f369-45f9-83bb-cf72390af84d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:48.755126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658c9d0-f369-45f9-83bb-cf72390af84d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:48.774040 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1469/2903] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jul 21 22:40:48 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 22:40:48.778240 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcea482-bbb8-417a-989c-36c564ad0863 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:48.788780 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcea482-bbb8-417a-989c-36c564ad0863 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:48.793966 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df63725-22c6-4883-8b8e-6d821ceef610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:48.794626 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df63725-22c6-4883-8b8e-6d821ceef610 admin admin] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:48.794909 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df63725-22c6-4883-8b8e-6d821ceef610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:48.795188 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df63725-22c6-4883-8b8e-6d821ceef610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:48.795919 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df63725-22c6-4883-8b8e-6d821ceef610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:48.797546 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df63725-22c6-4883-8b8e-6d821ceef610 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:48.808407 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1435/2904] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:48.812126 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658c9d0-f369-45f9-83bb-cf72390af84d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:48.821891 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658c9d0-f369-45f9-83bb-cf72390af84d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:48.826388 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5a01b-fb15-43b5-aa30-13d0be07a7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:48.827031 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5a01b-fb15-43b5-aa30-13d0be07a7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:48.827314 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5a01b-fb15-43b5-aa30-13d0be07a7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:48.827594 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5a01b-fb15-43b5-aa30-13d0be07a7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:48.828313 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5a01b-fb15-43b5-aa30-13d0be07a7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:48.829944 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5a01b-fb15-43b5-aa30-13d0be07a7b3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:48.839619 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1470/2905] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jul 21 22:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 22:40:48.843573 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df63725-22c6-4883-8b8e-6d821ceef610 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:48.854079 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df63725-22c6-4883-8b8e-6d821ceef610 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:48.858678 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736c60c-18bd-4f9e-9dd1-24dfe9c92793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:48.859554 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736c60c-18bd-4f9e-9dd1-24dfe9c92793 admin admin] REQUEST_METHOD: `PUT` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:48.859842 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736c60c-18bd-4f9e-9dd1-24dfe9c92793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:48.860120 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736c60c-18bd-4f9e-9dd1-24dfe9c92793 admin admin] PATH_INFO: `/v3/projects/9b183b3385094287b12cb5a4a28f79cc/users/be2bb816670242c282a81aef8ccc31bc/roles/3b7272bb6de3425fa18a474080a9c1a2` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:48.875592 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736c60c-18bd-4f9e-9dd1-24dfe9c92793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b183b3385094287b12cb5a4a28f79cc, user_id=be2bb816670242c282a81aef8ccc31bc, role_id=3b7272bb6de3425fa18a474080a9c1a2)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:48.878331 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736c60c-18bd-4f9e-9dd1-24dfe9c92793 admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:48.890918 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1436/2906] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jul 21 22:40:48 2022] PUT /identity/v3/projects/9b183b3385094287b12cb5a4a28f79cc/users/be2bb816670242c282a81aef8ccc31bc/roles/3b7272bb6de3425fa18a474080a9c1a2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:40:48.902237 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf1928-dbc6-411b-b693-7e35018a35bb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:48.902747 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf1928-dbc6-411b-b693-7e35018a35bb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:48.902863 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf1928-dbc6-411b-b693-7e35018a35bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:48.922181 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:48.931208 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c3cf1928-dbc6-411b-b693-7e35018a35bb None None] MFA Rules not processed for user `be2bb816670242c282a81aef8ccc31bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:48.933156 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c3cf1928-dbc6-411b-b693-7e35018a35bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:48.995289 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1471/2907] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 22:40:49.006631 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736c60c-18bd-4f9e-9dd1-24dfe9c92793 admin admin] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:49.008244 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-d736c60c-18bd-4f9e-9dd1-24dfe9c92793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:49.041960 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:49.085310 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736c60c-18bd-4f9e-9dd1-24dfe9c92793 admin admin] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:49.089420 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61ecde-3d24-43f7-8396-7b5386774978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de7ad1ebf93b4e1db64e3ccf72fa54b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:49.090068 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61ecde-3d24-43f7-8396-7b5386774978 service cinder] REQUEST_METHOD: `GET` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:49.090349 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61ecde-3d24-43f7-8396-7b5386774978 service cinder] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:49.090624 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61ecde-3d24-43f7-8396-7b5386774978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:49.098819 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61ecde-3d24-43f7-8396-7b5386774978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:49.100251 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61ecde-3d24-43f7-8396-7b5386774978 service cinder] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:49.109827 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1437/2908] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:49.134333 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf1928-dbc6-411b-b693-7e35018a35bb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:49.194836 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf1928-dbc6-411b-b693-7e35018a35bb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:49.199326 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d015709-95d3-4ddb-b277-0da6895ef505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:49.200185 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d015709-95d3-4ddb-b277-0da6895ef505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:49.200469 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d015709-95d3-4ddb-b277-0da6895ef505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:49.200743 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d015709-95d3-4ddb-b277-0da6895ef505 admin admin] PATH_INFO: `/v3/users/be2bb816670242c282a81aef8ccc31bc` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:49.201946 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d015709-95d3-4ddb-b277-0da6895ef505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2bb816670242c282a81aef8ccc31bc)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:49.203880 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d015709-95d3-4ddb-b277-0da6895ef505 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:49.247603 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9d015709-95d3-4ddb-b277-0da6895ef505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2bb816670242c282a81aef8ccc31bc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:49.259183 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9d015709-95d3-4ddb-b277-0da6895ef505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2bb816670242c282a81aef8ccc31bc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:49.266400 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9d015709-95d3-4ddb-b277-0da6895ef505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2bb816670242c282a81aef8ccc31bc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:49.267057 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9d015709-95d3-4ddb-b277-0da6895ef505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2bb816670242c282a81aef8ccc31bc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:49.273519 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9d015709-95d3-4ddb-b277-0da6895ef505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2bb816670242c282a81aef8ccc31bc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:49.280085 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1472/2909] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jul 21 22:40:49 2022] DELETE /identity/v3/users/be2bb816670242c282a81aef8ccc31bc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 22:40:49.284644 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7ff95-a132-4360-83ab-f99a2bea8afc None None] REQUEST_METHOD: `POST` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:49.284973 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7ff95-a132-4360-83ab-f99a2bea8afc None None] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:49.285242 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7ff95-a132-4360-83ab-f99a2bea8afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:49.303008 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.auth.core [None req-39a7ff95-a132-4360-83ab-f99a2bea8afc None None] MFA Rules not processed for user `f173d7158e2a4553aa3707927ef2704b`. Rule list: `[]` (Enabled: `True`). {{(pid=80107) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 22:40:49.304213 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-39a7ff95-a132-4360-83ab-f99a2bea8afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:49.361308 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1438/2910] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jul 21 22:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 22:40:49.371452 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d015709-95d3-4ddb-b277-0da6895ef505 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:49.372886 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9d015709-95d3-4ddb-b277-0da6895ef505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:49.394896 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:49.431340 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d015709-95d3-4ddb-b277-0da6895ef505 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:49.435059 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83013a-b254-4a79-9a83-81aaa4c87463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23aaef489c0948fe8bc10acb8e76c84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:49.435729 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83013a-b254-4a79-9a83-81aaa4c87463 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:49.436021 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83013a-b254-4a79-9a83-81aaa4c87463 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:49.436300 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83013a-b254-4a79-9a83-81aaa4c87463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:49.445348 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83013a-b254-4a79-9a83-81aaa4c87463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:49.446784 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83013a-b254-4a79-9a83-81aaa4c87463 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:49.456109 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1473/2911] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:40:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:40:49.717296 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7ff95-a132-4360-83ab-f99a2bea8afc None None] Authenticating user token {{(pid=80107) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:40:49.718879 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.fernet_utils [None req-39a7ff95-a132-4360-83ab-f99a2bea8afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80107) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:40:49.731752 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7ff95-a132-4360-83ab-f99a2bea8afc None None] Validating token access rules against request {{(pid=80107) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:40:49.736388 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78f470-f4ef-411f-8579-b08ff0ff452e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f173d7158e2a4553aa3707927ef2704b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cde20a12b28d4325b013339974b4c146', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80107) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:40:49.737350 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78f470-f4ef-411f-8579-b08ff0ff452e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:40:49.737642 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78f470-f4ef-411f-8579-b08ff0ff452e admin admin] SCRIPT_NAME: `/identity` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:40:49.737927 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78f470-f4ef-411f-8579-b08ff0ff452e admin admin] PATH_INFO: `/v3/projects/9b183b3385094287b12cb5a4a28f79cc` {{(pid=80107) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:40:49.739166 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78f470-f4ef-411f-8579-b08ff0ff452e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b183b3385094287b12cb5a4a28f79cc)` {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:40:49.741129 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78f470-f4ef-411f-8579-b08ff0ff452e admin admin] RBAC: Authorization granted {{(pid=80107) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:40:49.788312 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ca78f470-f4ef-411f-8579-b08ff0ff452e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b183b3385094287b12cb5a4a28f79cc', 'request_id': 'req-ca78f470-f4ef-411f-8579-b08ff0ff452e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:49.796173 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ca78f470-f4ef-411f-8579-b08ff0ff452e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b183b3385094287b12cb5a4a28f79cc', 'request_id': 'req-ca78f470-f4ef-411f-8579-b08ff0ff452e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:49.801675 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ca78f470-f4ef-411f-8579-b08ff0ff452e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b183b3385094287b12cb5a4a28f79cc', 'request_id': 'req-ca78f470-f4ef-411f-8579-b08ff0ff452e'} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:49.812900 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ca78f470-f4ef-411f-8579-b08ff0ff452e admin admin] The token cache is being invalidate because project 9b183b3385094287b12cb5a4a28f79cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80107) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 22:40:49.813514 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ca78f470-f4ef-411f-8579-b08ff0ff452e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:49.813847 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG keystone.notifications [None req-ca78f470-f4ef-411f-8579-b08ff0ff452e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80107) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 22:40:49.815374 dv-cinder-850697-1-smb devstack@keystone.service[80107]: [pid: 80107|app: 0|req: 1439/2912] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jul 21 22:40:49 2022] DELETE /identity/v3/projects/9b183b3385094287b12cb5a4a28f79cc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 22:40:59.452044 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=17 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:59.809986 dv-cinder-850697-1-smb devstack@keystone.service[80107]: DEBUG dbcounter [-] [80107] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80107) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:52.388697 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83013a-b254-4a79-9a83-81aaa4c87463 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 22:43:52.390731 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-df83013a-b254-4a79-9a83-81aaa4c87463 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:43:52.457585 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83013a-b254-4a79-9a83-81aaa4c87463 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 22:43:52.513501 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34446ef-e31d-4c14-aa0b-2cb3a245b759 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba75bf6ef954eb59d8db1efa6c73d8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6e77f9cc1c14e35b1d3e1874f107494', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 22:43:52.514680 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34446ef-e31d-4c14-aa0b-2cb3a245b759 service placement] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 22:43:52.514958 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34446ef-e31d-4c14-aa0b-2cb3a245b759 service placement] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 22:43:52.515234 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34446ef-e31d-4c14-aa0b-2cb3a245b759 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 22:43:52.517003 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f34446ef-e31d-4c14-aa0b-2cb3a245b759 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 22:43:52.527955 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34446ef-e31d-4c14-aa0b-2cb3a245b759 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 22:43:52.529583 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34446ef-e31d-4c14-aa0b-2cb3a245b759 service placement] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 22:43:52.539458 dv-cinder-850697-1-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1474/2913] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jul 21 22:43:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 22:44:02.535272 dv-cinder-850697-1-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=58 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}